Cleanup

Remove the AI Gateway resources that you created as part of the guides.

  1. Remove the Backend resource for the LLM provider.

    kubectl delete backend openai -n kgateway-system
  2. Delete any LLM provider credentials, model failover, TrafficPolicy, and other AI Gateway resources that you created.

    kubectl delete secret -n kgateway-system openai-secret
    kubectl delete backend,deployment,httproute,service -n kgateway-system -l app=model-failover
    kubectl delete TrafficPolicy -n kgateway-system -l app=ai-gateway
  3. Remove the AI Gateway.

    kubectl delete gateway ai-gateway -n kgateway-system
    kubectl delete gatewayparameters ai-gateway -n kgateway-system
  4. Disable the AI extension in your kgateway Helm chart.

    ⚠️
    If you use a different version or extra Helm settings such as in a -f values.yaml file, update the following command accordingly.
    helm upgrade -i -n kgateway-system kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway \
      --set gateway.aiExtension.enabled=false \
      --version v$NEW_VERSION