Cleanup

⚠️
AI Gateway for Envoy-based gateway proxies is deprecated and is planned to be removed in version 2.2. If you want to use AI capabilities, use an agentgateway proxy instead.

Remove the AI Gateway resources that you created as part of the guides.

  1. Remove the Backend resource for the LLM provider.

    kubectl delete backend openai -n kgateway-system
  2. Delete any LLM provider credentials, model failover, TrafficPolicy, and other AI Gateway resources that you created.

    kubectl delete secret -n kgateway-system openai-secret
    kubectl delete backend,deployment,httproute,service -n kgateway-system -l app=model-failover
    kubectl delete TrafficPolicy -n kgateway-system -l app=ai-gateway
  3. Remove the AI Gateway.

    kubectl delete gateway ai-gateway -n kgateway-system
    kubectl delete gatewayparameters ai-gateway -n kgateway-system
  4. Disable the AI extension in your kgateway Helm chart.

    ⚠️
    If you use a different version or extra Helm settings such as in a -f values.yaml file, update the following command accordingly.
    helm upgrade -i -n kgateway-system kgateway oci://cr.kgateway.dev/kgateway-dev/charts/kgateway \
      --set gateway.aiExtension.enabled=false \
      --version v$NEW_VERSION