kgateway kgateway
  • 2.1 (main)
  • 2.0 (latest)
Home Blog Get Started Why kgateway
CTRL K
    CTRL K
      • Blog
        • Adding Distributed Tracing to AI Gateway: My LFX Mentorship Journey
        • llm-d - Distributed Inference Serving on Kubernetes
        • Delegation in kgateway - scaling routing with multi-tenant ownership
        • Designing kgateway for Scalability – Not All Gateways Are Created Equal
        • Get Better Results from your LLM with AI Gateway Prompt Enrichment
        • How prioritized model load-balancing helps keep your AI-powered workloads running
        • Dive into Basic Prompt Guardrails with kgateway
        • Transformations in kgateway
        • Extend Istio Ambient Mesh with Kgateway as Waypoints
        • Understanding Gateway API Basics
        • Microgateway Patterns with kgateway and Ambient
        • Canary Deployments with kgateway and Argo Rollouts
        • Deep Dive into the Gateway API Inference Extension
        • Exploring the Gateway API's HTTPRoute
        • Shared Gateways in kgateway
        • Smarter AI Inference Routing on Kubernetes with Gateway API Inference Extension
        • Policy attachments with kgateway and Gateway API
        • Supporting Service Mesh with kgateway and Gateway API
        • Configuring HTTPS routes with the Gateway API
        • Guide to Installing kgateway
        • Introduction to the Kubernetes Gateway API
        • Five Learnings from Seven Years of Building Gloo and kgateway
        • Navigating DeepSeek R1, Security Concerns, and Guardrails
        • Advancing Open Source Gateways with the CNCF and kgateway
      • Docs
        • Documentation
          • Get started
          • About
            • Overview
            • Architecture
            • Deployment patterns
            • Custom resources
            • Policies
              • BackendConfigPolicy
              • HTTPListenerPolicy
              • TrafficPolicy
              • Policy merging
          • Gateway setup
            • Default gateway proxy setup
            • Gateway customization
              • Customize gateway proxies
              • AWS ELBs
                • AWS ALB
                • AWS NLB
              • Self-managed gateways (BYO)
            • Listeners
              • Listener overview
              • HTTP
              • HTTPS
              • SNI
              • TCP
              • TLS passthrough
          • Traffic management
            • Destination types
              • Kubernetes services
                • HTTP services
                • gRPC services
              • Backends
                • Static
                • AWS Lambda
                  • Access AWS Lambda with a credentials secret
                  • Access AWS Lambda with a service account
            • Buffering
            • Direct responses
            • External processing (ExtProc)
            • Header control
              • Request headers
              • Response headers
            • Health checks
              • Gateway health checks
              • Backend health checks
            • HTTP/2
            • Redirects
              • HTTPS redirect
              • Host redirect
              • Path redirects
            • Request matching
              • Header
              • Host
              • HTTP method
              • Path
              • Query parameter
            • Rewrites
              • Host rewrites
              • Path rewrites
            • Route delegation
              • Route delegation overview
              • Basic example
              • Delegation via labels
              • Multiple parents
              • Multi-level delegation
              • Header and query match
              • Policy inheritance and overrides
                • Native Gateway API policies
                • Kgateway policies
            • Session affinity
              • Simple load balancing
              • Consistent hashing
              • Session persistence
            • Traffic splitting
            • Transformations
              • Templating language
              • Inject response headers
              • Decode base64 headers
              • Update request paths and methods
              • Create redirect URLs
              • Change response status
              • Update response body
          • Resiliency
            • HTTP connection settings
            • Mirroring
            • Retries
            • TCP keepalive
            • Timeouts
          • Security
            • Access logging
            • CORS
            • CSRF
            • External auth
            • Rate limit
              • Local rate limiting
            • HTTPS listener
            • SNI listener
            • TLS passthrough
            • ExternalDNS and Cert-Manager
            • Istio ambient mesh for mTLS
          • AI Gateway
            • About AI Gateway
            • Set up AI Gateway
            • Cloud LLM providers
            • Ollama for local LLMs
            • Authenticate to the LLM
            • Model failover
            • Function calling
            • Prompt enrichment
            • Prompt guards
            • AI observability
            • Cleanup
          • Integrations
            • Argo Rollouts
            • AWS ELBs
            • ExternalDNS and cert-manager
            • Inference Extension
            • Istio
              • Ambient
                • Ingress
                • Waypoint proxy
              • Sidecar
                • Ingress
          • Observability
            • Gateway proxy metrics
          • Operations
            • Install
            • Sample HTTP app
            • Debug your setup
            • Upgrade
            • Uninstall
          • Reference
            • API reference
            • CLI
              • Install the kgwctl CLI
              • Visualize resource dependencies
              • Commands
                • kgwctl analyze
                • kgwctl check
                • kgwctl completion
                • kgwctl describe
                • kgwctl get
                • kgwctl help
            • Helm value reference
              • Crds
              • Helm
            • Open Source Attribution
            • Port reference
            • Security vulnerabilities
            • Version support
            • Contributor guide
              • Add documentation
              • Preview and build locally
              • Style guide
            • Release notes
          • FAQs
        • Documentation
          • Get started
          • About
            • Overview
            • Architecture
            • Deployment patterns
            • Custom resources
            • Gateway proxies
            • Policies
              • BackendConfigPolicy
              • HTTPListenerPolicy
              • TrafficPolicy
              • Global policy attachment
              • Policy merging
          • Gateway setup
            • Default gateway proxy setup
            • Gateway customization
              • Customize gateway proxies
              • AWS ELBs
                • AWS ALB
                • AWS NLB
              • Self-managed gateways (BYO)
            • Listeners
              • Listener overview
              • HTTP
              • HTTPS
              • SNI
              • TCP
              • TLS passthrough
          • Traffic management
            • Destination types
              • Kubernetes services
                • HTTP services
                • gRPC services
              • Backends
                • Static
                • AWS Lambda
                  • Access AWS Lambda with a credentials secret
                  • Access AWS Lambda with a service account
            • Buffering
            • Direct responses
            • External processing (ExtProc)
            • Header control
              • Request headers
              • Response headers
            • Health checks
              • Gateway health checks
              • Backend health checks
            • HTTP/2
            • Redirects
              • HTTPS redirect
              • Host redirect
              • Path redirects
            • Request matching
              • Header
              • Host
              • HTTP method
              • Path
              • Query parameter
            • Rewrites
              • Host rewrites
              • Path rewrites
            • Route delegation
              • Route delegation overview
              • Basic example
              • Delegation via labels
              • Multiple parents
              • Multi-level delegation
              • Header and query match
              • Policy inheritance and overrides
                • Native Gateway API policies
                • Kgateway policies
            • Session affinity
              • Simple load balancing
              • Consistent hashing
              • Session persistence
            • Traffic splitting
            • Transformations
              • Templating language
              • Inject response headers
              • Decode base64 headers
              • Update request paths and methods
              • Create redirect URLs
              • Change response status
              • Update response body
            • Weighted routing
          • Resiliency
            • HTTP connection settings
            • Mirroring
            • Retries
            • TCP keepalive
            • Timeouts
          • Security
            • Access logging
            • Backend TLS
            • CORS
            • CSRF
            • External auth
            • Rate limit
              • Local rate limiting
              • Global rate limiting
            • HTTPS listener
            • SNI listener
            • TLS passthrough
            • ExternalDNS and Cert-Manager
            • Istio ambient mesh for mTLS
          • AI Gateway
            • About AI Gateway
            • Set up AI Gateway
            • Cloud LLM providers
            • Ollama for local LLMs
            • Authenticate to the LLM
            • Model failover
            • Function calling
            • Prompt enrichment
            • Prompt guards
            • AI observability
            • Cleanup
          • Agentgateway
            • About
            • Routes
            • AI for LLM consumption
            • MCP
              • Static MCP
              • Dynamic MCP
            • Agent-to-agent (A2A)
          • Integrations
            • Argo Rollouts
            • AWS ELBs
            • ExternalDNS and cert-manager
            • Inference Extension
            • Istio
              • Ambient
                • Ingress
                • Waypoint proxy
              • Sidecar
                • Ingress
          • Observability
            • OTel stack
            • Control plane metrics
            • Gateway proxy metrics
          • Operations
            • Install
            • Sample HTTP app
            • Debug your setup
            • Upgrade
            • Uninstall
          • Reference
            • API reference
            • CLI
              • Install the kgwctl CLI
              • Visualize resource dependencies
              • Commands
                • kgwctl analyze
                • kgwctl check
                • kgwctl completion
                • kgwctl describe
                • kgwctl get
                • kgwctl help
            • Helm value reference
              • Crds
              • Helm
            • Open Source Attribution
            • Port reference
            • Security vulnerabilities
            • Version support
            • Contributor guide
              • Add documentation
              • Preview and build locally
              • Style guide
            • Release notes
          • FAQs
      • Learning paths
      • Resources
        • Labs
        • Videos
      • Slack
      • Documentation
        • Get started
        • About
          • Overview
          • Architecture
          • Deployment patterns
          • Custom resources
          • Policies
            • BackendConfigPolicy
            • HTTPListenerPolicy
            • TrafficPolicy
            • Policy merging
        • Gateway setup
          • Default gateway proxy setup
          • Gateway customization
            • Customize gateway proxies
            • AWS ELBs
              • AWS ALB
              • AWS NLB
            • Self-managed gateways (BYO)
          • Listeners
            • Listener overview
            • HTTP
            • HTTPS
            • SNI
            • TCP
            • TLS passthrough
        • Traffic management
          • Destination types
            • Kubernetes services
              • HTTP services
              • gRPC services
            • Backends
              • Static
              • AWS Lambda
                • Access AWS Lambda with a credentials secret
                • Access AWS Lambda with a service account
          • Buffering
          • Direct responses
          • External processing (ExtProc)
          • Header control
            • Request headers
            • Response headers
          • Health checks
            • Gateway health checks
            • Backend health checks
          • HTTP/2
          • Redirects
            • HTTPS redirect
            • Host redirect
            • Path redirects
          • Request matching
            • Header
            • Host
            • HTTP method
            • Path
            • Query parameter
          • Rewrites
            • Host rewrites
            • Path rewrites
          • Route delegation
            • Route delegation overview
            • Basic example
            • Delegation via labels
            • Multiple parents
            • Multi-level delegation
            • Header and query match
            • Policy inheritance and overrides
              • Native Gateway API policies
              • Kgateway policies
          • Session affinity
            • Simple load balancing
            • Consistent hashing
            • Session persistence
          • Traffic splitting
          • Transformations
            • Templating language
            • Inject response headers
            • Decode base64 headers
            • Update request paths and methods
            • Create redirect URLs
            • Change response status
            • Update response body
        • Resiliency
          • HTTP connection settings
          • Mirroring
          • Retries
          • TCP keepalive
          • Timeouts
        • Security
          • Access logging
          • CORS
          • CSRF
          • External auth
          • Rate limit
            • Local rate limiting
          • HTTPS listener
          • SNI listener
          • TLS passthrough
          • ExternalDNS and Cert-Manager
          • Istio ambient mesh for mTLS
        • AI Gateway
          • About AI Gateway
          • Set up AI Gateway
          • Cloud LLM providers
          • Ollama for local LLMs
          • Authenticate to the LLM
          • Model failover
          • Function calling
          • Prompt enrichment
          • Prompt guards
          • AI observability
          • Cleanup
        • Integrations
          • Argo Rollouts
          • AWS ELBs
          • ExternalDNS and cert-manager
          • Inference Extension
          • Istio
            • Ambient
              • Ingress
              • Waypoint proxy
            • Sidecar
              • Ingress
        • Observability
          • Gateway proxy metrics
        • Operations
          • Install
          • Sample HTTP app
          • Debug your setup
          • Upgrade
          • Uninstall
        • Reference
          • API reference
          • CLI
            • Install the kgwctl CLI
            • Visualize resource dependencies
            • Commands
              • kgwctl analyze
              • kgwctl check
              • kgwctl completion
              • kgwctl describe
              • kgwctl get
              • kgwctl help
          • Helm value reference
            • Crds
            • Helm
          • Open Source Attribution
          • Port reference
          • Security vulnerabilities
          • Version support
          • Contributor guide
            • Add documentation
            • Preview and build locally
            • Style guide
          • Release notes
        • FAQs
      • Documentation
        • Get started
        • About
          • Overview
          • Architecture
          • Deployment patterns
          • Custom resources
          • Gateway proxies
          • Policies
            • BackendConfigPolicy
            • HTTPListenerPolicy
            • TrafficPolicy
            • Global policy attachment
            • Policy merging
        • Gateway setup
          • Default gateway proxy setup
          • Gateway customization
            • Customize gateway proxies
            • AWS ELBs
              • AWS ALB
              • AWS NLB
            • Self-managed gateways (BYO)
          • Listeners
            • Listener overview
            • HTTP
            • HTTPS
            • SNI
            • TCP
            • TLS passthrough
        • Traffic management
          • Destination types
            • Kubernetes services
              • HTTP services
              • gRPC services
            • Backends
              • Static
              • AWS Lambda
                • Access AWS Lambda with a credentials secret
                • Access AWS Lambda with a service account
          • Buffering
          • Direct responses
          • External processing (ExtProc)
          • Header control
            • Request headers
            • Response headers
          • Health checks
            • Gateway health checks
            • Backend health checks
          • HTTP/2
          • Redirects
            • HTTPS redirect
            • Host redirect
            • Path redirects
          • Request matching
            • Header
            • Host
            • HTTP method
            • Path
            • Query parameter
          • Rewrites
            • Host rewrites
            • Path rewrites
          • Route delegation
            • Route delegation overview
            • Basic example
            • Delegation via labels
            • Multiple parents
            • Multi-level delegation
            • Header and query match
            • Policy inheritance and overrides
              • Native Gateway API policies
              • Kgateway policies
          • Session affinity
            • Simple load balancing
            • Consistent hashing
            • Session persistence
          • Traffic splitting
          • Transformations
            • Templating language
            • Inject response headers
            • Decode base64 headers
            • Update request paths and methods
            • Create redirect URLs
            • Change response status
            • Update response body
          • Weighted routing
        • Resiliency
          • HTTP connection settings
          • Mirroring
          • Retries
          • TCP keepalive
          • Timeouts
        • Security
          • Access logging
          • Backend TLS
          • CORS
          • CSRF
          • External auth
          • Rate limit
            • Local rate limiting
            • Global rate limiting
          • HTTPS listener
          • SNI listener
          • TLS passthrough
          • ExternalDNS and Cert-Manager
          • Istio ambient mesh for mTLS
        • AI Gateway
          • About AI Gateway
          • Set up AI Gateway
          • Cloud LLM providers
          • Ollama for local LLMs
          • Authenticate to the LLM
          • Model failover
          • Function calling
          • Prompt enrichment
          • Prompt guards
          • AI observability
          • Cleanup
        • Agentgateway
          • About
          • Routes
          • AI for LLM consumption
          • MCP
            • Static MCP
            • Dynamic MCP
          • Agent-to-agent (A2A)
        • Integrations
          • Argo Rollouts
          • AWS ELBs
          • ExternalDNS and cert-manager
          • Inference Extension
          • Istio
            • Ambient
              • Ingress
              • Waypoint proxy
            • Sidecar
              • Ingress
        • Observability
          • OTel stack
          • Control plane metrics
          • Gateway proxy metrics
        • Operations
          • Install
          • Sample HTTP app
          • Debug your setup
          • Upgrade
          • Uninstall
        • Reference
          • API reference
          • CLI
            • Install the kgwctl CLI
            • Visualize resource dependencies
            • Commands
              • kgwctl analyze
              • kgwctl check
              • kgwctl completion
              • kgwctl describe
              • kgwctl get
              • kgwctl help
          • Helm value reference
            • Crds
            • Helm
          • Open Source Attribution
          • Port reference
          • Security vulnerabilities
          • Version support
          • Contributor guide
            • Add documentation
            • Preview and build locally
            • Style guide
          • Release notes
        • FAQs
      Docs
      Documentation
      Reference
      CLI

      CLI

      Install the kgwctl CLI Visualize resource dependencies kgwctl commands
      Kgateway was originally created by Solo.io and was known as Gloo.
      GitHub Slack X Bluesky Mastodon LinkedIn YouTube

      We are a Cloud Native Computing Foundation sandbox project

      Copyright © kgateway, a Series of LF Projects, LLC.
      Website terms of use, trademark policy and other project policies