kgatewaykgateway
  • 2.2 (main)
  • 2.1 (latest)
Home Blog
Docs
Kgateway (Envoy) Agentgateway
CTRL K
    GitHub
    • Get started with agentgateway in Kubernetes
    • About
    • Setup
    • LLM consumption
      • About
      • Providers
      • Manage API keys
      • Model failover
      • Set up prompt guards
      • Enrich prompts
      • Call functions
      • Guardrail Webhook API
      • View metrics and logs
      • View traces
    • Inference routing
    • MCP connectivity
    • Agent connectivity
    • CEL-based RBAC
    • Configuration
    • Routes
    • Monitoring agentgateway for NACKs
    Agentgateway Docs / LLM consumption

    LLM consumption

    Consume services from LLM providers.

    About Providers Manage API keys Model failover Set up prompt guards Enrich prompts Call functions Guardrail Webhook API View metrics and logs View traces
    Kgateway was originally created by Solo.io and was known as Gloo.
    GitHub Slack X Bluesky Mastodon LinkedIn YouTube

    We are a Cloud Native Computing Foundation sandbox project

    Copyright © kgateway, a Series of LF Projects, LLC.
    Website terms of use, trademark policy and other project policies