AI Gateway

Discover the AI Gateway capabilities of the kgateway project

Lessons

Deploying an AI gateway

Learn to provision AI gateways for proxying LLMs.

LLM Credentials management with AI gateways

Learn how to manage credentials across LLM providers.

Prompt guards

Learn the fundamentals of ensuring the safety of your LLM content with prompt guards.

Prompt enrichment

Explore how to manage your system and user prompts in API calls to LLMs.

Model failover (*)

Learn how to configure failover for calls to LLMs.

Gateway API Inference extension

Learn to enable intelligent AI request routing with the Gateway API Inference Extension.