For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
AI Gateway
Unleash developer productivity and accelerate AI innovation with AI Gateway.
Explore what you can do with AI Gateway in the following guides.
About AI Gateway
Unleash developer productivity and accelerate AI innovation with AI Gateway.
Set up AI Gateway
Use a custom GatewayParameters resource to set up AI Gateway.
Cloud LLM providers
Set up cloud LLM providers with AI Gateway.
Ollama for local LLMs
Set up Ollama as a local LLM provider with AI Gateway.
Authenticate to the LLM
Let AI Gateway send requests to an LLM provider.
Model failover
Function calling
Prompt enrichment
Effectively manage system and user prompts to improve LLM outputs.
Prompt guards
Secure access to the LLM and the data that is returned with Web Application Filter and Data Loss …
AI observability
Cleanup
Remove the AI Gateway resources that you created as part of the guides.