---
title: "LLM"
url: "/guides/llm/"
kind: "hub"
summary: "Guides for the LLM gateway: one endpoint in front of several model providers, with failover, token budgets and guardrails."
---

> Arion site index: [/llms.txt](/llms.txt)

# LLM

Guides for the LLM gateway: one endpoint in front of several model providers, with failover, token budgets and guardrails.

The LLM gateway's guides are under construction and land with the feature. They will cover putting one endpoint in front of several model providers, with failover, token budgets and guardrails. Until then, start at the [LLM gateway docs](@/docs/llm-gateway/overview.md), or see [AI inference](@/guides/inference/_index.md) for routing to self-hosted model servers.