Definition
A model gateway is a single routing layer through which every AI model call passes, making it possible to swap providers, control access and track usage and cost.
Why it matters
- No model lock-in: switching from one model to another, or from hosted to self-hosted, is configuration.
- Control: some agents can be blocked from hosted models entirely.
- Visibility: usage and model cost per department.
LiteLLM is a common open-source gateway.
See deployment.