Vercel AI Gateway can now route to your own model endpoints
Vercel's AI Gateway now supports Private Inference, which lets you connect your own model endpoints to the gateway. You can switch between private models and catalog models, and the gateway translates each request into that endpoint's format. Private models stay scoped to your team. Credentials are encrypted, and Zero Data Retention is optional. Requests to private models show up in the gateway logs next to catalog model requests. Setting it up through the CLI requires Vercel CLI 65.16.0 or later.
If you serve your own model, it can now sit behind the same gateway as the hosted ones, and both show up in one log view. The practical win is failover. You can set a catalog model as the fallback when your private endpoint fails. Configure that before you send production traffic to your own endpoint, not after its first outage.