dailyai.stream

dailyai.stream

your daily ink of AI news

TUE, NOV 17 · CODING & AGENTS
CODING & AGENTS

Vercel AI Gateway can now route to your own model endpoints

Vercel's AI Gateway now supports Private Inference, which lets you connect your own model endpoints to the gateway. You can switch between private models and catalog models, and the gateway translates each request into that endpoint's format. Private models stay scoped to your team. Credentials are encrypted, and Zero Data Retention is optional. Requests to private models show up in the gateway logs next to catalog model requests. Setting it up through the CLI requires Vercel CLI 65.16.0 or later.

The Private Inference page in the Vercel AI Gateway dashboard, listing connected providers such as a self-hosted vLLM endpoint with their private model IDs and API formats.
Image: Vercel
Why it matters for builders

If you serve your own model, it can now sit behind the same gateway as the hosted ones, and both show up in one log view. The practical win is failover. You can set a catalog model as the fallback when your private endpoint fails. Configure that before you send production traffic to your own endpoint, not after its first outage.

Read on vercel.com →

One card. Back to the feed for the rest.