Latest news and updates from LLM Gateway
Cache-aware LLM routing learns cache-hit rates and token proportions from your project's recent model usage, so provider selection reflects the workload you actually run. Available automatically across plans, with explicit per-project overrides on Enterprise.
The LLM Gateway CLI now signs in through your browser or enterprise SSO, installs your organization's shared skills into Claude Code, Codex, OpenCode, Cursor, and more, and launches 15 coding agents pre-wired to the gateway. Organization skills are an Enterprise feature; browser login works on every plan.
LLM Gateway Chat now has Projects: group related chats, upload files — PDFs and spreadsheets included — as a knowledge base, and get answers grounded in your own documents via RAG, with source citations, on any of 280+ models. Projects also remember durable facts across chats. Available to every Chat user.
DevPass Code is an open-source terminal coding agent that talks only to LLM Gateway. One browser login, every model, and no per-provider API keys to juggle. Use it pay-as-you-go or on a DevPass coding subscription.
Most dashboards show what you spent, not where it went. LLM Gateway's enterprise LLM analytics break cost, requests, and tokens down by model, project, API key, and team member — no data warehouse to build. Member and organization-wide analytics are available on the Enterprise plan.
All three ByteDance Seedance video generation models — 2.0, 2.0 Fast, and 1.5 Pro with native audio — are now live on LLM Gateway. Same API key. Same billing. Same dashboard.
Generate vectors for semantic search, clustering, and RAG through the same gateway you already use for chat. OpenAI-compatible, drop-in, and tracked alongside your model spend.
A practical breakdown of how intelligent routing, caching, and model selection through an LLM gateway can dramatically reduce your AI infrastructure costs.
Why building directly against a single LLM provider's API is riskier than you think, and how a gateway layer protects your AI investment.
Learn why simple LLM proxies aren't enough and how a unified AI gateway delivers centralized access control, cost visibility, compliance, and security.