AssemblyAI LLM Gateway
OpenAI-compatible API that routes requests to GPT, Claude, Gemini, Qwen and other hosted models with automatic fallbacks, at the providers' own token prices with no markup, beside AssemblyAI's speech APIs.
Find alternatives to AssemblyAI LLM Gateway
What it does
- Model inference
Features 5
- Automatic fallbacksConfigure backup models per request so calls still go through when a provider errors or stalls.
- OpenAI-compatible APIDrops into any OpenAI SDK by changing a base URL and a model string.
- Zero markup pricingPay provider rates with no gateway markup, hidden fees or minimum commitment.
- Model catalog with filtersBrowse and filter dozens of open and frontier models by provider, region, features and task.
- Voice Standard BenchScores models on real transcripts for performance, cost and speed to help pick a model per voice task.
Sources
- Pricing
-
Official documentation · 9 Oct 2026
"You pay the same price as the underlying provider—zero markup. No additional fees from AssemblyAI to use the Gateway." Pricing page token table, for example GPT-5.1 $1.25 per 1M input and $10.00 per 1M output tokens, Claude Sonnet 4.6 $3.00 and $15.00; "In-region (US/EU) pricing is 10% higher". Docs: "LLM Gateway is not covered by the $50 free tier."
- Description
-
Official documentation · 9 Oct 2026
"AssemblyAI's LLM Gateway is a single, OpenAI-compatible API that routes requests to GPT, Claude, Gemini, Qwen, and other frontier models—with automatic fallbacks, no markup, and zero data retention available on every call."
- What it does
-
Official documentation · 9 Oct 2026
Routes inference requests to hosted language models.
- Sold within
-
Official documentation · 9 Oct 2026
"Use as a standalone service or make use of our easy integration with AssemblyAI speech-to-text products." Its own per-model token table on the pricing page.
- Name
-
Official documentation · 9 Oct 2026
Page heading: "LLM Gateway".
- URL
-
Official documentation · 9 Oct 2026
The product's own page.
- Deployment
-
Official documentation · 9 Oct 2026
Hosted; "EU customers can route requests through EU-hosted infrastructure for GDPR compliance."
- Interfaces
-
Official documentation · 9 Oct 2026
"Any OpenAI SDK or HTTP client works—change the base URL and API key, and the rest of your code is unchanged."
- Modalities
-
Official documentation · 12 Oct 2026
Page: 'We focus on text to text LLM providers with regional compliance, security, and ZDR'.
- Intended for
-
Official documentation · 9 Oct 2026
An API for developers.
Also from AssemblyAI
-
AssemblyAI Pre-recorded Speech-to-Text API API service
Speech-to-text API for recorded audio and video files: transcripts in 99 languages with speaker diarization, language detection, word-level timestamps and keyterm prompting, billed per second of audio.
-
AssemblyAI Realtime Speech-to-Text API API service
Live transcription API: audio streamed over a WebSocket comes back as text within a few hundred milliseconds, with endpointing for voice agents, sold by the hour of session time and also offered self-hosted.
-
AssemblyAI Voice Agent API API service
One connection that runs a production voice agent end to end: speech recognition, a conversational language model, voice generation, turn detection, interruptions and tool calls, at one flat hourly rate.
-
AssemblyAI Speech Understanding API API service
Add-on models switched on in a transcription request that turn recorded audio into structured output: speaker labels, sentiment, entities, topics, key phrases, summaries, translation and custom formatting, each priced per audio hour.
-
AssemblyAI Guardrails API service
Safety add-ons for transcription requests: profanity filtering, content moderation and redaction of personal data in the transcript text and in the audio itself, each toggled per request.
-
Sync Speech-to-Text API API service
Returns a transcript of a short audio clip in a synchronous API response.
-
Dictation API API service
Converts spoken audio into text with a cleanup pass and an accompanying verbatim transcript.
-
Blurt Application
Converts speech into text wherever the user is typing.
Open AssemblyAI in the directory
Something wrong here? Send a correction — quote this product id: assemblyai-llm-gateway.