Together Provisioned Throughput
Reserved inference capacity for open models, bought in Provisioned Throughput Units that each hold a fixed tokens-per-minute rate, with a 99% uptime SLA and overflow routed to Together's serverless fleet at list price.
Find alternatives to Together Provisioned Throughput
What it does
- Model inference
Sources
- Pricing
-
"Reserve dedicated capacity in throughput units (PTUs). Each PTU represents fixed capacity. The tokens-per-minute it delivers depends on the model and the token type." with a per-model PTU rate table and a cost estimator.
- Description
-
Official documentation · 18 Oct 2026
"Each PTU represents a fixed amount of normalized token throughput per minute (TPM). Your reserved capacity is held exclusively for you." "When traffic exceeds your purchased capacity, we'll do our best to route overflow to our serverless fleet at list price."
- What it does
-
Official documentation · 18 Oct 2026
"Provisioned Throughput gives you reserved inference capacity for frontier open models" (page description).
- Sold within
-
The pricing page lists Provisioned Throughput as its own priced section; no parent product is named.
- Name
-
Official documentation · 18 Oct 2026
Heading "Provisioned Throughput"; "Buy Provisioned Throughput Units for the model you're running."
- URL
-
Official documentation · 18 Oct 2026
The product's own page, "Provisioned Throughput | Together AI", linked from the Inference menu as "Token-based capacity with SLAs".
- Deployment
-
Official documentation · 18 Oct 2026
"Drop-in API compatibility. No infrastructure to manage."
- Interfaces
-
Official documentation · 18 Oct 2026
"Drop-in API compatibility. No infrastructure to manage. Send your traffic and let the SLA do its job."
- Intended for
-
Official documentation · 18 Oct 2026
"Committed throughput, hard SLAs, and defined overage behavior. Everything production teams need without any infrastructure overhead."
Also from Together AI
-
Together GPU Clusters Infrastructure service
Reserved NVIDIA GPU clusters for training and large-scale inference.
-
Together Inference Model API
Hosted API serving open-weight text, image and audio models, billed per token.
-
Together Fine-Tuning API service
A managed service for fine-tuning open-source models on a customer's own data and serving the result on Together's infrastructure.
-
Together Batch Inference API service
Asynchronous bulk inference for workloads that do not need a real-time response, priced below Together's serverless rate.
-
Together Custom Training Developer tool
Custom model training service covering supervised fine-tuning and direct preference optimization, billed per token.
-
Together Dedicated Container Inference Infrastructure service
Dedicated, reserved GPU containers for model inference with guaranteed performance, billed per GPU-hour.
-
Together Dedicated Model Inference Infrastructure service
Dedicated single-tenant GPU endpoints for open-weight or custom models pulled from Hugging Face or S3, with autoscaling, canary and rolling rollouts and multi-region failover, billed per GPU-hour.
-
Together Frontier AI Factory Infrastructure service
Private GPU cloud built to order for frontier-scale training, fine-tuning and inference, from 1,000 to 100,000+ NVIDIA GPUs with managed Kubernetes or Slurm and direct access to Together's research team.
Open Together AI in the directory
Something wrong here? Send a correction — quote this product id: together-provisioned-throughput.