Together Inference
Hosted API serving open-weight text, image and audio models, billed per token.
Find alternatives to Together Inference
What it does
- Model inference
Features 4
- Adaptive speculative decodingListed as a key capability that lowers latency and speeds outputs without losing quality.
- Intelligent quantizationRuns quantized models at full quality to reduce compute costs and improve speed.
- Every modality, one APIText, image, video, code and voice models are reachable through a single API.
- Pay per tokenModels are called through a single API with nothing to deploy, billed for tokens used.
How it compares
-
Modal
Specialized AI platforms like Modal, Together.ai, and Fireworks.ai
Official documentation · 19 Sep 2026
Sources
- Pricing
- Constraints
-
Official documentation · 2 Oct 2026
Derived from the security facts on this page, from the same source.
- Security
-
Official documentation · 2 Oct 2026
Privacy policy (platform services). GPU clusters and custom training left out (policy routes their data to email requests). Certifications not read: trust.together.ai is script-only (see needs_browser). Training stated as opt-in only.
- Sold within
-
Together's pricing page publishes a per-model rate card headed "Price per 1M tokens", and the serverless inference page says to "pay only for the tokens you use".
- Deployment
-
Inferred 2026-09-08, not read off a page: every already-decided product of type 'model-api' in this catalogue includes "saas" in its deployment list, zero exceptions, per item 198's measured cross-tab. May be incomplete if this product also offers a self-hosted or private-cloud option; not wrong either way.
- Interfaces
-
Official documentation · 29 Sep 2026
Page states: 'Same API, better models. No code changes required. Drop in your API key and access hundreds of open-source models through the same interface you're already using', with a Python code sample against the API.
- Modalities
-
Official documentation · 12 Oct 2026
Page: 'Extract information from images as JSON. / A wireframe to app tool that takes in a UI mockup of a site and gives you React code'.
- Intended for
-
page schema describes audience as "Developers and AI engineers"; copy addresses "AI natives" wanting a unified API
Also from Together AI
-
Together GPU Clusters Infrastructure service
Reserved NVIDIA GPU clusters for training and large-scale inference; also takes a trained model to a production endpoint without switching providers.
-
Together Fine-Tuning API service
A managed service for fine-tuning open-source models on a customer's own data and serving the result on Together's infrastructure.
-
Together Batch Inference API service
Asynchronous bulk inference for workloads that do not need a real-time response, priced below Together's serverless rate.
-
Together Custom Training Developer tool
Custom model training service covering supervised fine-tuning and direct preference optimization, billed per token.
-
Together Dedicated Container Inference Infrastructure service
Dedicated, reserved GPU containers for model inference with guaranteed performance, billed per GPU-hour.
-
Together Provisioned Throughput API service
Reserved inference capacity for open models, bought in Provisioned Throughput Units that each hold a fixed tokens-per-minute rate, with a 99% uptime SLA and overflow routed to Together's serverless fleet at list price.
-
Together Dedicated Model Inference Infrastructure service
Dedicated single-tenant GPU endpoints for open-weight or custom models pulled from Hugging Face or S3, with autoscaling, canary and rolling rollouts and multi-region failover, billed per GPU-hour.
-
Together Frontier AI Factory Infrastructure service
Private GPU cloud built to order for frontier-scale training, fine-tuning and inference, from 1,000 to 100,000+ NVIDIA GPUs with managed Kubernetes or Slurm and direct access to Together's research team.
Open Together AI in the directory
Something wrong here? Send a correction — quote this product id: together-inference.