Together Batch Inference
Asynchronous bulk inference for workloads that do not need a real-time response, priced below Together's serverless rate.
Find alternatives to Together Batch Inference
Metered per token, at a discount to the serverless rate.
What it does
- Model inference
Sources
- Pricing
-
Together AI publishes per-unit and per-GPU-hour rates; each service is metered separately and bought on its own.
- Description
-
Official documentation · 6 Sep 2026
Summarised from the page's own title, <h1> and meta description, fetched 2026-09-06.
- Sold within
-
Together AI publishes per-unit and per-GPU-hour rates; each service is metered separately and bought on its own. Corrected at apply time: parent set to null.
standalonemeans no parent OFFERING stands between the buyer and the product; the vendor's own company name is not such an offering. - URL
-
Official documentation · 6 Sep 2026
Fetched 2026-09-06: HTTP 200, <title> 'Batch Inference | Together AI', <h1> 'Process massive workloads asynchronously'.
Also from Together AI
-
Together GPU Clusters Infrastructure service
Reserved NVIDIA GPU clusters for training and large-scale inference.
-
Together Inference Model API
Hosted API serving open-weight text, image and audio models, billed per token.
-
Together Fine-Tuning API service
A managed service for fine-tuning open-source models on a customer's own data and serving the result on Together's infrastructure.
-
Together Custom Training Developer tool
Custom model training service covering supervised fine-tuning and direct preference optimization, billed per token.
-
Together Dedicated Container Inference Infrastructure service
Dedicated, reserved GPU containers for model inference with guaranteed performance, billed per GPU-hour.
Open Together AI in the directory
Something wrong here? Send a correction — quote this product id: together-batch-inference.