Together Batch Inference

API service

Asynchronous bulk inference for workloads that do not need a real-time response, priced below Together's serverless rate.

Find alternatives to Together Batch Inference

TypeAPI service
RoleStandalone tool
AvailabilitySold
DeploymentSaaS
Intended forDeveloper
SecurityVendor-asserted
CertificationsNot recorded
Trains on customer dataNo
Zero data retentionAvailable
Data residencyNot recorded
Security featuresNot recorded
StatusActive
Sold withinSold on its own
PricingUsage-based

What it does

Features 5

together.ai

Sources

Pricing

Pricing page · 6 Sep 2026

Together AI publishes per-unit and per-GPU-hour rates; each service is metered separately and bought on its own.

Description

Official documentation · 6 Sep 2026

Summarised from the page's own title, <h1> and meta description, fetched 2026-09-06.

Constraints

Official documentation · 2 Oct 2026

Derived from the security facts on this page, from the same source.

Security

Official documentation · 2 Oct 2026

Privacy policy (platform services). GPU clusters and custom training left out (policy routes their data to email requests). Certifications not read: trust.together.ai is script-only (see needs_browser). Training stated as opt-in only.

Sold within

Pricing page · 6 Sep 2026

Together AI publishes per-unit and per-GPU-hour rates; each service is metered separately and bought on its own. Corrected at apply time: parent set to null. standalone means no parent OFFERING stands between the buyer and the product; the vendor's own company name is not such an offering.

URL

Official documentation · 6 Sep 2026

Fetched 2026-09-06: HTTP 200, <title> 'Batch Inference | Together AI', <h1> 'Process massive workloads asynchronously'.

Interfaces

Official documentation · 12 Oct 2026

Page: 'We rely on the Batch Inference API to process very large amounts of requests'.

Modalities

Official documentation · 12 Oct 2026

Page: 'from a single uploaded JSONL file / batch_output.jsonl'.

Intended for

Self-reported · 8 Sep 2026

page describes capabilities as "purpose built for AI natives" processing offline workloads, matching serverless-inference's developer framing

Also from Together AI

Open Together AI in the directory

Something wrong here? Send a correction — quote this product id: together-batch-inference.