Together Dedicated Container Inference
Dedicated, reserved GPU containers for model inference with guaranteed performance, billed per GPU-hour.
Find alternatives to Together Dedicated Container Inference
What it does
- Model hosting
- Model inference
Features 5
- Job-level monitoringReal-time monitoring of inference jobs, GPU utilisation, queue depth and latency metrics.
- Multi-cluster scalingAutoscales rapidly to handle traffic surges of 10x.
- Priority queuingPriority-based queuing keeps critical workloads running during surges.
- Multi-GPU orchestrationDeploys video generation models across multiple GPUs through a simplified torchrun interface.
- Sprocket SDKModel logic is implemented via the Sprocket SDK, with infrastructure configured in pyproject.toml.
Sources
- Pricing
- Description
- What it does
- Constraints
-
Official documentation · 2 Oct 2026
Derived from the security facts on this page, from the same source.
- Security
-
Official documentation · 2 Oct 2026
Privacy policy (platform services). GPU clusters and custom training left out (policy routes their data to email requests). Certifications not read: trust.together.ai is script-only (see needs_browser). Training stated as opt-in only.
- Sold within
-
Own published per-GPU-hour rate card confirms standalone purchase.
- Name
- URL
- Interfaces
-
Official documentation · 12 Oct 2026
Page: 'implement model logic via the Sprocket SDK'.
- Intended for
Also from Together AI
-
Together GPU Clusters Infrastructure service
Reserved NVIDIA GPU clusters for training and large-scale inference; also takes a trained model to a production endpoint without switching providers.
-
Together Inference Model API
Hosted API serving open-weight text, image and audio models, billed per token.
-
Together Fine-Tuning API service
A managed service for fine-tuning open-source models on a customer's own data and serving the result on Together's infrastructure.
-
Together Batch Inference API service
Asynchronous bulk inference for workloads that do not need a real-time response, priced below Together's serverless rate.
-
Together Custom Training Developer tool
Custom model training service covering supervised fine-tuning and direct preference optimization, billed per token.
-
Together Provisioned Throughput API service
Reserved inference capacity for open models, bought in Provisioned Throughput Units that each hold a fixed tokens-per-minute rate, with a 99% uptime SLA and overflow routed to Together's serverless fleet at list price.
-
Together Dedicated Model Inference Infrastructure service
Dedicated single-tenant GPU endpoints for open-weight or custom models pulled from Hugging Face or S3, with autoscaling, canary and rolling rollouts and multi-region failover, billed per GPU-hour.
-
Together Frontier AI Factory Infrastructure service
Private GPU cloud built to order for frontier-scale training, fine-tuning and inference, from 1,000 to 100,000+ NVIDIA GPUs with managed Kubernetes or Slurm and direct access to Together's research team.
Open Together AI in the directory
Something wrong here? Send a correction — quote this product id: together-dedicated-inference.