Modal Inference

Infrastructure service

Serve, scale and optimise model inference on Modal's runtime, with sub-second cold starts and autoscaling across regions.

Find alternatives to Modal Inference

TypeInfrastructure service
RoleBundled component
AvailabilitySold
DeploymentSaaS
Intended forDeveloper
SecurityVendor-asserted
CertificationsSOC 2 Type II, HIPAA BAA
Trains on customer dataNo
Zero data retentionUnknown
Data residencyUS, EU, UK, Asia-Pacific
Security featuresSSO (SAML/OIDC), SCIM provisioning, Role-based access control, Audit logs, Encryption at rest
StatusActive
Sold withinModal — Included with the parent
PricingFreemium, Usage-based

What it does

Features 6

modal.com

How it compares

Sources

Pricing

Pricing page · 5 Sep 2026

Metered per second of compute on Modal's one rate card — Nvidia B200 $0.001736/sec, H200 SXM $0.001261/sec, H100 SXM5 $0.001097/sec, A100 80GB $0.000694/sec — with $30 a month of free compute. The pro

Description

Official documentation · 5 Sep 2026

Modal's own product page for it, fetched 2026-09-05, HTTP 200.

Constraints

Official documentation · 2 Oct 2026

Derived from the security facts on this page, from the same source.

Security

Official documentation · 2 Oct 2026

Platform-wide: security, data-residency, region-selection, audit-logs, SCIM and RBAC docs. HIPAA BAA is Enterprise plan only and excludes Volumes v1, Images (most), Memory Snapshots and user code. SSO, SCIM and audit logs are Enterprise-plan features; SCIM is beta. ZDR unknown at platform level: only Inference endpoints are described as zero data retention. Training is from the Modal terms: without prior written consent Modal will not 'train any AI model using Customer Data' (this page adds that Modal will not access inputs, outputs or stored data). Customer Supplied Encryption Keys exist but are Alpha, so customer-managed-keys not recorded. Trust portal trust.modal.com is script-rendered.

Sold within

Official documentation · 5 Sep 2026

Modal's pricing page prices compute, not products: every one of the six entries in its Products nav runs on the same account and the same meter.

Interfaces

Official documentation · 8 Oct 2026

"Run pip install modal to install the modal Python package" -- a Python SDK and a CLI workflow for every product on the same account/meter; modal-notebooks additionally has a browser notebook UI.

Intended for

Self-reported · 8 Sep 2026

"AI infrastructure that developers love"; "Code-first inference" staying in application code, customer quote praising it for "power and flexibility."

Also from Modal

Open Modal in the directory

Something wrong here? Send a correction — quote this product id: modal-inference.