GroqCloud
Hosted inference service that serves open-weight models on Groq's own LPU hardware, billed per token.
Find alternatives to GroqCloud
What it does
- Model inference
- Accelerator silicon
Features 4
- GroqMetalDedicated bare-metal infrastructure layer of the Groq platform, tuned for speed and reliability.
- GroqCoreInference layer that turns dedicated capacity into production-ready performance without infrastructure expertise.
- GroqAssuredControl layer adding enterprise governance, auditability and control on top of the platform.
- Built-in toolsProvides built-in, server-side tools that add agentic capabilities to an application.
How it compares
-
AWS Trainium
Beyond Nvidia, Groq competes with Amazon, Google and Microsoft, all of which offer -- or will soon offer -- custom chips for AI workloads in the cloud.
News reporting · 19 Sep 2026 -
AMD Developer Cloud
Groq could consider Arm, Intel, AMD ... as rivals, too...
News reporting · 19 Sep 2026 -
AMD Developer Cloud
Groq could consider Arm, Intel, AMD ... as rivals, too...
News reporting · 19 Sep 2026 -
Arm AGI CPU
Groq could consider Arm, Intel, AMD and a growing number of startups as rivals, too, in an AI chip market that could reach $400 billion in annual sales in the next five years
News reporting · 19 Sep 2026 -
Cerebras Inference
As Cerebras looks to expand into the larger AI inference market, it will have to innovate against Groq's inference-specialized LPU chips.
Research report · 19 Sep 2026 -
Cerebras Inference
As Cerebras looks to expand into the larger AI inference market, it will have to innovate against Groq's inference-specialized LPU chips.
Research report · 19 Sep 2026 -
NVIDIA DGX Cloud
Groq faces increasing competition from both rival AI chip upstarts and Nvidia, the formidable incumbent in the AI hardware sector.
News reporting · 19 Sep 2026 -
NVIDIA DGX Cloud
Groq faces increasing competition from both rival AI chip upstarts and Nvidia, the formidable incumbent in the AI hardware sector.
News reporting · 19 Sep 2026 -
SambaCloud
Groq similarly focuses on low-latency inference through its Language Processing Units and GroqCloud service.
Research report · 19 Sep 2026
Sources
- Pricing
-
"To upgrade from the Free tier to the Developer tier, you'll need to provide a valid payment method"; "you'll be billed for tokens at month-end or when you reach progressive billing thresholds"; the rate-limits page shows Free Plan Limits and Developer Plan Limits side by side.
- Constraints
-
Derived from the security facts on this page, from the same source.
- Security
-
Groq Trust Center (script-rendered, read in a browser): 'we have successfully maintained our SOC 2 Type II compliance, with our latest report now available as of 2025'; the compliance list also shows GDPR and HIPAA, with no BAA or DPA stated, so those are not recorded. Training on customer data and retention are not stated. Subprocessors listed: Stytch, Google Cloud Platform, Stripe, Cloudflare (no model provider). groq-lpu is hardware and is not written.
- Sold within
-
GroqCloud's billing plans page lists a "Free" plan at "$0" ("Great for anyone to get started with our APIs") and a "Developer" plan billed "Pay per Token"; its models page gives a "PRICE PER 1M TOKENS" for each model.
- Interfaces
-
Official documentation · 29 Sep 2026
Quickstart shows a curl example for direct REST access, states 'Install the Groq Python library', and covers third-party JS SDKs (Vercel AI SDK) built on the same API.
- Modalities
-
Official documentation · 1 Oct 2026
Page: 'Text Generation Speech to Text Text to Speech Orpheus OCR and Image Recognition'.
- Intended for
-
"developers run trillions of tokens on Groq every week"; "GroqAssured adds enterprise controls" / "Enterprise-grade governance, auditability, and control"
Also from Groq
-
Groq LPU (GroqChip) Hardware
The Language Processing Unit (LPU) — Groq's own inference accelerator chip (GroqChip), deployed 256 per rack across Groq's own data centers. Not sold or licensed as standalone hardware today: access comes bundled into GroqCloud or into the dedicated regional deployments Groq itself builds and operates for governments and telecoms.
Something wrong here? Send a correction — quote this product id: groqcloud.