Groq
by Groq
At a glance
AI inference platform powered by custom LPU hardware for very low-latency serving of open language models.
inference llm-hosting infrastructure
- Licence
- Not recorded
- Category
- Platforms & Infrastructure
- Business model
- Freemium
- Availability
- Global
- Launched
- 2024-02
Overview
Groq is an AI inference platform powered by its custom LPU hardware, designed for very low-latency serving of open language models. Its OpenAI-compatible API serves models through the Groq console, and the company now pairs its LPUs with LPX systems that work alongside NVIDIA GPUs. A free tier is available, with usage-based paid pricing.
Compare this tool Suggest a correction
Key features
- Custom LPU hardware for very fast inference
- OpenAI-compatible API through the Groq console
- Low-latency serving of open models
- LPX systems that work alongside NVIDIA GPUs
Use cases
- Latency-sensitive apps needing fast responses
- Real-time assistants and agents
- Serving open models at high speed
Pricing
A free tier is available; production usage is priced per token through Groq's API.
Record details
Provenance, dates and links are kept here so the main sections stay about the product itself.
Links, dates and provenance
- Record updated
- 2026-09-10
- Founded
- 2016
- Headquarters
- US
- Canonical URL
- https://globalaiproductindex.com/products/groq/
Selection profile
Every field says where its value comes from. "Unknown" means we have not confirmed it — it does not mean the product lacks the feature.
Selection profile11 fields3 unknown
- Tasks it fits
- Running models yourself
Derived from the record: category "platforms".
Suggest a correction - How you use it
- Web app
Hosted product with no desktop/CLI tag in the record; assumed web-delivered.
Suggest a correction - Runs on
- Web
Derived from platform words in the record description/features/tags.
Suggest a correction - Where it runs
- Vendor cloud
Vendor-hosted product; no self-hosted option is recorded.
Suggest a correction - Works offline
- Not recorded
The record contains no offline-operation claim.
Suggest a correction - Official service region
- Global
Mirrors the availability field already on the record ("global").
Suggest a correction - Public API
- Yes
The record mentions an API surface.
Suggest a correction - Licence
- proprietary
Commercial product; no source licence is published in the record.
Suggest a correction - Commercial use
- Not recorded
Commercial product; the terms reviewed here do not state a non-commercial restriction, but that was not verified.
Suggest a correction - Interface languages
- Not recorded
No vendor page read in this pass states the product's own interface languages; the key exists so the field can be answered later rather than left absent.
Suggest a correction - Billing
- Subscription Free allowance: Limited Subscription required: No
Prices are the vendor’s advertised entry price and exclude taxes; always confirm on the vendor’s own page.
Suggest a correction
Where each value comes from
- Tasks it fits
- Our inference
- How you use it
- Our inference
- Runs on
- Our inference
- Where it runs
- Our inference
- Works offline
- Our inference
- Official service region
- Our inference
- Public API
- Our inference
- Licence
- Our inference
- Commercial use
- Our inference
- Interface languages
- Unknown
Frequently asked questions
What is an LPU?
An LPU (Language Processing Unit) is Groq's custom chip designed for fast, low-latency language-model inference.
Is Groq OpenAI-compatible?
Yes. GroqCloud offers an OpenAI-compatible API for running open models.
Is Groq free?
Groq offers a free tier; production usage is priced per token.
What does the Groq record not establish?
No public documentation or pricing page is recorded because no matching page could be confirmed on the vendor site, and Groq's licence, regions and supported languages are not established.
Similar products
- Baseten — Platform for deploying and serving machine-learning models as scalable APIs.
- Cerebras — AI compute company whose inference cloud serves open language models on wafer-scale hardware.
- Fal.ai — Generative media inference platform for running diffusion and other models with a fast API.
- Fireworks AI — Inference platform for fast serving and fine-tuning of open-source generative AI models.
- Together AI — Cloud platform for running, fine-tuning, and hosting open-source AI models via serverless and dedicated endpoints.
- Modal — Serverless cloud platform for running AI and data workloads with usage-based pricing.
All Groq alternatives → · All Platforms & Infrastructure products →
Related guides
Sources
This record was last reviewed on 2026-09-10.
Machine-readable record: /api/products/groq.json · Spot an error? Suggest a correction