vLLM

by vLLM Project · docs.vllm.ai ↗

Platforms & Infrastructure Open (open weights/source) Availability: Global Launched 2023

Open-source inference and serving engine for large language models, known for high-throughput PagedAttention.

open-source inference serving llm

Category
Platforms & Infrastructure
Business model
Open (open weights/source)
Availability
Global
Launched
2023
Record updated
2026-07-24
Canonical URL
https://globalaiproductindex.com/products/vllm/

Sources

This record was last reviewed on 2026-07-24.

Machine-readable record: /api/products/vllm.json · Spot an error? Suggest a correction