Platforms & Infrastructure
vLLM alternatives
23 alternatives to vLLM (vLLM Project) from the Platforms & Infrastructure category of the index.
- Amazon Bedrock (Amazon Web Services) — Managed AWS service for building applications with foundation models from multiple providers via one API. Paid
- Amazon Nova (Amazon Web Services) — AWS portfolio of Amazon-built foundation models and services for text, multimodal, speech, custom model building, and UI-automating agents. Paid
- Azure AI Foundry (Microsoft) — Microsoft's platform for building, evaluating, and deploying AI applications and agents on Azure. Paid
- Baseten (Baseten) — Platform for deploying and serving machine-learning models as scalable APIs. Paid
- Cerebras (Cerebras Systems) — AI compute company whose inference cloud serves open language models on wafer-scale hardware. Freemium
- Civitai (Civitai) — Community platform for sharing and discovering open image-generation models, LoRAs, and generated art. Freemium
- Dify (LangGenius) — Open-source platform for building LLM applications with visual agent workflows, RAG pipelines, and model management. Open (open weights/source)
- Fal.ai (fal) — Generative media inference platform for running diffusion and other models with a fast API. Paid
- Fireworks AI (Fireworks AI) — Inference platform for fast serving and fine-tuning of open-source generative AI models. Paid
- Groq (Groq) — AI inference platform powered by custom LPU hardware for very low-latency serving of open language models. Freemium
- Hugging Face (Hugging Face, Inc.) — Platform hosting machine learning models, datasets, and demo apps, centered on open-source AI. Freemium
- Jan (Homebrew (formerly Menlo Research)) — Open-source desktop app for running open language models locally as an offline ChatGPT alternative. Open (open weights/source)
- LM Studio (LM Studio) — Desktop application for discovering, downloading, and running open large language models locally. Free
- Modal (Modal Labs) — Serverless cloud platform for running AI and data workloads with usage-based pricing. Freemium
- Ollama (Ollama) — Open-source tool for running open large language models locally on your own machine with a simple command-line interface. Open (open weights/source)
- Open WebUI (Open WebUI) — Extensible, self-hosted AI interface that runs offline and connects to local or remote models such as Ollama and OpenAI-compatible APIs. Open (open weights/source)
- OpenRouter (OpenRouter) — Unified API gateway that routes requests to hundreds of large language models from many providers. Paid
- Pinecone (Pinecone) — Managed vector database for similarity search and retrieval in AI applications. Freemium
- Poe (Quora) — Platform from Quora providing access to multiple AI chatbots and models through a single interface. Freemium
- Replicate (Replicate) — Platform for running and deploying open-source machine learning models via a hosted API. Paid
- Together AI (Together AI) — Cloud platform for running, fine-tuning, and hosting open-source AI models via serverless and dedicated endpoints. Paid
- Vertex AI (Google) — Google Cloud's platform for training, tuning, and serving machine learning and generative AI models. Paid
- Weaviate (Weaviate) — Open-source vector database for semantic search, retrieval-augmented generation, and hybrid search. Open (open weights/source)
Full vLLM profile → · All Platforms & Infrastructure products →