Editorial suggestion — not a checked fact
Open-source tool for running open large language models locally on your own machine with a simple command-line interface.
Open (open weights/source) MIT
Use cases
- Private, offline AI chat and coding assistance
- Local development against an LLM API without cloud costs
- Experimenting with and comparing open models
Pricing: Ollama is free and open source; optional hosted services are offered separately.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Editorial suggestion · cites a checked fact
Open-source desktop app for running open language models locally as an offline ChatGPT alternative.
Open (open weights/source) Apache-2.0 (main; confirmed tags: Apache-2.0 at v0.5.18-rc1-beta and v0.6.0, AGPL-3.0 at v0.5.16 and v0.5.17; other versions not individually checked)
Use cases
- Private, offline AI chat on personal hardware
- Local development against an OpenAI-style API
- Experimenting with open models without a GPU cloud
Pricing: Jan is free and open source; users optionally pay third-party providers if they connect cloud models.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-13.
Listed together in guide “AI platforms and infrastructure”
Extensible, self-hosted AI interface that runs offline and connects to local or remote models such as Ollama and OpenAI-compatible APIs.
Open (open weights/source) BSD-3-Clause
Use cases
- Private ChatGPT-style interface on company servers
- Team access to local models with permissions
- Document Q&A fully offline
Pricing: Open WebUI is free and open source to self-host; an enterprise plan adds custom theming, SLAs, and support for a fee.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Listed together in guide “AI platforms and infrastructure”
Open-source inference and serving engine for large language models, known for high-throughput PagedAttention.
Open (open weights/source) Apache-2.0
Use cases
- Serving open LLMs in production at high throughput
- Self-hosting an OpenAI-compatible inference endpoint
- Benchmarking and research on efficient LLM inference
Pricing: vLLM is free and open source under Apache-2.0; costs are limited to the GPU infrastructure it runs on.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Related: shares the task Running models yourself
Platform for deploying and serving machine-learning models as scalable APIs.
Paid
Use cases
- Serving custom and open models in production
- Low-latency inference APIs
- Scaling ML services reliably
Pricing: Dedicated GPU compute is billed per minute with no charge for idle time, model APIs are billed per million tokens, and new accounts come with credits.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
AI compute company whose inference cloud serves open language models on wafer-scale hardware.
Freemium
Use cases
- Latency-sensitive applications needing fast tokens
- Serving open models at high speed
- Large-model training on specialized hardware
Pricing: Inference is usage-priced per token and starts with a free trial; training systems and on-premises deployments are sold separately.
Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
Generative media inference platform for running diffusion and other models with a fast API.
Paid
Use cases
- Adding image and video generation to apps
- Serving open diffusion models at scale
- Prototyping generative media pipelines
Pricing: Pricing is usage-based per inference or compute second; new developers receive free credits.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
Inference platform for fast serving and fine-tuning of open-source generative AI models.
Paid
Use cases
- Serving open models in production with low latency
- Fine-tuning models on custom data
- Migrating from closed APIs with minimal code change
Pricing: Pricing is usage-based per token, with dedicated capacity options; new developers receive free credits.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-09-10.