Editorial suggestion · cites a checked fact
Desktop application for discovering, downloading, and running open large language models locally.
Freemium
Use cases
- Running chat models fully offline for privacy
- Local development against an OpenAI-style endpoint
- Benchmarking open models on personal hardware
Pricing: Checked 2026-11-02: Free covers local models and Bionic Agent. Bionic+ is USD 20/month and Pro USD 100/month for optional cloud usage allowances; cloud credits cover use beyond the included allowance. These paid individual tiers are available now; the page separately says team subscription plans are coming soon.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-02.
Editorial suggestion · cites a checked fact
Open-source desktop app for running open language models locally as an offline ChatGPT alternative.
Open (open weights/source) Apache-2.0 (main; confirmed tags: Apache-2.0 at v0.5.18-rc1-beta and v0.6.0, AGPL-3.0 at v0.5.16 and v0.5.17; other versions not individually checked)
Use cases
- Private, offline AI chat on personal hardware
- Local development against an OpenAI-style API
- Experimenting with open models without a GPU cloud
Pricing: Jan is free and open source; users optionally pay third-party providers if they connect cloud models.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-13.
Listed together in guide “AI platforms and infrastructure”
Extensible, self-hosted AI interface that runs offline and connects to local or remote models such as Ollama and OpenAI-compatible APIs.
Open (open weights/source) BSD-3-Clause
Use cases
- Private ChatGPT-style interface on company servers
- Team access to local models with permissions
- Document Q&A fully offline
Pricing: Open WebUI is free and open source to self-host; an enterprise plan adds custom theming, SLAs, and support for a fee.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Listed together in guide “AI platforms and infrastructure”
Open-source inference and serving engine for large language models, known for high-throughput PagedAttention.
Open (open weights/source) Apache-2.0
Use cases
- Serving open LLMs in production at high throughput
- Self-hosting an OpenAI-compatible inference endpoint
- Benchmarking and research on efficient LLM inference
Pricing: vLLM is free and open source under Apache-2.0; costs are limited to the GPU infrastructure it runs on.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Listed together in guide “Local and private document Q&A”
Open-weight large language model family from Meta, spanning Llama 3 and Llama 4 generations across multiple sizes.
Open (open weights/source) Llama Community License
Use cases
- Self-hosted assistants and private deployments
- Fine-tuning for domain-specific applications
- Research on large language models
Pricing: Llama weights are free to download under the Llama community license; hosted inference is offered by many providers at usage-based prices.
Sources
This record was last reviewed on 2026-09-04.
Related: shares the task Running models yourself
Platform for deploying and serving machine-learning models as scalable APIs.
Paid
Use cases
- Serving custom and open models in production
- Low-latency inference APIs
- Scaling ML services reliably
Pricing: Dedicated GPU compute is billed per minute with no charge for idle time, model APIs are billed per million tokens, and new accounts come with credits.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
AI compute company whose inference cloud serves open language models on wafer-scale hardware.
Freemium
Use cases
- Latency-sensitive applications needing fast tokens
- Serving open models at high speed
- Large-model training on specialized hardware
Pricing: Inference is usage-priced per token and starts with a free trial; training systems and on-premises deployments are sold separately.
Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
Generative media inference platform for running diffusion and other models with a fast API.
Paid
Use cases
- Adding image and video generation to apps
- Serving open diffusion models at scale
- Prototyping generative media pipelines
Pricing: Pricing is usage-based per inference or compute second; new developers receive free credits.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.