Editorial suggestion · cites a checked fact
Desktop application for discovering, downloading, and running open large language models locally.
Freemium
Use cases
- Running chat models fully offline for privacy
- Local development against an OpenAI-style endpoint
- Benchmarking open models on personal hardware
Pricing: Checked 2026-11-02: Free covers local models and Bionic Agent. Bionic+ is USD 20/month and Pro USD 100/month for optional cloud usage allowances; cloud credits cover use beyond the included allowance. These paid individual tiers are available now; the page separately says team subscription plans are coming soon.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-02.
Editorial suggestion · cites a checked fact
Open-source tool for running open large language models locally on your own machine with a simple command-line interface.
Open (open weights/source) MIT
Use cases
- Private, offline AI chat and coding assistance
- Local development against an LLM API without cloud costs
- Experimenting with and comparing open models
Pricing: Ollama is free and open source; optional hosted services are offered separately.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Listed together in guide “AI platforms and infrastructure”
Extensible, self-hosted AI interface that runs offline and connects to local or remote models such as Ollama and OpenAI-compatible APIs.
Open (open weights/source) BSD-3-Clause
Use cases
- Private ChatGPT-style interface on company servers
- Team access to local models with permissions
- Document Q&A fully offline
Pricing: Open WebUI is free and open source to self-host; an enterprise plan adds custom theming, SLAs, and support for a fee.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Listed together in guide “AI platforms and infrastructure”
Open-source inference and serving engine for large language models, known for high-throughput PagedAttention.
Open (open weights/source) Apache-2.0
Use cases
- Serving open LLMs in production at high throughput
- Self-hosting an OpenAI-compatible inference endpoint
- Benchmarking and research on efficient LLM inference
Pricing: vLLM is free and open source under Apache-2.0; costs are limited to the GPU infrastructure it runs on.
Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Related: shares the task Running models yourself, Questions over your own documents
Cohere's open-weight LLM family optimized for retrieval-augmented generation and tool use; succeeded by Command A as Cohere's flagship.
Open (open weights/source) CC-BY-NC-4.0
Use cases
- Enterprise RAG assistants grounded in company documents
- Building agents that call external tools and APIs
- Research on open-weight instruction-tuned models
Pricing: Model weights are free for non-commercial research under a CC-BY-NC license; commercial access is via Cohere's usage-priced API and enterprise deployments.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself, Questions over your own documents
Open-source platform for building LLM applications with visual agent workflows, RAG pipelines, and model management.
Open (open weights/source) Dify Open Source License (modified Apache-2.0)
Use cases
- Building internal AI assistants over company knowledge
- Prototyping and shipping agentic workflows without heavy coding
- Standardizing LLM app development across a team
Pricing: Self-hosting Dify is free under its open-source license; Dify Cloud offers a free sandbox and paid plans, with enterprise licensing for advanced needs.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-10-10.
Related: shares the task Running models yourself, Questions over your own documents
Korean AI company offering the Solar LLM family, document AI models, and an API platform for enterprise workflows.
Freemium
Use cases
- Automating document-heavy workflows such as invoices, claims, and contracts
- Building assistants and agents on an API-first LLM platform
- Running document AI in environments that require on-premises deployment
Pricing: Upstage meters API use by tokens or document pages and offers prepaid tiers (Explore, Build, Scale) that add credits and higher request limits; enterprise pricing is custom. Some features and models have free or beta access, including an education and public-interest program.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-10-09.
Related: shares the task Running models yourself
German AI company that builds sovereign large language models and enterprise AI platforms for industry, public-sector, and defense customers.
Paid
Use cases
- Public-sector and defense applications that require data to stay in Europe
- Enterprise assistants in industry, administration, and science
- Research collaborations on transparent language models
Pricing: Aleph Alpha sells to organizations rather than consumers and does not publish list prices; commercial terms are arranged directly with enterprise and public-sector customers.
Documentation ↗ · Sources
This record was last reviewed on 2026-09-10.