Related: shares the task Data analysis
Source-available AI observability project for tracing model calls, retrieval and tool execution.
Free
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: Phoenix can be run on your infrastructure under Elastic License 2.0; its source availability is not an unrestricted open-source license. Infrastructure and evaluator-model costs are separate, and managed Arize offerings have separate commercial terms.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
Agent observability and evaluation platform that links production traces to quality experiments.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: Free has a USD 0 platform fee, with 1 GB of processed data and 10000 scores per month before metered overages. Pro is USD 249 per month; model credits, data processing, scores and retention are separate billing dimensions.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
AI development environment incorporating Weights & Biases experiment tracking, Weave evaluations and model lifecycle services.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: Free supports personal development with limited storage and ingestion. Pro starts at USD 60 per month billed monthly; storage, Weave ingestion, inference and sandbox compute have separate meters. Academic access has eligibility requirements, not a blanket commercial exemption.
Pricing ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
Python evaluation framework for monitoring data quality, predictive models and LLM applications.
Open (open weights/source)
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: The open-source software can be run on your own infrastructure. Compute, storage and any external model API usage are separate costs; a managed service is not included.
Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
AI evaluation and red-teaming platform for finding security and business failures in agents.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: Giskard offers open-source testing components and the commercial Giskard Hub. Hub and enterprise security evaluations are arranged with the vendor; a limited audit promotion is not an ongoing free hosted plan, and test-generation model costs may be separate.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
LLM engineering platform connecting agent traces, prompt versions and evaluations.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: The open-source platform can be self-hosted. Cloud has a Hobby tier; Core is USD 29 per month with 100000 units included and additional units metered. Cloud retention and team features vary by tier, and external model evaluation costs remain separate.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
Comet’s agent observability and evaluation platform for tracing, scoring and improving LLM workflows.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: The self-hosted open-source edition is free. Free Cloud includes 25000 spans per month and 60-day retention; Pro Cloud is USD 19 per month with 100000 spans. Evaluator-model charges and enterprise terms remain separate.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.
Related: shares the task Data analysis
CLI and library for evaluating prompts and red-teaming LLM applications with repeatable test cases.
Freemium
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing: Community is free and includes up to 10000 red-team probes per month where hosted inference is needed. Enterprise is quoted for team needs; testing your own targets can still incur their model API charges.
Pricing ↗ · Documentation ↗ · Sources
This record was last reviewed on 2026-11-03.