Promptfoo
by Promptfoo
At a glance
CLI and library for evaluating prompts and red-teaming LLM applications with repeatable test cases.
eval developer-tools
- Licence
- Not recorded
- Category
- Platforms & Infrastructure
- Business model
- Freemium
- Availability
- Not recorded
- Launched
- Not recorded
Overview
Typical uses include Investigation of agent failures; Regression evaluation of AI applications. Documented capabilities: Compare model and prompt outputs against assertions; Generate adversarial probes for AI security testing; Run evaluation suites in development and CI.
Compare this tool Suggest a correction
Key features
- Compare model and prompt outputs against assertions
- Generate adversarial probes for AI security testing
- Run evaluation suites in development and CI
Use cases
- Investigation of agent failures
- Regression evaluation of AI applications
Pricing
Community is free and includes up to 10000 red-team probes per month where hosted inference is needed. Enterprise is quoted for team needs; testing your own targets can still incur their model API charges.
Record details
Provenance, dates and links are kept here so the main sections stay about the product itself.
Links, dates and provenance
- Record updated
- 2026-11-03
- Pricing
- www.promptfoo.dev ↗
- Documentation
- www.promptfoo.dev ↗
- Canonical URL
- https://globalaiproductindex.com/products/promptfoo/
Selection profile
Every field says where its value comes from. "Unknown" means we have not confirmed it — it does not mean the product lacks the feature.
Selection profile11 fields8 unknown
- Tasks it fits
- Data analysis
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - How you use it
- Command line
Editorial classification of the documented features; not a product-performance test.
Suggest a correction - Runs on
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Where it runs
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Works offline
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Official service region
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Public API
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Licence
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Commercial use
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Interface languages
- Not recorded
This product-specific field was not established in this entry’s source review.
Suggest a correction - Billing
- Open source Enterprise quote Free allowance: Limited Subscription required: No
Prices are the vendor’s advertised entry price and exclude taxes; always confirm on the vendor’s own page.
Suggest a correction
Where each value comes from
- Tasks it fits
- Our inference
- How you use it
- Our inference
- Runs on
- Unknown
- Where it runs
- Unknown
- Works offline
- Unknown
- Official service region
- Unknown
- Public API
- Unknown
- Licence
- Unknown
- Commercial use
- Unknown
- Interface languages
- Unknown
Key facts and their evidence
Each fact lists the conditions it holds under, the page it was read from and the day it was checked.
-
Capability: Compare model and prompt outputs against assertions Verified 2026-11-03 www.promptfoo.dev ↗
Suggest a correction
Frequently asked questions
Where does Promptfoo fit in a workflow?
CLI and library for evaluating prompts and red-teaming LLM applications with repeatable test cases. Compare model and prompt outputs against assertions.
What costs and limits should I compare before choosing Promptfoo?
Community is free and includes up to 10000 red-team probes per month where hosted inference is needed. Enterprise is quoted for team needs; testing your own targets can still incur their model API charges.
Similar products
- Arize Phoenix — Source-available AI observability project for tracing model calls, retrieval and tool execution.
- Braintrust — Agent observability and evaluation platform that links production traces to quality experiments.
- CoreWeave Forge — AI development environment incorporating Weights & Biases experiment tracking, Weave evaluations and model lifecycle services.
- Evidently AI — Python evaluation framework for monitoring data quality, predictive models and LLM applications.
- Giskard — AI evaluation and red-teaming platform for finding security and business failures in agents.
- Helicone — LLM gateway and observability platform for inspecting requests, sessions and application costs.
All Promptfoo alternatives → · All Platforms & Infrastructure products →
Sources
- Promptfoo — official product ↗
- Promptfoo — official documentation and terms ↗
- Promptfoo — official documentation and terms ↗
This record was last reviewed on 2026-11-03.
Machine-readable record: /api/products/promptfoo.json · Spot an error? Suggest a correction