- Home
- LLM Evaluation Tools
- Promptfoo
Promptfoo
Promptfoo identifies San Francisco, California as its base and headquarters.
What it is
Promptfoo helps developers and enterprises evaluate prompts and check AI applications for security risks. It compares prompt outputs across multiple models in a web view. Red-team tests simulate users to look for issues such as prompt injections, jailbreaks, data leaks, business rule violations, and insecure agent tool use. Its getting-started guide lists 60+ providers, including OpenAI, Anthropic, Google, and local models such as Ollama. Integrations include CI services such as GitHub Actions, GitLab CI, Jenkins, Azure Pipelines, CircleCI, and Bitbucket Pipelines, along with Splunk, Burp Suite, Google Sheets, and MCP. Installation is available through npm, npx, or Homebrew. Promptfoo requires Node.js 22.22.0 or newer and recommends Node.js 24 LTS. The free Community plan includes all LLM evaluation features and 10k red-team probes per month, and can run locally or be self-hosted. Enterprise offers managed cloud deployment; On-Premise runs on customer infrastructure. Promptfoo says it is based in San Francisco, is now part of OpenAI, and remains open source.
For and against
For
- Compares prompt outputs across multiple models.
- Red-team testing targets several classes of application risk.
- Supports 60+ providers, including local models.
- Community plan includes 10k red-team probes monthly.
- Offers local, self-hosted, managed cloud, and on-premise options.
Against
- Community red-team testing is limited to 10k probes monthly.
- Requires Node.js 22.22.0 or newer.
- Enterprise and On-Premise pricing is custom.
The verdict
Promptfoo brings model comparisons and AI risk testing together, with provider and CI integrations. The free Community plan is substantial, though its monthly red-team probe allowance is defined.
Who it suits
Promptfoo is for developers and enterprises building AI applications who need prompt evaluation or red-team testing. Its deployment choices also suit teams looking to run it locally, self-host, or deploy on their own infrastructure.
Plans and prices
Community
10k red-team probes/month · local or self-hosted · community support
Read 15 Oct 2026 · promptfoo.dev
Enterprise
custom red-team limits · team collaboration · continuous monitoring · SSO/RBAC
Read 15 Oct 2026 · promptfoo.dev
On-Premise
enterprise features · customer infrastructure · complete data isolation · dedicated runner
Read 15 Oct 2026 · promptfoo.dev
On the record
- Acquisition news
- Promptfoo announced on March 9, 2026 that it had agreed to be acquired by OpenAI while remaining open source.promptfoo.dev · read 15 Oct 2026
- Browser testing
- An optional Playwright-based browser provider supports Chromium, Edge, Firefox, and WebKit interactions.promptfoo.dev · read 15 Oct 2026
- CI/CD
- Promptfoo can run evaluations and security checks in CI/CD pipelines using configuration files and provider credentials.promptfoo.dev · read 15 Oct 2026
- Cloud viewer
- The browser viewer is free at promptfoo.app and supports private organization links plus self-hosted sharing endpoints.promptfoo.dev · read 15 Oct 2026
- Company
- Promptfoo says it is based in San Francisco, California, and is now part of OpenAI while remaining open source.promptfoo.dev · read 3 Oct 2026
- Company founding
- Promptfoo's co-founder said the company was founded in 2024.promptfoo.dev · read 15 Oct 2026
- Company legal name
- Crunchbase lists the legal name as Promptfoo, Inc.crunchbase.com · read 15 Oct 2026
- Company size
- LinkedIn lists Promptfoo as a privately held software-development company with 11–50 employees.linkedin.com · read 15 Oct 2026
- Compliance testing
- Its GDPR preset tests privacy, access control, personal-data exposure, deletion flows, and automated-decision risks, but the documentation says it is not legal certification.promptfoo.dev · read 15 Oct 2026
- Custom extensibility
- Developers can write JavaScript, TypeScript, Python, Ruby, or script-based custom providers for APIs not built in.promptfoo.dev · read 15 Oct 2026
- Deployment
- The Community plan can run locally or be self-hosted, while Enterprise includes managed cloud deployment and On-Premise supports deployment on the customer’s infrastructure.promptfoo.dev · read 3 Oct 2026
- Documentation depth
- The documentation includes installation, evaluations, assertions, runtime, red teaming, providers, integrations, code scanning, model audit, enterprise, API references, and release notes.promptfoo.dev · read 15 Oct 2026
- Evaluation
- It tests prompts across multiple providers, grades outputs with assertions, and calculates accuracy, safety, and performance metrics.promptfoo.dev · read 15 Oct 2026
- Evaluations
- Promptfoo evaluates prompts across multiple models and opens a web view for comparing outputs.promptfoo.dev · read 3 Oct 2026
- Funding
- Crunchbase lists seed and Series A rounds, six investors including Insight Partners and Andreessen Horowitz, and 11–50 employees.crunchbase.com · read 15 Oct 2026
- HTTP API support
- The HTTP provider can call arbitrary endpoints, build requests from templates, transform responses, authenticate, and handle tool-calling formats.promptfoo.dev · read 15 Oct 2026
- Independent package evidence
- Homebrew lists promptfoo as MIT licensed and provides macOS Apple Silicon plus Linux ARM64 and x86_64 bottles.formulae.brew.sh · read 15 Oct 2026
- Installation
- Installation is available through npm, npx, Homebrew, and a project dependency; npm and npx require Node.js 22.22.0 or newer.promptfoo.dev · read 15 Oct 2026
