The best garak alternatives
The rest of Best LLM Evaluation Tools, in this site's order: each with what it costs, where it runs and its record score.
DeepEval suits developers building repeatable evaluations for AI systems, especially those running tests in Python or CI/CD.
It is designed for cross-functional AI teams, including product managers who want to define and analyze evaluations without code and developers who…
Promptfoo is for developers and enterprises building AI applications who need prompt evaluation or red-team testing.
It suits teams assessing conversational AI agents for safety and quality issues before production.
Braintrust is intended for teams running AI agents in production, from early-stage projects to enterprise deployments.
It is designed for engineers, QA teams, product managers, subject-matter experts, and annotators working on AI quality, evaluation, or production…
Arena suits people who want to compare model responses or consult public leaderboards.
Galileo is designed for engineers, product managers, and subject matter experts building AI applications.
HELM suits teams and researchers who want an open-source framework for evaluating foundation models and can run it themselves.
It is aimed at researchers and practitioners evaluating large language and vision-language models.
Parea suits teams developing LLM applications that need evaluation, production observability, and human review.
It suits security professionals and engineers evaluating generative AI behavior, safety, and data-leakage risks.
It suits researchers, organizations, and developers evaluating language models with shared benchmarks or custom metrics.
Inspect AI suits developers and teams evaluating language models or agents across varied tasks.
