Galileo vs SWE-bench

Galileo

6.3 #9 in AI Agent Observability Tools

About Galileo

SWE-bench

5.2 #23 in LLM Evaluation Tools

About SWE-bench
GalileoSWE-bench
Free planYesNo
Free trialNoNo
Paid from$100/mo—
Open sourceNoNo
Platformsapi, self-hosted, WebWeb, macOS, Linux
Free planYesYes
Paid from100 /mo—
Deployment optionsbothboth
Custom metricsYes—
LLM-as-a-judgeYes—
Safety evaluationsYes—
Human review workflowsYes—
Prompt versioningYes—
CI/CD integrationYes—

Both are listed in Best LLM Evaluation Tools. On Samsung Mobile US Press, Galileo scores higher on our published basis.