- Home
- AI Agent Evaluation Tools
- Exgentic
On the recordRead 9 Oct 202626 facts
Exgentic
On the record
- Agents
- Listed agents include LiteLLM Tool Calling, SmolAgents, OpenAI MCP, Claude Code, Codex CLI, and Gemini CLI.github.com · read 4 Oct 2026
- Available agents
- The listed agents include LiteLLM Tool Calling, HuggingFace SmolAgents, OpenAI MCP, Claude Code, Codex CLI, and Gemini CLI.github.com · read 9 Oct 2026
- Available benchmarks
- The framework lists tau2, appworld, browsecompplus, swebench, hotpotqa, gsm8k, and bfcl benchmarks.github.com · read 9 Oct 2026
- Benchmark handling
- Exgentic says it does not modify benchmarks or agent implementations, though it may adapt interfaces to its unified protocol.exgentic.ai · read 4 Oct 2026
- Benchmarks
- The leaderboard covers personal assistance, customer service, technical support, deep research, and software engineering benchmarks.exgentic.ai · read 9 Oct 2026
- Evaluation approach
- Exgentic says it avoids prompt optimization and reports results on 100 sampled tasks per benchmark.exgentic.ai · read 9 Oct 2026
- Evaluation domains
- The leaderboard covers personal assistance, customer service, technical support, deep research, and software engineering tasks.exgentic.ai · read 4 Oct 2026
- Evaluation framework
- Its framework provides a consistent interface for evaluating agents on benchmarks to compare performance and reproduce results.github.com · read 4 Oct 2026
- Framework
- Exgentic provides a consistent interface for testing agents across benchmarks and domains to compare performance and reproduce results.github.com · read 9 Oct 2026
- Installation
- The project documents installation as a command line tool with uv and use as a Python library with uv or pip.github.com · read 4 Oct 2026
- Integrations
- The README documents API credentials for OpenAI and Anthropic models and support for Hugging Face models and Jobs.github.com · read 9 Oct 2026
- Isolation
- The repository documents a Docker runner for full container isolation, requiring Docker to be installed and running.github.com · read 4 Oct 2026
- License
- The framework is distributed under the Apache License 2.0.github.com · read 9 Oct 2026
- License and support
- The repository states that Exgentic is licensed under Apache License 2.0 and directs support questions to GitHub issues.github.com · read 4 Oct 2026
- Local use
- The README documents installation as a command-line tool or Python library and includes an evaluation dashboard command.github.com · read 9 Oct 2026
- Methodology
- Exgentic says it avoids prompt optimization and reports results on 100 sampled tasks per benchmark.exgentic.ai · read 4 Oct 2026
- Model integrations
- The quick start documents OpenAI and Anthropic API credentials, and the repository also describes support for Hugging Face models or evaluations on Hugging Face Jobs.github.com · read 4 Oct 2026
- Open results
- The evaluation pipeline, agent implementations, configuration, and results are available for reproducing evaluations.github.com · read 9 Oct 2026
