- Home
- LLM Evaluation Tools
- TruLens
On the recordRead 15 Oct 202650 facts
TruLens
Plans and prices
Open-source TruLens library
Free
Python library · self-hosted storage/dashboard · optional provider packages
Read 15 Oct 2026 · aicoolies.com
Open source
Free
Open source Python SDK · install with pip or from source
Read 7 Oct 2026 · trulens.org
On the record
- Acquisition
- Snowflake announced an agreement on May 22, 2024 to acquire TruEra's AI-observability platform.snowflake.com · read 15 Oct 2026
- Agent benchmark
- The homepage reports that Agent GPA caught 267 of 281 human-annotated errors, or 95%, on TRAIL and GAIA traces.trulens.org · read 15 Oct 2026
- Agent metrics
- Built-in agent metrics include tool selection, tool calling, tool quality, plan adherence, plan quality, execution efficiency and logical consistency.trulens.org · read 15 Oct 2026
- API documentation
- The project publishes a searchable API reference covering core classes, metrics, providers and connectors.trulens.org · read 15 Oct 2026
- Batch evaluation
- Runs can replay a dataset and compute the same metrics over stored inputs.trulens.org · read 15 Oct 2026
- Company facts
- LinkedIn lists TruEra as a privately held software-development company founded in 2019 with headquarters in Redwood City, California, and 51–200 employees.linkedin.com · read 15 Oct 2026
- Current stewardship
- The official TruLens homepage says the project was created by TruEra and is actively maintained in open source by Snowflake after the acquisition.trulens.org · read 15 Oct 2026
- Custom evaluation
- Developers can define metrics with Python functions, LLM-as-judge prompts, span attributes, rubrics and examples.trulens.org · read 15 Oct 2026
- Custom metrics
- Users can define custom metrics with Python functions or LLM-as-judge prompts and tune judges with rubrics and examples.trulens.org · read 7 Oct 2026
- Dashboard
- The built-in Streamlit dashboard provides leaderboards, trends, individual records and side-by-side version comparison.trulens.org · read 15 Oct 2026
- Database connector
- A Snowflake connector is provided for storing TruLens traces and evaluation data.trulens.org · read 15 Oct 2026
- Evaluation
- It supports agent, RAG, MCP app, and summarization evaluations with metrics including tool selection, groundedness, context relevance, and correctness.trulens.org · read 7 Oct 2026
- Evaluation modes
- Evaluations can run as traces arrive or in batch over a dataset.trulens.org · read 7 Oct 2026
- Experiment comparison
- The leaderboard compares app versions across metrics, latency, and cost.trulens.org · read 7 Oct 2026
- Explained scores
- Its judges attach explanations to metric scores so teams can investigate why a result was rated poorly.trulens.org · read 15 Oct 2026
- Founders
- Snowflake's announcement names Anupam Datta, Shayak Sen and Will Uppington as TruEra's three co-founders.snowflake.com · read 15 Oct 2026
- Framework integrations
- Official integrations instrument LangChain, LangGraph, LlamaIndex and NeMo Guardrails applications.trulens.org · read 15 Oct 2026
- Independent company profile
- Craft describes TruEra as an AI-observability company founded in 2019 and headquartered in Redwood City.craft.co · read 15 Oct 2026
