- Home
- AI Prompt Management Software
- PromptMetrics
On the recordRead 8 Oct 202624 facts
PromptMetrics
Berlin, Germany
On the record
- Agent telemetry
- It tracks agent traces and spans, workflow runs, and prompt versions tagged with environment labels.github.com · read 8 Oct 2026
- Compliance scanning
- Its compliance engine scans prompts for PII, API keys, URLs, and IP addresses and assigns risk scores.github.com · read 8 Oct 2026
- Dashboard
- An optional Next.js dashboard provides charts and views for prompts, logs, traces, evaluations, A/B tests, compliance, and the playground.github.com · read 8 Oct 2026
- Dashboard key handling
- The dashboard authenticates through a BFF proxy so API keys are not stored in browser localStorage.github.com · read 8 Oct 2026
- Deployment
- The README provides installation options using npm, Docker Compose, or source, and describes the product as self-hosted.github.com · read 8 Oct 2026
- Evaluations and A/B tests
- Evaluation suites can be run against datasets with budget tracking, and A/B tests compare prompt versions and can promote a winner.github.com · read 8 Oct 2026
- Evaluations and testing
- It supports evaluation suites, dataset-backed evaluation runs, and statistical A/B comparisons with winner promotion.github.com · read 8 Oct 2026
- Installation
- The README documents installation through npm, Docker Compose, or building from source.github.com · read 8 Oct 2026
- Interfaces and SDKs
- The project provides a REST API, CLI, optional Next.js dashboard, and Node.js and Python SDKs.github.com · read 8 Oct 2026
- License
- The repository identifies the project as MIT licensed.github.com · read 8 Oct 2026
- LLM providers
- The playground can proxy chat and completion calls for OpenAI, Anthropic, Cohere, Ollama, and Azure OpenAI.github.com · read 8 Oct 2026
- Logging
- Structured logs can capture model, token, latency, cost, and custom-tag metadata and export to stdout JSON or OpenTelemetry.github.com · read 8 Oct 2026
- Maker and company details
- The repository says it is maintained by the PromptMetrics team; it does not state a headquarters or founding date.github.com · read 8 Oct 2026
- Observability
- It logs LLM request metadata such as model, tokens, latency, cost, and custom tags, and can export data through OpenTelemetry.github.com · read 8 Oct 2026
- Prompt versioning
- Prompts can be stored, versioned, retrieved, and rolled back through a REST API or CLI, with changes recorded in Git.github.com · read 8 Oct 2026
- Purpose
- PromptMetrics is a lightweight, self-hosted prompt registry with Git-backed versioning, metadata logging, and evaluations for LLM observability.github.com · read 8 Oct 2026
- Rate limit
- The README lists a default limit of 300 requests per 60-second window per API key, configurable through environment variables.github.com · read 8 Oct 2026
- SDKs
- The project lists Node.js and Python SDKs for programmatic access.github.com · read 8 Oct 2026
