- Home
- LLM gateways
- Manifest
Manifest
What it is
Manifest is an open-source LLM gateway that routes requests, handles provider failures and tracks inference spending. It offers one endpoint compatible with OpenAI and Anthropic for models and subscriptions. If a provider goes down, the gateway can retry through another provider; Autofix can repair malformed requests and resend them when retries alone do not resolve the issue. Its observability tools show spending by harness, which models served requests and what failed. Manifest connects API keys, paid subscriptions, local models and custom endpoints, including Ollama, llama.cpp and LM Studio. The self-hosted gateway runs with Docker, works offline, requires no account and supports amd64 and arm64. The Cloud Free plan includes 10,000 routed requests per calendar month, but cannot reach local models on a user's machine. Manifest says self-hosted routing and request data stay on customer servers except for documented telemetry and Autofix flows. The Free plan includes unlimited self-hosted use; Pro costs $19/mo and includes unlimited routed requests on Manifest Cloud.
For and against
For
- One endpoint supports OpenAI- and Anthropic-compatible models
- Can retry requests through another provider
- Autofix repairs malformed requests and resends them
- Self-hosting works offline and requires no account
- Tracks spending, model usage and failures
Against
- Cloud Free is limited to 10,000 routed requests monthly
- Cloud Free cannot reach local models on the user's machine
- Pro is single-user
The verdict
Manifest combines routing, fallback handling, request repair and spending visibility in a cloud or self-hosted gateway. The Cloud Free request limit and local-model restriction distinguish it from self-hosting.
Who it suits
Manifest is aimed at AI builders, teams and startups, as well as platforms or providers managing inference consumption. It suits users who want a shared gateway for hosted and local model connections or a self-hosted deployment.
Plans and prices
Free
Manifest Cloud or Docker self-hosted · MIT licence · unlimited agents · 10,000 routed Cloud requests/month
Read 15 Oct 2026 · manifest.build
Pro
Hosted Manifest Cloud · unlimited routed requests · 365-day dashboard retention · basic support
Read 15 Oct 2026 · manifest.build
Enterprise
On-premise, VPC or private cloud · multiple seats and team management · SSO/SAML · audit logs
Read 15 Oct 2026 · manifest.build
On the record
- API example
- The documented chat endpoint is POST /v1/chat/completions with a harness key beginning mnfst_.manifest.build · read 15 Oct 2026
- Audience
- Manifest says its gateway helps AI builders, teams and startups, and platforms or providers create reliable agents and workflows and manage inference consumption.manifest.build · read 1 Oct 2026
- Autofix
- Autofix repairs malformed provider requests and resends them before the agent receives an error.manifest.build · read 15 Oct 2026
- Bring-your-own keys
- Users can connect their own provider API keys and OAuth-backed subscriptions and pay providers directly.manifest.build · read 15 Oct 2026
- CLI
- The documentation says the CLI can create harnesses, connect providers, configure routing and read request logs.manifest.build · read 15 Oct 2026
- Cloud limit
- The Cloud Free plan includes 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.manifest.build · read 1 Oct 2026
- Cloud limitation
- The free Cloud plan is limited to 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.manifest.build · read 15 Oct 2026
- Community integration
- A GitHub issue author called the self-hosted router clean and effective for request-complexity routing and failover, including self-hosted models.github.com · read 15 Oct 2026
- Company headquarters
- LinkedIn lists Berkeley, California as Manifest's headquarters.linkedin.com · read 15 Oct 2026
- Company size
- LinkedIn lists Manifest as a 2–10 employee software-development company.linkedin.com · read 15 Oct 2026
- Compliance
- The Enterprise plan lists HIPAA and custom BAAs, SSO/SAML, audit logs, custom retention, and a contractual uptime SLA.manifest.build · read 1 Oct 2026
- Data residency
- For the self-hosted version, routing and request data stay on the customer's servers except for documented telemetry and Autofix flows.manifest.build · read 1 Oct 2026
- Deployment options
- Repository deployment guides cover Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, Koyeb and Apple Containers.github.com · read 15 Oct 2026
- Documentation depth
- The documentation includes installation, first-request examples, provider setup, environment variables, CLI guidance and deployment paths.manifest.build · read 15 Oct 2026
- Enterprise compliance
- Enterprise pricing lists SSO/SAML, audit logs, contractual uptime SLAs, HIPAA and custom business associate agreements.manifest.build · read 15 Oct 2026
- Fallbacks
- Manifest automatically retries another provider when a selected provider fails.manifest.build · read 15 Oct 2026
- Founded year
- LinkedIn lists Manifest as founded in 2025.linkedin.com · read 15 Oct 2026
- Independent praise: fallbacks
- The same reviewer reported that automatic fallbacks kept an agent working during a provider outage.andrew.ooo · read 15 Oct 2026
