- Home
- Model Hosting
- BentoML
On the recordRead 29 Sep 202613 facts
BentoML
Plans and prices
BentoML Open-Source
Free
Open-source model serving framework · install via pip
Read 29 Sep 2026 · docs.bentoml.com
BentoCloud
Priced on request
Free trial mentioned · manages AI inference deployments
Read 29 Sep 2026 · docs.bentoml.com
On the record
- Community support
- BentoML directs users to its community forum, GitHub project, and release notes for updates and support resources.docs.bentoml.com · read 29 Sep 2026
- Deployment
- The platform supports deployment to BentoCloud and deployment in a user’s cloud environment.docs.bentoml.com · read 29 Sep 2026
- GPU support
- BentoML documentation describes running model inference on GPUs.docs.bentoml.com · read 29 Sep 2026
- Integrations
- Documented integrations include PyTorch, Transformers, TensorFlow, MLflow, XGBoost, Ray, and ONNX.docs.bentoml.com · read 29 Sep 2026
- Model serving
- BentoML packages and serves custom models as online API services.docs.bentoml.com · read 29 Sep 2026
- Monitoring
- BentoML documentation includes monitoring, logging, metrics, and tracing topics.docs.bentoml.com · read 29 Sep 2026
- OpenAI compatibility
- A featured example serves large language models with OpenAI-compatible APIs and a vLLM inference backend.docs.bentoml.com · read 29 Sep 2026
- Purpose
- BentoML is a unified inference platform for deploying and scaling AI models with production-grade reliability.docs.bentoml.com · read 29 Sep 2026
- Scaling
- BentoCloud documentation includes concurrency configuration and autoscaling.docs.bentoml.com · read 29 Sep 2026
- Security controls
- BentoCloud documentation includes managing secrets and API tokens, and administering users.docs.bentoml.com · read 29 Sep 2026
- Serving capabilities
- The documentation lists adaptive batching, model composition, async task queues, streaming responses, and WebSocket endpoints.docs.bentoml.com · read 29 Sep 2026
- Trial
- The documentation says users can sign up for BentoCloud to get a free trial; it does not state the trial duration.docs.bentoml.com · read 29 Sep 2026
