- Home
- Deep Learning Software
- NVIDIA Triton Inference Server
On the recordRead 4 Oct 202614 facts
NVIDIA Triton Inference Server
Santa Clara, California, United States
Plans and prices
Open-source development
Free
Open-source code on GitHub · free Triton containers on NVIDIA NGC for development
Read 4 Oct 2026 · nvidia.com
NVIDIA AI Enterprise cloud production
Priced on request
Cloud marketplace production use · support limited to 3 calls
Read 4 Oct 2026 · docs.nvidia.com
NVIDIA AI Enterprise subscription
$4,500a year
Per GPU · for production use · Business Standard Support included
Read 4 Oct 2026 · docs.nvidia.com
On the record
- Deployment platforms
- It runs on NVIDIA GPUs, non-NVIDIA accelerators, x86 and ARM CPUs, and supports cloud, data center, edge, and embedded deployments.docs.nvidia.com · read 4 Oct 2026
- Downloads
- NVIDIA lists Linux containers for x86 and Arm, plus Windows and Jetson JetPack binary releases on GitHub.developer.nvidia.com · read 4 Oct 2026
- Enterprise support
- NVIDIA AI Enterprise includes Business Standard Support with 24/7 case filing, local business-hours support coverage, a four-hour initial response, and up to three years of long-term branch maintenance for selected components.docs.nvidia.com · read 4 Oct 2026
- Evaluation
- NVIDIA offers a 90-day NVIDIA AI Enterprise evaluation license for Triton production inference.developer.nvidia.com · read 4 Oct 2026
- Frameworks
- Supported frameworks include TensorRT, PyTorch, ONNX, OpenVINO, Python, and RAPIDS FIL.developer.nvidia.com · read 4 Oct 2026
- Integrations
- It integrates with Kubernetes for scaling and Prometheus for monitoring, and NVIDIA lists availability through AWS, Azure, and Google Cloud marketplaces with NVIDIA AI Enterprise.developer.nvidia.com · read 4 Oct 2026
- Performance features
- It offers dynamic batching, concurrent model execution, and optimized configurations.developer.nvidia.com · read 4 Oct 2026
- Protocols
- Inference requests can use HTTP/REST, gRPC, or the C API; Triton also provides a Java API for in-process use cases.docs.nvidia.com · read 4 Oct 2026
- Purpose
- Dynamo-Triton is open-source inference-serving software for deploying, running, and scaling AI models from multiple frameworks on GPU- or CPU-based infrastructure.developer.nvidia.com · read 4 Oct 2026
- Security
- NVIDIA's secure-deployment guide says solution security is the deployer's responsibility, dynamic model repository updates are disabled by default, and Triton does not sandbox arbitrary model or backend code.docs.nvidia.com · read 4 Oct 2026
- Who it is for
- NVIDIA describes GitHub and NGC options for individuals developing with Triton and NVIDIA AI Enterprise for enterprises purchasing it for production.nvidia.com · read 4 Oct 2026
- Workloads
- It supports real-time, batched, ensemble, and audio/video streaming inference workloads.developer.nvidia.com · read 4 Oct 2026