- Home
- GPU Cluster Management Software
- GPUStack
GPUStack
Shenzhen, Guangdong, China
What it is
GPUStack is an open-source manager for deploying and operating AI models across on-premise, cloud, and hybrid infrastructure. It exposes models through OpenAI-compatible and Anthropic-compatible APIs, and supports inference engines such as vLLM, SGLang, llama.cpp, TensorRT-LLM, and MindIE. Users can select models from Hugging Face and ModelScope or supply local files; GPUStack checks compatibility automatically. It also provisions GPU instances with lifecycle controls, GPU partitioning, SSH key injection, Jupyter access, and persistent S3 or NFS storage. Deployment options include Kubernetes and multi-cloud setups, as well as air-gapped environments. The maker lists accelerators from NVIDIA, AMD, Ascend, T-head, Hygon, MetaX, Moore Threads, Cambricon, and Iluvatar. Security controls include role-based access, multi-tenancy, SSO, scoped API keys, IP allowlisting, quotas, and usage analytics. GPUStack Community Edition is free. Enterprise licensing requires contacting the company for pricing.
For and against
For
- Free Community Edition
- OpenAI- and Anthropic-compatible endpoints
- Supports several inference engines
- GPU instances include persistent storage options
- Lists security controls and usage analytics
Against
- Worker nodes support Linux only
- macOS worker nodes are not supported
- Enterprise licensing requires contacting the company
The verdict
GPUStack combines model deployment, inference APIs, and GPU instance management in one open-source platform. Check worker-node operating system requirements and contact the company for Enterprise Edition pricing.
Who it suits
GPUStack suits teams deploying AI models across on-premise, cloud, or hybrid infrastructure. It may also fit organizations that need GPU provisioning, Kubernetes support, or air-gapped deployment.
Plans and prices
GPUStack Community Edition
Open-source GPU cluster manager
Read 29 Sep 2026 · gpustack.ai
On the record
- Deployment
- It supports on-premise, Kubernetes, and multi-cloud GPU deployments, and the maker states that air-gapped deployments are supported.gpustack.ai · read 29 Sep 2026
- Enterprise availability
- GPUStack Enterprise describes control-plane and model-service high availability with automatic failover and traffic rerouting.gpustack.ai · read 29 Sep 2026
- Enterprise licensing
- The contact page directs users to contact the company for pricing and Enterprise Edition licensing.gpustack.ai · read 29 Sep 2026
- Enterprise security
- GPUStack Enterprise describes immutable audit logs, CIDR-based IP allowlists and blocklists, and per-model and per-API-key access rules.gpustack.ai · read 29 Sep 2026
- GPU service
- GPUStack can provision GPU instances with lifecycle controls, GPU partitioning, SSH key injection, Jupyter access, and persistent S3 or NFS storage.gpustack.ai · read 29 Sep 2026
- Inference APIs
- It exposes models through OpenAI-compatible and Anthropic-compatible endpoints.gpustack.ai · read 29 Sep 2026
- Inference engines
- The platform supports inference engines including vLLM, SGLang, llama.cpp, TensorRT-LLM, and MindIE.gpustack.ai · read 29 Sep 2026
- Integrations
- Listed integrations include OpenWebUI, LangChain, n8n, Dify, RAGFlow, Claude Code, OpenClaw, Docker, Podman, Kubernetes, Helm, Prometheus, and Grafana.gpustack.ai · read 29 Sep 2026
- Linux worker requirement
- The Docker installation page says GPUStack worker nodes support Linux only; Windows users are directed to consider WSL2, and macOS is not supported for worker nodes.docs.gpustack.ai · read 29 Sep 2026
- Model sources
- Users can browse and download models from Hugging Face and ModelScope or provide local model files, with automated compatibility checks.gpustack.ai · read 29 Sep 2026
- Security
- The site lists RBAC, multi-tenancy, OIDC/SAML/AD-LDAP SSO, scoped API keys, IP allowlisting, token quotas, and usage analytics.gpustack.ai · read 29 Sep 2026
- Support
- The contact page offers personalized demos and architecture, deployment, and scaling guidance, and says replies typically arrive within one business day.gpustack.ai · read 29 Sep 2026
- Supported hardware
- The maker lists NVIDIA, AMD, Ascend, T-head, Hygon, MetaX, Moore Threads, Cambricon, and Iluvatar accelerators.gpustack.ai · read 29 Sep 2026
- What it does
- GPUStack is an open-source GPU cluster manager for deploying, governing, and scaling AI models across on-premise, cloud, or hybrid infrastructure.gpustack.ai · read 29 Sep 2026
