DeepSpeed

Plans and prices

Every plan, in full

On the record

Accelerators

The getting-started guide names AMD ROCm, Intel Xeon CPU, Intel Data Center Max Series XPU, Intel Gaudi HPU and Huawei Ascend NPU support.deepspeed.ai · read 4 Oct 2026

Data efficiency

The Data Efficiency Library uses curriculum learning and random layerwise token dropping, with the site reporting up to 2x data and time savings for specified workloads.deepspeed.ai · read 4 Oct 2026

Inference

DeepSpeed-Inference supports model parallelism, inference-customized kernels and model quantization for transformer-based PyTorch models.deepspeed.ai · read 4 Oct 2026

Integrations

The site lists integrations with Hugging Face Transformers, Accelerate, PyTorch Lightning and MosaicML.deepspeed.ai · read 4 Oct 2026

Intended users

The project describes its audience as deep learning researchers and practitioners working on large-scale training and inference.microsoft.com · read 4 Oct 2026

License

The GitHub repository identifies DeepSpeed as an open-source project under the Apache-2.0 license.github.com · read 4 Oct 2026

Megatron compatibility

DeepSpeed states that it is fully compatible with Megatron and supports combining its data parallelism with model parallelism.deepspeed.ai · read 4 Oct 2026

Monitoring

The DeepSpeed Monitor can log live training metrics to TensorBoard, WandB or CSV files.deepspeed.ai · read 4 Oct 2026

Purpose

DeepSpeed is a deep learning optimization library for distributed model training and inference.github.com · read 4 Oct 2026

PyTorch API

DeepSpeed describes its API as a lightweight wrapper around PyTorch that manages distributed training, mixed precision, gradient accumulation and checkpoints.deepspeed.ai · read 4 Oct 2026

Security

The repository links to a SECURITY file and identifies the project as Apache-2.0 licensed.github.com · read 4 Oct 2026

Support

The GitHub repository says DeepSpeed holds public office hours on the last Tuesday of each month.github.com · read 4 Oct 2026

Training

Its training features include mixed precision, data, model and pipeline parallelism, and the ZeRO optimizer.deepspeed.ai · read 4 Oct 2026

ZeRO memory optimization

ZeRO partitions model states and gradients across data-parallel processes to reduce memory use.deepspeed.ai · read 4 Oct 2026

Alternatives to DeepSpeed

Every alternative, ranked