Horovod

Plans and prices

Every plan, in full

On the record

Autotuning

Horovod includes automated performance tuning that can be enabled with a command-line argument.github.com · read 9 Oct 2026

Collectives

Its distributed optimizer averages gradients using allreduce or allgather before applying them.github.com · read 9 Oct 2026

Deployment

Horovod can be installed on-premise or run on AWS, Azure and Databricks.horovod.ai · read 9 Oct 2026

Installation

The getting-started page provides pip installation commands for CPU use and GPU use with NCCL.horovod.ai · read 9 Oct 2026

MPI alternative

Gloo is included and allows Horovod to run without MPI installed.github.com · read 9 Oct 2026

Open source

Horovod is described as an open source project hosted by the LF AI & Data Foundation.github.com · read 9 Oct 2026

Performance

Tensor Fusion batches small allreduce operations and interleaves communication with computation.github.com · read 9 Oct 2026

Project status

The repository says Horovod was archived in September 2026 due to inactivity and is read-only.github.com · read 9 Oct 2026

Purpose

Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch and Apache MXNet.horovod.ai · read 9 Oct 2026

Requirements

The project README says Linux or macOS installation requires CMake and describes compiler requirements for supported frameworks.github.com · read 9 Oct 2026

Runtime integrations

Documentation describes running Horovod with Docker, Kubernetes, Spark, Ray, Singularity, LSF and Hadoop Yarn.github.com · read 9 Oct 2026

Scale

The project site says an existing training script can be scaled to hundreds of GPUs with a few lines of Python code.horovod.ai · read 9 Oct 2026

Security

The documentation includes a security section for Horovod on Spark; the opened pages make no security certification or compliance claim.horovod.readthedocs.io · read 9 Oct 2026

Spark

Horovod can run on Apache Spark to combine data processing and model training in one pipeline.horovod.ai · read 9 Oct 2026

Support

The project directs users to documentation, troubleshooting guidance and a ticket submission link for unresolved issues.github.com · read 9 Oct 2026

Alternatives to Horovod

Every alternative, ranked