Distributed Training Tools

Apache MXNet

Development

The high-performance deep learning framework for flexible and efficient distributed training.

Ray

General AI

Ray is an open-source AI compute engine for scaling AI and Python applications.

PyTorch-Ignite

Machine Learning

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Accelerate

General AI

Enables running PyTorch code across any distributed configuration with minimal code changes.

OneTrainer

General AI

A lightweight training framework, making distributed training easier and faster.