Data Parallelism

Accelerate

Enables running PyTorch code across any distributed configuration with minimal code changes.

OneTrainer

A lightweight training framework, making distributed training easier and faster.