Popular repositories Loading

1. DeepSpeed DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 43k 4.9k

2. DeepSpeedExamples DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 6.8k 1.1k

3. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 2.3k 368

4. DeepSpeed-MII DeepSpeed-MII Public

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python 2.1k 191

5. DeepSpeed-Kernels DeepSpeed-Kernels Public

   C++ 75 18

6. deepspeed-gpt-neox deepspeed-gpt-neox Public

   Forked from EleutherAI/gpt-neox

   An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

   Python 22 4