Pinned Loading

1. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

2. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

3. accelerate accelerate Public

   Forked from huggingface/accelerate

   🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

   Python

4. Megatron-Bridge Megatron-Bridge Public

   Forked from NVIDIA-NeMo/Megatron-Bridge

   Training library for Megatron-based models

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

6. RL RL Public

   Forked from NVIDIA-NeMo/RL

   Scalable toolkit for efficient model reinforcement

   Python