Pinned Loading

1. LeetCUDA LeetCUDA Public

   Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.

   Cuda 11.8k 1.2k

2. lite.ai.toolkit lite.ai.toolkit Public

   A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.

   C++ 4.4k 783

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

   Python 5.5k 429

4. Awesome-DiT-Inference Awesome-DiT-Inference Public

   📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉

   Python 587 29

5. torchlm torchlm Public

   💎An easy-to-use PyTorch library for face landmarks detection: training, evaluation, inference, and 100+ data augmentations.🎉

   Python 270 29

6. ffpa-attn ffpa-attn Public

   Fast and Memory-Efficient Exact Attention (BF16/FP16/FP8/FP4) for Large Headdim, 1.5x~15x speedup over PyTorch SDPA.

   Python 323 25