A General-purpose Task-parallel Programming System in C++

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

CUDA Core Compute Libraries

Sample codes for my CUDA programming book

Write Java. Run on GPUs. Fast.

Safe rust wrapper around CUDA toolkit

A self-learning tutorail for CUDA High Performance Programing.

TinyChatEngine: On-Device LLM Inference Library

A curated list of best cuda programming books

Thin, unified, C++-flavored wrappers for the CUDA APIs

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

GPU Engineering for AI Systems

Static suckless single batch CUDA-only qwen3-0.6B mini inference engine

A simple GPU hash table implemented in CUDA using lock free techniques

A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

Comprehensive CUDA tutorials for Maths & ML with examples

This is an archive of materials produced for an introductory class on CUDA programming at Stanford University in 2010

μ-Cuda, COVER THE LAST MILE OF CUDA. With features: intellisense-friendly, structured launch, automatic cuda graph generation and updating.

Accelerated General (FP32) Matrix Multiplication from scratch in CUDA