FasterDecoding

Think deeper, decode faster

Pinned Loading

Medusa Medusa Public

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Jupyter Notebook 2.8k 205

Type Language Sort

REST Public
REST: Retrieval-Based Speculative Decoding, NAACL 2024

FasterDecoding/REST's past year of commit activity

C 221 Apache-2.0 17 15 0 Updated Mar 5, 2026
SnapKV Public

FasterDecoding/SnapKV's past year of commit activity

Python 332 Apache-2.0 33 18 1 Updated Jul 10, 2025
TEAL Public

FasterDecoding/TEAL's past year of commit activity

Python 171 MIT 16 6 1 Updated Feb 15, 2025
BitDelta Public

FasterDecoding/BitDelta's past year of commit activity

Jupyter Notebook 206 Apache-2.0 16 3 1 Updated Dec 5, 2024
Medusa Public
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

FasterDecoding/Medusa's past year of commit activity

Jupyter Notebook 2,770 Apache-2.0 205 51 6 Updated Jun 25, 2024

This organization has no public members. You must be a member to see who’s a part of this organization.

Loading…

Loading…