FasterDecoding's tracked open-source repos, sorted by stars.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads