Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

APACHE-2.0 License

Downloads
96
Stars
2.2K
View Code on GitHub Visit Website
Ecosystems: Jupyter Notebook

Issue Statistics

Past Year

All Time

Total Pull Requests
8
25
Merged Pull Requests
4
20
Total Issues
43
75
Time to Close Issues
20 days
24 days
Package Rankings
Top 38.26% on Pypi.org
Related Projects
llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

17 Jun 2023 37,645