DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

APACHE-2.0 License

Downloads
3.9K
Stars
1.9K
Committers
34

Commit Statistics

Past Year

All Time

Total Commits
97
224
Total Committers
22
36
Avg. Commits Per Committer
4.41
6.22
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
99
170
Merged Pull Requests
82
133
Total Issues
180
282
Time to Close Issues
25 days
about 1 month
Package Rankings
Top 6.75% on Proxy.golang.org
Top 5.23% on Pypi.org
Badges
Extracted from project README
Formatting nv-v100-legacy nv-a6000-fastgen License Apache 2.0 PyPI version