petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

MIT License

Downloads
1.2K
Stars
9.1K
Committers
17
View Code on GitHub Visit Website View on X
Ecosystems: PyTorch, Llama

Commit Statistics

Past Year

All Time

Total Commits
30
513
Total Committers
10
21
Avg. Commits Per Committer
3.0
24.43
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
47
180
Merged Pull Requests
24
131
Total Issues
44
160
Time to Close Issues
17 days
25 days
Package Rankings
Top 4.81% on Pypi.org
Top 6.75% on Proxy.golang.org
Related Projects
transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

29 Oct 2018 132,459
peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

25 Nov 2022 15,987
JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

30 Mar 2023 23,575
LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

27 Mar 2023 8,170
BigDL-2.x

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

05 May 2017 2,664
speechbrain

A PyTorch-based Speech Toolkit

28 Apr 2020 7,821
mt-dnn

Multi-Task Deep Neural Networks for Natural Language Understanding

19 Feb 2019 2,210
DialoGPT

Large-scale pretraining for dialogue

29 Aug 2019 2,352
hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across t...

27 Feb 2020 2,001