Projects
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Python - Released: 12 Jun 2022 - 9,134
hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
Python - Released: 27 Feb 2020 - 2,001
efficient-dl-systems
Efficient Deep Learning Systems course materials (HSE, YSDA)
Jupyter Notebook - Released: 06 Dec 2021 - 651
learning-at-home
"Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implementation
Jupyter Notebook - Released: 10 Feb 2020 - 53
dl-hse-ami
Deep Learning course materials (HSE, Faculty of Computer Science)
Jupyter Notebook - Released: 31 Aug 2022 - 37
vmf_loss
PyTorch Implementation of "Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputs"
Python - Released: 11 Feb 2019 - 6