fairscale

PyTorch extensions for high performance and large scale training.

OTHER License

Stars
3.2K
Committers
70
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
8
700
Total Committers
8
75
Avg. Commits Per Committer
1.0
9.33
Bot Commits
0
1

Issue Statistics

Past Year

All Time

Total Pull Requests
42
113
Merged Pull Requests
19
62
Total Issues
10
57
Time to Close Issues
20 days
27 days
Package Rankings
Top 6.75% on Proxy.golang.org
Top 16.92% on Spack.io
Top 15.15% on Conda-forge.org
Badges
Extracted from project README
Support Ukraine Documentation Status CircleCI Downloads PRs Welcome Explain Like Iā€™m 5: FairScale
Related Projects
TimeSformer

The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video ...

02 Apr 2021 1,518
fvcore

Collection of common code that's shared among different research projects in FAIR computer vision...

25 Sep 2019 1,993
gradsflow-automl

An open-source AutoML Library based on PyTorch

11 Aug 2021 306
ignite

High-level library to help with training and evaluating neural networks in PyTorch flexibly and t...

23 Nov 2017 4,484
TensorLayer

Deep Learning and Reinforcement Learning Library for Scientists and Engineers

07 Jun 2016 7,302
CV-pretrained-model

A collection of computer vision pre-trained models.

14 Jul 2020 1,273
accelerate

šŸš€ A simple way to launch, train, and use PyTorch models on almost any device and distributed conf...

30 Oct 2020 7,759
peft

šŸ¤— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

25 Nov 2022 15,987
torchmetrics

Torchmetrics - Machine learning metrics for distributed, scalable PyTorch applications.

22 Dec 2020 1,998
sentiment-discovery

Unsupervised Language Modeling at scale for robust sentiment classification

30 Nov 2017 1,061
xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

13 Oct 2021 7,730
OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DP...

30 Jul 2023 2,191
the-incredible-pytorch

The Incredible PyTorch: a curated list of tutorials, papers, projects, communities and more relat...

11 Feb 2017 11,389
TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482
Deep-Learning-in-Production

In this repository, I will share some useful notes and references about deploying deep learning-b...

03 May 2018 4,294