Projects
phenaki-pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
Python - Released: 29 Sep 2022 - 747
linear-attention-transformer
Transformer based on a variant of attention that is linear complexity in respect to sequence length
Python - Released: 04 Jun 2020 - 679
voicebox-pytorch
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
Python - Released: 01 Aug 2023 - 599
transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
Python - Released: 23 Aug 2024 - 646
byol-pytorch
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
Python - Released: 16 Jun 2020 - 1,687
alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
Python - Released: 01 Dec 2020 - 1,563
local-attention
An implementation of local windowed attention for language modeling
Python - Released: 05 Jul 2020 - 375
MEGABYTE-pytorch
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
Python - Released: 15 May 2023 - 620
enformer-pytorch
Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch
Python - Released: 23 Oct 2021 - 420
lightweight-gan
Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two
Python - Released: 11 Nov 2020 - 1,623
self-rewarding-lm-pytorch
Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
Python - Released: 19 Jan 2024 - 1,321
ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
Python - Released: 14 Feb 2024 - 457
BS-RoFormer
Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs
Python - Released: 09 Sep 2023 - 409
iTransformer
Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group
Python - Released: 11 Oct 2023 - 429
naturalspeech2-pytorch
Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch
Python - Released: 19 Apr 2023 - 1,269
e2-tts-pytorch
Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch
Python - Released: 09 Jul 2024 - 301
lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
Python - Released: 08 Oct 2020 - 1,533
tab-transformer-pytorch
Implementation of TabTransformer, attention network for tabular data, in Pytorch
Python - Released: 15 Dec 2020 - 793
performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
Python - Released: 03 Oct 2020 - 1,084
q-transformer
Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind
Python - Released: 20 Sep 2023 - 338
perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
Python - Released: 05 Mar 2021 - 1,049
robotic-transformer-pytorch
Implementation of RT1 (Robotic Transformer) in Pytorch
Python - Released: 13 Dec 2022 - 375
flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
Python - Released: 28 Apr 2022 - 1,203