Projects
zorro-pytorch
Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
Python - Released: 26 Jan 2023 - 95
progen
Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax
Python - Released: 09 Jun 2021 - 109
llama-qrlhf
Implementation of the Llama architecture with RLHF + Q-learning
Python - Released: 23 Nov 2023 - 155
charformer-pytorch
Implementation of the GBST block from the Charformer paper, in Pytorch
Python - Released: 30 Jun 2021 - 116
STAM-pytorch
Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification
Python - Released: 28 Mar 2021 - 126
long-short-transformer
Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
Python - Released: 07 Jul 2021 - 116
mirasol-pytorch
Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
Python - Released: 18 Nov 2023 - 84
perceiver-ar-pytorch
Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
Python - Released: 18 Jun 2022 - 86
global-self-attention-network
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
Python - Released: 02 Oct 2020 - 92
MaMMUT-pytorch
Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
Python - Released: 05 May 2023 - 97
pi-GAN-pytorch
Implementation of π-GAN, for 3d-aware image synthesis, in Pytorch
Python - Released: 04 Dec 2020 - 116
gated-state-spaces-pytorch
Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
Python - Released: 29 Jun 2022 - 94
chroma-pytorch
Implementation of Chroma, generative models of protein using DDPM and GNNs, in Pytorch
Python - Released: 02 Dec 2022 - 158
feedback-transformer-pytorch
Implementation of Feedback Transformer in Pytorch
Python - Released: 02 Feb 2021 - 104
memformer
Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
Python - Released: 10 Oct 2020 - 106
phasic-policy-gradient
An implementation of Phasic Policy Gradient, a proposed improvement of Proximal Policy Gradients, in Pytorch
Python - Released: 27 Sep 2020 - 42
RQ-Transformer
Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"
Python - Released: 11 Mar 2022 - 89
tf-bind-transformer
A repository with exploration into using transformers to predict DNA ↔ transcription factor binding
Python - Released: 08 Dec 2021 - 81
VN-transformer
A Transformer made of Rotation-equivariant Attention using Vector Neurons
Python - Released: 12 Jun 2022 - 81
uniformer-pytorch
Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022
Python - Released: 13 Nov 2021 - 97
axial-positional-embedding
Axial Positional Embedding for Pytorch
Python - Released: 08 Jun 2020 - 61
hourglass-transformer-pytorch
Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
Python - Released: 08 Nov 2021 - 82
TPDNE
Thispersondoesnotexist went down, so this time, while building it back up, I am going to open source all of it.
Python - Released: 04 Mar 2023 - 86
tr-rosetta-pytorch
Implementation of trRosetta and trDesign for Pytorch, made into a convenient package, for protein structure prediction and design
Python - Released: 04 Feb 2021 - 79
lie-transformer-pytorch
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
Python - Released: 22 Dec 2020 - 87