Projects
adam-atan2-pytorch
Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
Python - Released: 30 Jul 2024 - 91
res-mlp-pytorch
Implementation of ResMLP, an all MLP solution to image classification, in Pytorch
Python - Released: 10 May 2021 - 192
gamengen-pytorch
Implementation of a framework for Gamengen in Pytorch
Python - Released: 28 Aug 2024 - 89
self-reasoning-tokens-pytorch
Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
Python - Released: 02 May 2024 - 53
mlm-pytorch
An implementation of masked language modeling for Pytorch, made as concise and simple as possible
Python - Released: 14 Aug 2020 - 175
glom-pytorch
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data
Python - Released: 02 Mar 2021 - 190
invariant-point-attention
Implementation of Invariant Point Attention, used for coordinate refinement in the structure module of Alphafold2, as a standalone Pytorch module
Python - Released: 16 Jul 2021 - 147
unet-stylegan2
A Pytorch implementation of Stylegan2 with UNet Discriminator
Python - Released: 25 Jul 2020 - 199
quartic-transformer
Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
Python - Released: 03 Feb 2024 - 43
halonet-pytorch
Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones
Python - Released: 24 Mar 2021 - 200
recurrent-interface-network-pytorch
Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch
Python - Released: 23 Dec 2022 - 193
fast-transformer-pytorch
Implementation of Fast Transformer in Pytorch
Python - Released: 23 Aug 2021 - 171
scaling-vin-pytorch
Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
Python - Released: 15 Sep 2024 - 36
compressive-transformer-pytorch
Pytorch implementation of Compressive Transformers, from Deepmind
Python - Released: 24 Jun 2020 - 155
videogigagan-pytorch
Implementation of VideoGigaGAN, SOTA video upsampling out of Adobe AI labs, in Pytorch
Python - Released: 03 May 2024 - 62
transganformer
Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper
Python - Released: 11 Mar 2021 - 153
contrastive-learner
A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network
Python - Released: 28 Apr 2020 - 119
ddpm-proteins
A denoising diffusion probabilistic model (DDPM) tailored for conditional generation of protein distograms
Python - Released: 14 Jun 2021 - 133
sinkhorn-router-pytorch
Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
Python - Released: 23 Aug 2024 - 31
SAC-pytorch
Implementation of Soft Actor Critic and some of its improvements in Pytorch
Python - Released: 12 Feb 2024 - 34
gradnorm-pytorch
A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
Python - Released: 15 Nov 2023 - 77
AMIE-pytorch
Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind
Python - Released: 13 Jan 2024 - 53
einops-exts
Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
Python - Released: 09 Apr 2022 - 52
discrete-key-value-bottleneck-pytorch
Implementation of Discrete Key / Value Bottleneck, in Pytorch
Python - Released: 25 Jul 2022 - 87