hamburger-pytorch

Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"

MIT License

Downloads
60
Stars
98
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
18
Total Committers
1
Avg. Commits Per Committer
18.0
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
0
3
Time to Close Issues
N/A
8 months
Package Rankings
Top 19.56% on Pypi.org
Related Projects
isab-pytorch

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

26 Oct 2020 53
halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Paramete...

24 Mar 2021 200
hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

08 Nov 2021 74
res-mlp-pytorch

Implementation of ResMLP, an all MLP solution to image classification, in Pytorch

10 May 2021 191
lambda-networks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less...

08 Oct 2020 1,532
molecule-attention-transformer

Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle th...

30 Nov 2020 58
pytorch-toolbelt

PyTorch extensions for fast R&D prototyping and Kaggle farming

15 Mar 2019 1,476
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153
deformable-attention

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deforma...

17 Mar 2022 273
point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

18 Dec 2020 587
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 73
glom-pytorch

An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts fro...

02 Mar 2021 190
segformer-pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

06 Jun 2021 336
ITTR-pytorch

Implementation of the Hybrid Perception Block and Dual-Pruned Self-Attention block from the ITTR ...

01 Apr 2022 33