recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

MIT License

Downloads
932
Stars
393
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
1
67
Total Committers
1
1
Avg. Commits Per Committer
1.0
67.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
3
21
Time to Close Issues
6 minutes
1 day
Package Rankings
Top 19.67% on Pypi.org
Related Projects
RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

15 Jan 2022 849
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

06 Apr 2023 204
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

05 Jan 2021 5,563
dalle-mini

DALL·E Mini - Generate images from a text prompt

03 Jul 2021 14,752
nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

28 Nov 2021 540
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623
compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

24 Jun 2020 155
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 747
x-transformers

A simple but complete full-attention transformer with a set of promising experimental features fr...

24 Oct 2020 4,226
x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent ...

01 Dec 2021 686
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084