RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

APACHE-2.0 License

Downloads
1.1K
Stars
850
Committers
7
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
128
Total Committers
7
Avg. Commits Per Committer
18.29
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
11
Merged Pull Requests
0
9
Total Issues
6
34
Time to Close Issues
3 days
13 days
Package Rankings
Top 8.25% on Pypi.org
Related Projects
dalle-mini

DALL·E Mini - Generate images from a text prompt

03 Jul 2021 14,752
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

28 Nov 2021 540
x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent ...

01 Dec 2021 681
soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 746
muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

03 Jan 2023 855
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 624
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with ...

03 Oct 2020 19,872
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

05 Jan 2021 5,563
x-transformers

A simple but complete full-attention transformer with a set of promising experimental features fr...

24 Oct 2020 4,226