memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

MIT License

Downloads

1.7K

Stars

624

Committers

View Code on GitHub

Ecosystems: Python

Bot releases are hidden (Show)

memorizing-transformers-pytorch - 0.4.1 Latest Release

Published by lucidrains over 1 year ago

memorizing-transformers-pytorch - 0.4.0

Published by lucidrains over 1 year ago

memorizing-transformers-pytorch - 0.3.10

Published by lucidrains almost 2 years ago

memorizing-transformers-pytorch - 0.3.9a

Published by lucidrains almost 2 years ago

memorizing-transformers-pytorch - 0.3.9

Published by lucidrains almost 2 years ago

memorizing-transformers-pytorch - 0.3.8

Published by lucidrains almost 2 years ago

memorizing-transformers-pytorch - 0.3.7

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.6

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.5

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.4

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.3

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.2

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.1

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.3.0

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.21

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.20

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.19

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.18

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.17

Published by lucidrains over 2 years ago

memorizing-transformers-pytorch - 0.2.16

Published by lucidrains over 2 years ago

Package Rankings

Top 10.86% on Pypi.org

Related Projects

soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370

RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

15 Jan 2022 850

block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212

se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repo...

09 Jan 2021 253

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features fr...

24 Oct 2020 4,226

phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 746

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with ...

03 Oct 2020 19,872

memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 373

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084

compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

24 Jun 2020 155

equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595

audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399

En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208