infini-transformer-pytorch

Implementation of Infini-Transformer in Pytorch

MIT License

Downloads
1.5K
Stars
102
Committers
1
View Code on GitHub
Ecosystems: Python
infini-transformer-pytorch - 0.0.6

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.5

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.4

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/compare/0.0.3...0.0.4

infini-transformer-pytorch - 0.0.3

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/compare/0.03...0.0.3

infini-transformer-pytorch - 0.03

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/compare/0.0.2...0.03

infini-transformer-pytorch - 0.0.2

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/compare/0.0.1...0.0.2

infini-transformer-pytorch - 0.0.1

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/commits/0.0.1

Package Rankings
Top 35.93% on Pypi.org
Related Projects
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver ...

18 Jun 2022 86
memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

10 Oct 2020 106
learning-to-expire-pytorch

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

11 Oct 2020 33
RQ-Transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Re...

11 Mar 2022 89
feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 72
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

22 Dec 2020 87
long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attenti...

07 Jul 2021 116
block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212
fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171