infini-transformer-pytorch

Implementation of Infini-Transformer in Pytorch

MIT License

Downloads
1.5K
Stars
102
Committers
1
View Code on GitHub
Ecosystems: Python
infini-transformer-pytorch - 0.1.5 Latest Release

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.1.1a

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.1.0

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.25

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.24

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.23

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.22

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.21

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.20

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.18

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.17

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.16

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.15

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.14

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.12

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.11

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.10

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/infini-transformer-pytorch/compare/0.0.9...0.0.10

infini-transformer-pytorch - 0.0.9

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.8

Published by lucidrains 6 months ago

infini-transformer-pytorch - 0.0.7

Published by lucidrains 6 months ago

Package Rankings
Top 35.93% on Pypi.org
Related Projects
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

10 Oct 2020 106
block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623
RQ-Transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Re...

11 Mar 2022 89
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 72
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153
learning-to-expire-pytorch

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

11 Oct 2020 33
fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171
lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

22 Dec 2020 87
feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104
long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attenti...

07 Jul 2021 116
perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver ...

18 Jun 2022 86