infini-transformer-pytorch

Implementation of Infini-Transformer in Pytorch

MIT License

Downloads
1.5K
Stars
102
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
45
45
Total Committers
1
1
Avg. Commits Per Committer
45.0
45.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
1
1
Time to Close Issues
about 5 hours
about 5 hours
Package Rankings
Top 35.93% on Pypi.org
Related Projects
RQ-Transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Re...

11 Mar 2022 89
long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attenti...

07 Jul 2021 116
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153
perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver ...

18 Jun 2022 86
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212
memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

10 Oct 2020 106
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
learning-to-expire-pytorch

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

11 Oct 2020 33
feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 72
lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

22 Dec 2020 87
fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620