taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

MIT License

Downloads
22.2K
Stars
88
Committers
2
View Code on GitHub
Ecosystems: Python
taylor-series-linear-attention - 0.1.12 Latest Release

Published by lucidrains 2 months ago

taylor-series-linear-attention - 0.1.11

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.9...0.1.11

taylor-series-linear-attention - 0.1.10

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.9...0.1.10

taylor-series-linear-attention - 0.1.9

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.8...0.1.9

taylor-series-linear-attention - 0.1.8

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.6...0.1.8

taylor-series-linear-attention - 0.1.7

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.6...0.1.7

taylor-series-linear-attention - 0.1.6

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.5...0.1.6

taylor-series-linear-attention - 0.1.5

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/taylor-series-linear-attention/compare/0.1.4...0.1.5

taylor-series-linear-attention - 0.1.4

Published by lucidrains 9 months ago

taylor-series-linear-attention - 0.1.2

Published by lucidrains 9 months ago

taylor-series-linear-attention - 0.1.1

Published by lucidrains 9 months ago

taylor-series-linear-attention - 0.1.0

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.11

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.10

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.9

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.8

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.6

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.4

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.3

Published by lucidrains 10 months ago

taylor-series-linear-attention - 0.0.2

Published by lucidrains 10 months ago

Package Rankings
Top 38.23% on Pypi.org
Related Projects
meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

29 Nov 2023 642
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

24 Apr 2023 393
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

24 Jun 2020 155
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
voicebox-pytorch

Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch

01 Aug 2023 599
q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338
nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

28 Nov 2021 540
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242