quartic-transformer

Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)

MIT License

Downloads
493
Stars
43
Committers
1
View Code on GitHub
Ecosystems: Python
quartic-transformer - 0.0.12 Latest Release

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.11...0.0.12

quartic-transformer - 0.0.11

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.10...0.0.11

quartic-transformer - 0.0.10

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.9...0.0.10

quartic-transformer - 0.0.9

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.7...0.0.9

quartic-transformer - 0.0.8

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.7...0.0.8

quartic-transformer - 0.0.7

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.6...0.0.7

quartic-transformer - 0.0.6

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.5...0.0.6

quartic-transformer - 0.0.5

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.4...0.0.5

quartic-transformer - 0.0.4

Published by lucidrains 8 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.3...0.0.4

quartic-transformer - 0.0.3

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.1...0.0.3

quartic-transformer - 0.0.2

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/compare/0.0.1...0.0.2

quartic-transformer - 0.0.1

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/quartic-transformer/commits/0.0.1

Package Rankings
Top 37.54% on Pypi.org
Related Projects
taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

23 Dec 2023 88
q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338
mixture-of-attention

Some personal experiments around routing tokens to different autoregressive attention, akin to mi...

21 Apr 2023 101
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
coordinate-descent-attention

Implementation of an Attention layer where each head can attend to more than just one token, usin...

31 Mar 2023 46
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153
simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

06 Apr 2023 204
ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

14 Feb 2024 457
agent-attention-pytorch

Implementation of Agent Attention in Pytorch

18 Dec 2023 85
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

28 Nov 2021 540
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
complex-valued-transformer

Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer A...

06 Oct 2023 57