agent-attention-pytorch

Implementation of Agent Attention in Pytorch

MIT License

Downloads
4.1K
Stars
85
Committers
1
View Code on GitHub
Ecosystems: Python
agent-attention-pytorch - 0.1.7 Latest Release

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.6

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.5

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.4

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.2

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.1

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.1.0

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.6

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.5

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.4

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.3

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.2

Published by lucidrains 10 months ago

agent-attention-pytorch - 0.0.1

Published by lucidrains 10 months ago

Package Rankings
Top 38.51% on Pypi.org
Related Projects
quartic-transformer

Exploring an idea where one forgets about efficiency and carries out attention across each edge o...

03 Feb 2024 43
taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

23 Dec 2023 88
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
complex-valued-transformer

Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer A...

06 Oct 2023 57
mixture-of-attention

Some personal experiments around routing tokens to different autoregressive attention, akin to mi...

21 Apr 2023 101
self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

31 Jan 2021 1,171
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

06 Apr 2023 204
magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

10 Oct 2023 552
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338