VN-transformer

A Transformer made of Rotation-equivariant Attention using Vector Neurons

MIT License

Downloads
171
Stars
81
Committers
1
View Code on GitHub
Ecosystems: Python
VN-transformer - 0.0.12 Latest Release

Published by lucidrains about 1 year ago

VN-transformer - 0.0.11

Published by lucidrains about 1 year ago

VN-transformer - 0.0.10

Published by lucidrains about 1 year ago

VN-transformer - 0.0.9

Published by lucidrains about 1 year ago

VN-transformer - 0.0.8

Published by lucidrains about 1 year ago

VN-transformer - 0.0.7

Published by lucidrains about 1 year ago

VN-transformer - 0.0.6

Published by lucidrains about 1 year ago

VN-transformer - 0.0.5

Published by lucidrains about 1 year ago

VN-transformer - 0.0.4

Published by lucidrains about 1 year ago

VN-transformer - 0.0.3

Published by lucidrains about 1 year ago

VN-transformer - 0.0.2a

Published by lucidrains about 1 year ago

VN-transformer - 0.0.2

Published by lucidrains about 1 year ago

Package Rankings
Top 38.55% on Pypi.org
Related Projects
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repo...

09 Jan 2021 254
lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

22 Dec 2020 87
agent-attention-pytorch

Implementation of Agent Attention in Pytorch

18 Dec 2023 85
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

23 Dec 2023 88
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338
self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

31 Jan 2021 1,171
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208