complex-valued-transformer

Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"

MIT License

Downloads
353
Stars
57
Committers
1
View Code on GitHub
Ecosystems: Python
complex-valued-transformer - 0.0.14c Latest Release

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.12

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.11

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.10

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.9

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.8

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.7

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.6

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.4

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.3

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.2

Published by lucidrains about 1 year ago

complex-valued-transformer - 0.0.1

Published by lucidrains about 1 year ago

Package Rankings
Top 30.35% on Pypi.org
Related Projects
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
agent-attention-pytorch

Implementation of Agent Attention in Pytorch

18 Dec 2023 85
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

28 Mar 2022 345
compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

24 Jun 2020 155
q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338
quartic-transformer

Exploring an idea where one forgets about efficiency and carries out attention across each edge o...

03 Feb 2024 43
block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212
memory-transformer-xl

A variant of Transformer-XL where the memory is updated not with a queue, but with attention

10 Jul 2020 45
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

06 Apr 2023 204
recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

24 Apr 2023 393
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375