gateloop-transformer

Implementation of GateLoop Transformer in Pytorch and Jax

MIT License

Downloads

5.2K

Stars

86

Committers

View Code on GitHub

Ecosystems: Python

gateloop-transformer - 0.2.5 Latest Release

Published by lucidrains 4 months ago

Full Changelog: https://github.com/lucidrains/gateloop-transformer/compare/0.2.4...0.2.5

gateloop-transformer - 0.0.24a

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/gateloop-transformer/compare/0.2.4...0.0.24a

gateloop-transformer - 0.2.4

Published by lucidrains 9 months ago

Full Changelog: https://github.com/lucidrains/gateloop-transformer/compare/0.2.3...0.2.4

gateloop-transformer - 0.2.3

Published by lucidrains 10 months ago

gateloop-transformer - 0.2.2

Published by lucidrains 10 months ago

gateloop-transformer - 0.2.1

Published by lucidrains 10 months ago

gateloop-transformer - 0.2.0

Published by lucidrains 10 months ago

gateloop-transformer - 0.1.5

Published by lucidrains 11 months ago

gateloop-transformer - 0.1.4

Published by lucidrains 11 months ago

gateloop-transformer - 0.1.2

Published by lucidrains 11 months ago

gateloop-transformer - 0.1.1

Published by lucidrains 11 months ago

gateloop-transformer - 0.1.0

Published by lucidrains 11 months ago

gateloop-transformer - 0.0.26

Published by lucidrains 11 months ago

gateloop-transformer - 0.0.25

Published by lucidrains 11 months ago

gateloop-transformer - 0.0.24

Published by lucidrains 11 months ago

gateloop-transformer - 0.0.23

Published by lucidrains 11 months ago

gateloop-transformer - 0.0.22

Published by lucidrains 12 months ago

gateloop-transformer - 0.0.21

Published by lucidrains 12 months ago

gateloop-transformer - 0.0.20

Published by lucidrains 12 months ago

gateloop-transformer - 0.0.19

Published by lucidrains 12 months ago

Package Rankings

Top 29.95% on Pypi.org

Related Projects

taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

29 Nov 2023 642

transformers-from-scratch

Modular Python implementation of encoder-only, decoder-only and encoder-decoder transformer archi...

hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Fun...

20 Sep 2023 338

feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104

iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429

coordinate-descent-attention

Implementation of an Attention layer where each head can attend to more than just one token, usin...

h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084

local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375

memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623

FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

28 Mar 2022 345

block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212