simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

MIT License

Downloads
1.1K
Stars
204
Committers
1
View Code on GitHub
Ecosystems: Python
simple-hierarchical-transformer - 0.2.0 Latest Release

Published by lucidrains 11 months ago

simple-hierarchical-transformer - 0.1.2

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.1.1

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.1.0

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.28

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.27

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.26

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.25

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.24

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.23

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.22

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.21

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.19

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.18

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.17

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.16

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.15

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.14

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.12

Published by lucidrains over 1 year ago

simple-hierarchical-transformer - 0.0.11

Published by lucidrains over 1 year ago

Package Rankings
Top 18.72% on Pypi.org
Related Projects
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

29 Nov 2023 642
mirasol-pytorch

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

18 Nov 2023 84
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370
x-transformers

A simple but complete full-attention transformer with a set of promising experimental features fr...

24 Oct 2020 4,226
En-transformer

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...

27 Feb 2021 208
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

03 Jan 2023 860
recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

24 Apr 2023 393
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 747
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375