token-shift-gpt

Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing

MIT License

Downloads
32
Stars
47
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
13
Total Committers
1
Avg. Commits Per Committer
13.0
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
0
1
Time to Close Issues
N/A
4 months
Package Rankings
Top 21.09% on Pypi.org
Related Projects
progen

Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax

09 Jun 2021 109
g-mlp-gpt

GPT, but made only out of MLPs

20 May 2021 86
soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370
rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

29 Jun 2021 535
FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

28 Mar 2022 345
muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

03 Jan 2023 855
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 746
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
gigagan-pytorch

Implementation of GigaGAN, new SOTA GAN out of Adobe. Culmination of nearly a decade of research ...

10 Mar 2023 1,813
mlp-gpt-jax

A GPT, made only of MLPs, in Jax

21 May 2021 55
DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

05 Jan 2021 5,563
graph-transformer-pytorch

Implementation of Graph Transformer in Pytorch, for potential use in replicating Alphafold2

18 Jun 2021 197
GLM

GLM (General Language Model)

18 Mar 2021 3,170
hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

08 Nov 2021 74