Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
MIT License
GPT, but made only out of MLPs
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...
GLM (General Language Model)
Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
A GPT, made only of MLPs, in Jax
Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the se...
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch
Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch
Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch
Mamba state-space model
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the param...
[ECCV 2024 Oral] LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation.
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch