Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group
MIT License
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...
Implementation of Alphafold 3 in Pytorch
Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...
An implementation of Performer, a linear attention-based transformer, in Pytorch
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
Pytorch implementation of Compressive Transformers, from Deepmind
Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-E...
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch