Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
MIT License
Published by lucidrains over 1 year ago
Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch
Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...
Pytorch implementation of Compressive Transformers, from Deepmind
A concise but complete implementation of CLIP with various experimental improvements from recent ...
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...
A simple but complete full-attention transformer with a set of promising experimental features fr...
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
DALL·E Mini - Generate images from a text prompt
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...