Explorations into some recent techniques surrounding speculative decoding
MIT License
Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...
Implementation of MagViT2 Tokenizer in Pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-...
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...
Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
Implementation of Alphafold 3 in Pytorch