CoCa-pytorch

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

dalle-mini

DALL·E Mini - Generate images from a text prompt

caption-by-committee

Using LLMs and pre-trained caption models for super-human performance on image captioning.

phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities...

muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent ...

flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net o...

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

MaMMUT-pytorch

Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks ...

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling wit...

transformers

voicebox-pytorch

Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch