Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch
MIT License
Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
Implementation of Bottleneck Transformer in Pytorch
Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classif...
Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Re...
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
Implementation of a U-net complete with efficient attention as well as the latest research findings
Implementation of Uformer, Attention-based Unet, in Pytorch
Implementation of Block Recurrent Transformer - Pytorch
Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repo...
Implementation of Fast Transformer in Pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with ...
Pytorch implementation of Compressive Transformers, from Deepmind