Implementation of a Light Recurrent Unit in Pytorch
MIT License
Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
Implementation of ResMLP, an all MLP solution to image classification, in Pytorch
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts fro...
Implementation of a framework for Gamengen in Pytorch
Implementation of Bottleneck Transformer in Pytorch
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less...
Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen...
Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images an...
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in ...
A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Tran...
Implementation of Block Recurrent Transformer - Pytorch
Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch
Implementation of Hierarchical Transformer Memory (HTM) for Pytorch