light-recurrent-unit-pytorch

Implementation of a Light Recurrent Unit in Pytorch

MIT License

Downloads
1.2K
Stars
45
Committers
1
View Code on GitHub
Ecosystems: Python
light-recurrent-unit-pytorch - 0.0.1 Latest Release

Published by lucidrains about 2 months ago

Full Changelog: https://github.com/lucidrains/light-recurrent-unit-pytorch/commits/0.0.1

Package Rankings
Top 34.53% on Pypi.org
Related Projects
glom-pytorch

An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts fro...

02 Mar 2021 190
mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch

04 May 2024 244
lambda-networks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less...

08 Oct 2020 1,533
RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

15 Jan 2022 849
res-mlp-pytorch

Implementation of ResMLP, an all MLP solution to image classification, in Pytorch

10 May 2021 192
gamengen-pytorch

Implementation of a framework for Gamengen in Pytorch

28 Aug 2024 89
byol-pytorch

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in ...

16 Jun 2020 1,687
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
recurrent-interface-network-pytorch

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images an...

23 Dec 2022 193
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
yet-another-retnet

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Tran...

01 Aug 2023 80
block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

07 Feb 2023 212
bottleneck-transformer-pytorch

Implementation of Bottleneck Transformer in Pytorch

28 Jan 2021 670
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 72
PEER-pytorch

Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen...

09 Jul 2024 109