mogrifier

Usable implementation of Mogrifier, a circuit for enhancing LSTMs and potentially other networks, from Deepmind

MIT License

Downloads
474
Stars
15
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
2
18
Total Committers
1
1
Avg. Commits Per Committer
2.0
18.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
0
0
Time to Close Issues
N/A
N/A
Package Rankings
Top 15.86% on Pypi.org
Badges
Extracted from project README
PyPI version
Related Projects
contrastive-learner

A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network

28 Apr 2020 119
st-moe-pytorch

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

26 Mar 2023 285
CALM-pytorch

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composi...

09 Jan 2024 167
soft-moe-pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

04 Aug 2023 239
n-grammer-pytorch

Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch

28 Nov 2021 72
g-mlp-gpt

GPT, but made only out of MLPs

20 May 2021 86
matmulfreellm

Implementation for MatMul-free LM.

23 Apr 2024 2,889
xlstm

Official repository of the xLSTM.

08 May 2024 1,267
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

08 Nov 2021 82
segformer-pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

06 Jun 2021 338
ponder-transformer

Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper

25 Aug 2021 78
memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

10 Oct 2020 106
kanformer

Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment

05 May 2024 32
mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the param...

13 Jul 2020 624