mlm-pytorch

An implementation of masked language modeling for Pytorch, made as concise and simple as possible

MIT License

Downloads
75
Stars
175
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
12
Total Committers
1
Avg. Commits Per Committer
12.0
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
2
Merged Pull Requests
0
2
Total Issues
1
6
Time to Close Issues
N/A
9 days
Package Rankings
Top 12.6% on Pypi.org
Related Projects
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
matmulfreellm

Implementation for MatMul-free LM.

23 Apr 2024 2,889
sentiment-discovery

Unsupervised Language Modeling at scale for robust sentiment classification

30 Nov 2017 1,061
transformers-from-scratch

Modular Python implementation of encoder-only, decoder-only and encoder-decoder transformer archi...

16 Jul 2024 0
hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

08 Nov 2021 74
long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attenti...

07 Jul 2021 116
transformer-smaller-training-vocab

Temporary remove unused tokens during training to save ram and speed.

01 Jan 2023 20
feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104
PPLM

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.

05 Nov 2019 1,130
fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171
point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

18 Dec 2020 587
electra-pytorch

A simple and working implementation of Electra, the fastest way to pretrain language models from ...

04 Aug 2020 222
transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

29 Oct 2018 132,459
marge-pytorch

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

24 Aug 2020 75
h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

28 Jul 2021 153