gpt2-ml
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
APACHE-2.0 License
Stars
1.7K
Ecosystems:
Tensorflow
Bot releases are hidden (Show)
- new 1.5B GPT2 pretrained Chinese model ( ~30G corpus, 22w steps )
- dependencies upgrade
- change vocab to CLUEVocab ( with some modifies )
- some bugfixes
gpt2-ml
- GPT2-ML First Pubilc Release
Published by imcaspar almost 5 years ago
With this release comes the 1.5B pretrained model ( ~15G corpus, 10w steps )
Badges
Extracted from project README
