mup

maximal update parametrization (µP)

MIT License

Downloads
26.5K
Stars
1.2K
Committers
6
View Code on GitHub Visit Website View on X
Ecosystems: Python, PyTorch

Bot releases are hidden (Show)

mup - v1.0.0 Latest Release

Published by thegregyang over 2 years ago

Initial release.

Package Rankings
Top 6.75% on Proxy.golang.org
Top 31.07% on Conda-forge.org
Top 3.4% on Pypi.org
Related Projects
DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

23 Mar 2022 1,851
tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

06 Aug 2021 716
mi-module-zoo

Common PyTorch Modules

08 Oct 2021 7