megablocks

MegaBlocks

APACHE-2.0 License

Downloads
15.5K
Stars
1.1K
View Code on GitHub
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
2
2
Time to Close Issues
N/A
N/A
Package Rankings
Top 16.35% on Pypi.org
Related Projects
NeMo

A scalable generative AI framework built for researchers and developers working on Large Language...

05 Aug 2019 11,448
GLM

GLM (General Language Model)

18 Mar 2021 3,170
meta-blocks

A modular toolbox for meta-learning research with a focus on speed and reproducibility.

24 Feb 2020 123
Deep-Learning-in-Production

In this repository, I will share some useful notes and references about deploying deep learning-b...

03 May 2018 4,294
blocks

A Theano framework for building and training neural networks

06 Oct 2014 1,159
Neuromorphic-Computing-Guide

Learn about the Neumorphic engineering process of creating large-scale integration (VLSI) systems...

03 Oct 2021 191
MegEngine

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

18 Mar 2020 4,721
Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

02 Jul 2021 1,323
sentiment-discovery

Unsupervised Language Modeling at scale for robust sentiment classification

30 Nov 2017 1,061
Megatron-LM

Ongoing research training transformer models at scale

21 Mar 2019 8,839
mmengine

OpenMMLab Foundational Library for Training Deep Learning Models

08 Feb 2022 1,093
TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482
accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed conf...

30 Oct 2020 7,759
fastmoe

A fast MoE impl for PyTorch

25 Jan 2021 1,534
nanotron

Minimalistic large language model 3D-parallelism training

11 Sep 2023 1,080