tutel

Tutel MoE: An Optimized Mixture-of-Experts Implementation

MIT License

Stars
716
Committers
15
View Code on GitHub View on X
Ecosystems: TypeScript, Playwright, VS Code Extension, Windows UI Library (WinUI), Windows, PyTorch

Commit Statistics

Past Year

All Time

Total Commits
20
178
Total Committers
4
17
Avg. Commits Per Committer
5.0
10.47
Bot Commits
0
1

Issue Statistics

Past Year

All Time

Total Pull Requests
18
141
Merged Pull Requests
17
135
Total Issues
14
59
Time to Close Issues
about 6 hours
5 days
Package Rankings
Top 6.75% on Proxy.golang.org
Related Projects
MInference

To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention,...

22 May 2024 725
subseasonal_toolkit

Subseasonal forecasting models

27 Jul 2021 42
BioGPT

15 Aug 2022 4,292
BiDR

Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable...

28 Feb 2022 15
mi-module-zoo

Common PyTorch Modules

08 Oct 2021 7
mttl

Building modular LMs with parameter-efficient fine-tuning.

11 Jul 2022 76
Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using S...

25 Mar 2021 13,692
PromptCraft-Robotics

Community for applying LLMs to robotics and a robot simulator with ChatGPT integration

08 Feb 2023 1,852
table-transformer

Table Transformer (TATR) is a deep learning model for extracting tables from unstructured documen...

17 May 2021 2,228
mscclpp

MSCCL++: A GPU-driven communication stack for scalable AI applications

02 Feb 2023 235
DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

23 Mar 2022 1,856
torchscale

Foundation Architecture for (M)LLMs

17 Nov 2022 3,006
VRL3

06 Nov 2022 32
evodiff

Generation of protein sequences and evolutionary alignments via discrete diffusion models

07 Jun 2022 487
aici

AICI: Prompts as (Wasm) Programs

26 Sep 2023 1,916