unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

MIT License

Stars
19.6K
Committers
74
View Code on GitHub Visit Website View on X
Ecosystems: Windows, Windows UI Library (WinUI), Playwright, VS Code Extension, TypeScript

Bot releases are hidden (Show)

unilm - YOCO Latest Release

Published by donglixp 5 months ago

https://arxiv.org/abs/2405.05254

unilm - s2s-ft version 0.3

Published by donglixp over 4 years ago

fix an issue running on CPUs: https://github.com/microsoft/unilm/commit/13641268b59df5cf90d27b451d87ab58b6a07055

unilm - s2s-ft version 0.2

Published by donglixp over 4 years ago

  • Support MiniLM in s2s-ft
unilm - s2s-ft version 0.0

Published by donglixp over 4 years ago

seq2seq fine-tuning with unilmv1/unilmv2

Related Projects
torchscale

Foundation Architecture for (M)LLMs

17 Nov 2022 3,006
aici

AICI: Prompts as (Wasm) Programs

26 Sep 2023 1,916
LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

18 Jun 2021 10,416
SpeechT5

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

08 Feb 2022 1,164
LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

13 Dec 2022 3,604
LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabil...

20 May 2023 1,483
DialoGPT

Large-scale pretraining for dialogue

29 Aug 2019 2,352
X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and la...

28 Nov 2022 1,287
CodeBERT

CodeBERT

17 Jun 2020 2,192
MASS

MASS: Masked Sequence to Sequence Pre-training for Language Generation

27 May 2019 1,116
MMdnn

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g...

16 Aug 2017 5,788
MEGAVERSE

Official Codebase for MEGAVERSE: (published in ACL: NAACL 2024)

04 Jun 2024 6
BioGPT

15 Aug 2022 4,292
Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using S...

25 Mar 2021 13,692
MInference

To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention,...

22 May 2024 713