MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

MIT License

Downloads
1.4K
Stars
620
Committers
2
View Code on GitHub
Ecosystems: Python
MEGABYTE-pytorch - 0.3.5 Latest Release

Published by lucidrains about 1 month ago

Full Changelog: https://github.com/lucidrains/MEGABYTE-pytorch/compare/0.3.4...0.3.5

MEGABYTE-pytorch - 0.3.4

Published by lucidrains about 1 month ago

MEGABYTE-pytorch - 0.3.3

Published by lucidrains about 1 month ago

What's Changed

New Contributors

Full Changelog: https://github.com/lucidrains/MEGABYTE-pytorch/compare/0.3.2...0.3.3

MEGABYTE-pytorch - 0.3.2

Published by lucidrains about 2 months ago

Full Changelog: https://github.com/lucidrains/MEGABYTE-pytorch/compare/0.3.1...0.3.2

MEGABYTE-pytorch - 0.3.1

Published by lucidrains about 2 months ago

Full Changelog: https://github.com/lucidrains/MEGABYTE-pytorch/compare/0.3.0...0.3.1

MEGABYTE-pytorch - 0.3.0

Published by lucidrains 6 months ago

Full Changelog: https://github.com/lucidrains/MEGABYTE-pytorch/compare/0.2.1...0.3.0

MEGABYTE-pytorch - 0.2.1

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.2.0

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.7

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.6

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.4

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.2

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.1b

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.1a

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.1

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.1.0

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.0.10

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.0.9

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.0.8

Published by lucidrains over 1 year ago

MEGABYTE-pytorch - 0.0.7

Published by lucidrains over 1 year ago

Package Rankings
Top 22.18% on Pypi.org
Related Projects
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

24 Jun 2020 155
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 747
FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

28 Mar 2022 345
soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

17 May 2023 1,370
meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

29 Nov 2023 642
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 375
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

06 Apr 2023 204
recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

24 Apr 2023 393
RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

15 Jan 2022 849
magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

10 Oct 2023 552
memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and ...

21 Mar 2022 623