speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

MIT License

Downloads
570
Stars
199
Committers
1
View Code on GitHub
Ecosystems: Python
speculative-decoding - 0.1.0 Latest Release

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.15

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.14

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.12

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.10

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.9

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.8

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.7

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.5

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.4

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.3

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.2

Published by lucidrains about 1 year ago

speculative-decoding - 0.0.1

Published by lucidrains about 1 year ago

Package Rankings
Top 22.8% on Pypi.org
Related Projects
transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-...

23 Aug 2024 646
progen

Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax

09 Jun 2021 109
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

05 Jan 2021 5,563
meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

29 Nov 2023 642
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

10 Oct 2023 552
imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

23 May 2022 8,031
phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 min...

29 Sep 2022 747
alphafold3-pytorch

Implementation of Alphafold 3 in Pytorch

08 May 2024 881
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Re...

09 Sep 2022 2,399
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
spear-tts-pytorch

Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch

19 Jun 2023 254
muse-maskgit-pytorch

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

03 Jan 2023 860