PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

MIT License

Downloads
872
Stars
822
Committers
3
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
0
44
Total Committers
0
4
Avg. Commits Per Committer
0.0
11.0
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
7
Merged Pull Requests
0
4
Total Issues
0
11
Time to Close Issues
N/A
10 days
Package Rankings
Top 11.42% on Pypi.org
Top 6.75% on Proxy.golang.org
Related Projects
toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

10 Feb 2023 1,948
parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

22 Jun 2022 522
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
mirasol-pytorch

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

18 Nov 2023 84
CoCa-pytorch

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

05 May 2022 977
MaMMUT-pytorch

Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks ...

05 May 2023 97
PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling wit...

08 Apr 2022 184
robotic-transformer-pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch

13 Dec 2022 375
triton-transformer

Implementation of a Transformer, but completely in Triton

08 Sep 2021 243
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
CoLT5-attention

Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch

20 Mar 2023 223
lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly bet...

15 Feb 2023 2,018
flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net o...

28 Apr 2022 1,203
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
voicebox-pytorch

Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch

01 Aug 2023 599