adam-atan2-pytorch

Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch

MIT License

Stars
91
Committers
1
View Code on GitHub
Ecosystems: Python
adam-atan2-pytorch - 0.0.12 Latest Release

Published by lucidrains about 2 months ago

Full Changelog: https://github.com/lucidrains/adam-atan2-pytorch/compare/0.0.10...0.0.12

adam-atan2-pytorch - 0.0.10

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/adam-atan2-pytorch/compare/0.0.9...0.0.10

adam-atan2-pytorch - 0.0.9

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.8

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.7

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.6

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.5

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.4

Published by lucidrains 3 months ago

adam-atan2-pytorch - 0.0.3

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/adam-atan2-pytorch/compare/0.0.2...0.0.3

adam-atan2-pytorch - 0.0.2

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/adam-atan2-pytorch/compare/0.0.1...0.0.2

adam-atan2-pytorch - 0.0.1

Published by lucidrains 3 months ago

Full Changelog: https://github.com/lucidrains/adam-atan2-pytorch/commits/0.0.1

Related Projects
PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling wit...

08 Apr 2022 184
SAC-pytorch

Implementation of Soft Actor Critic and some of its improvements in Pytorch

12 Feb 2024 34
ali-pytorch

Adversarially Learned Inference in Pytorch

24 Mar 2017 30
iTransformer

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks...

11 Oct 2023 429
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
adanet

Fast and flexible AutoML with learning guarantees.

28 Jun 2018 3,468
lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly bet...

15 Feb 2023 2,018
Adan-pytorch

Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch

25 Aug 2022 247
MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Py...

15 May 2023 620
grokfast-pytorch

Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow ...

15 Jun 2024 83
adamw_bfloat16

AdamW optimizer for bfloat16 models in pytorch 🔥.

14 Dec 2021 19
dalle-mini

DALL·E Mini - Generate images from a text prompt

03 Jul 2021 14,752
taylor-series-linear-attention

Explorations into the recently proposed Taylor Series Linear Attention

23 Dec 2023 88
phasic-policy-gradient

An implementation of Phasic Policy Gradient, a proposed improvement of Proximal Policy Gradients,...

27 Sep 2020 42
PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling wit...

04 Apr 2022 822