RAdam+Lookahead
from ranger import Ranger opt = Ranger(learning_rate=learning_rate)
A TensorFlow implementation of the Lion optimizer
The PyTorch Implementation based on YOLOv4 of the paper: "Complex-YOLO: Real-time 3D Object Detec...
Reinforcement Learning Library.
PyTorch Implementation of Soft Actor-Critic Algorithm
Train fastai models faster (and other useful tools)
Here we will test various linear attention designs.
GPT implementation in Flax
minichatgpt - To Train ChatGPT In 5 Minutes
Time series forecasting with PyTorch
ESGD-M is a stochastic non-convex second order optimizer, suitable for training deep learning mod...
A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementat...
Software Architecture for ML engineers
Tensorflow implementation of Human-Level Control through Deep Reinforcement Learning
tensorflow learning according to CS20SI
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection