Weight-Decay

mnist-tensorflow

mnist_tensorflow(batch_norm,xavier_init,gradient_decay,Adam)

DQN-tensorflow

Tensorflow implementation of Human-Level Control through Deep Reinforcement Learning

noisy-K-FAC

Natural Gradient, Variational Inference

WeightWatcher

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

tf-weightnorm

Examples for TensorFlow Weight Normalization

Follow-the-Ridge

Minimax Optimization, Stackelberg Games, Generative Adversarial Networks

morph-net

Fast & Simple Resource-Constrained Learning of Deep Network Structure

Differentiable-AIS

Implementation for DAIS

relaxed-equivariance-dynamics

Code for "Effect of equivariance on training dynamics"

Lightweighting_Cookbook

This project attempts to build neural network training and lightweighting cookbook including thre...

PocketFlow

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

pytorch-admm-pruning

Prune DNN using Alternating Direction Method of Multipliers (ADMM)

RepVGG

RepVGG: Making VGG-style ConvNets Great Again

NNG-Pytorch