g2-lstm

GATE

build-nanogpt

Video+code lecture on building nanoGPT from scratch

g-mlp-gpt

GPT, but made only out of MLPs

xlstm

Official repository of the xLSTM.

sequence-to-sequence-from-scratch

Sequence to Sequence from Scratch Using Pytorch

g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

GLM-130B

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

rnn.wgan

Code for training and evaluation of the model from "Language Generation with Recurrent Generative...

TinyGPT-V

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

language-modeling

Pipeline for training Language Models using PyTorch.

gated-state-spaces-pytorch

Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated Stat...

minichatgpt

minichatgpt - To Train ChatGPT In 5 Minutes

PPLM

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.

lstm

Minimal, clean example of lstm neural network training in python, for learning purposes.