jax_dt

long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attenti...

performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

minGPT-flax

GPT implementation in Flax

compressive-transformer-pytorch

Pytorch implementation of Compressive Transformers, from Deepmind

h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

triton-transformer

Implementation of a Transformer, but completely in Triton

minimal-opt

dino

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

robotic-transformer-pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch

fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

tab-transformer-pytorch

Implementation of TabTransformer, attention network for tabular data, in Pytorch

decision-transformer

Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.

generalized_dt

Generalized Decision Transformer for Offline Hindsight Information Matching (ICLR2022)