transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

Stars
2.9K
View Code on GitHub View on X
Ecosystems: PyTorch

Issue Statistics

Past Year

All Time

Total Pull Requests
2
9
Merged Pull Requests
0
7
Total Issues
8
20
Time to Close Issues
about 2 months
3 months
Related Projects
reformer-pytorch

Reformer, the efficient Transformer, in Pytorch

09 Jan 2020 2,105
deepvision

PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/impleme...

31 Jan 2023 33
CvT-TensorFlow

TensorFlow 2.X reimplementation of CvT: Introducing Convolutions to Vision Transformers, Haiping ...

16 Oct 2022 3
Transformers-from-Scratch

Transformer from Scratch using PyTorch

17 Aug 2024 0
bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

16 Dec 2018 6,255
sinkhorn-transformer

Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention

03 Apr 2020 253
attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

14 Jun 2017 8,777
Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

31 Aug 2020 9,151
linear-attention-transformer

Transformer based on a variant of attention that is linear complexity in respect to sequence length

04 Jun 2020 679
vit-explain

Explainability for Vision Transformers

29 Dec 2020 830
TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...

20 Sep 2022 1,482
External-Attention-pytorch

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which i...

08 May 2021 11,329