attention-cnn

Source code for "On the Relationship between Self-Attention and Convolutional Layers"

APACHE-2.0 License

Stars
1.1K
View Code on GitHub Visit Website
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
0
2
Merged Pull Requests
0
2
Total Issues
0
10
Time to Close Issues
N/A
4 months
Related Projects
UGATIT

Official Tensorflow implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with...

26 Jul 2019 6,169
Awesome-Vision-Attentions

Summary of related papers on visual attention. Related code will be released based on Jittor grad...

01 Sep 2021 2,692
halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Paramete...

24 Mar 2021 200
AoA-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Vi...

07 Nov 2020 40
self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

31 Jan 2021 1,171
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
attention-is-all-you-need

Pytorch implementation of the reknowned "Attention Is All You Need" paper - NeurIPS 2017

21 Jan 2024 3
Attention-OCR

Visual Attention based OCR

09 Jun 2016 1,111
global-self-attention-network

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision ...

02 Oct 2020 93
Perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

12 Apr 2021 86
tf-attentive-conv

A Tensorflow implementation of Yin Wenpeng's recent paper on TACL "Attentive Convolution"

09 Aug 2018 33
deep_architecture_genealogy

Deep Learning Architecture Genealogy Project

04 Nov 2017 1,220
byol-pytorch

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in ...

16 Jun 2020 1,687
flash-attention

Fast and memory-efficient exact attention

19 May 2022 11,791
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852