halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

MIT License

Downloads
67
Stars
200
Committers
1
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
13
Total Committers
1
Avg. Commits Per Committer
13.0
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
0
Merged Pull Requests
0
0
Total Issues
1
5
Time to Close Issues
N/A
less than a minute
Package Rankings
Top 17.01% on Pypi.org
Related Projects
AoA-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Vi...

07 Nov 2020 40
nystrom-attention

Implementation of Nyström Self-attention, from the paper Nyströmformer

11 Feb 2021 120
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
omninet-pytorch

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

02 Mar 2021 53
hamburger-pytorch

Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than...

11 Nov 2020 98
deformable-attention

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deforma...

17 Mar 2022 273
global-self-attention-network

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision ...

02 Oct 2020 93
isab-pytorch

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

26 Oct 2020 53
HTM-pytorch

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

14 Sep 2021 73
dilated-attention-pytorch

(Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000...

09 Jul 2023 47
kronecker-attention-pytorch

Implementation of Kronecker Attention in Pytorch

27 Aug 2020 17
point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

18 Dec 2020 587
bidirectional-cross-attention

A simple cross attention that updates both the source and target in one step

27 Mar 2022 143
bottleneck-transformer-pytorch

Implementation of Bottleneck Transformer in Pytorch

28 Jan 2021 669
ITTR-pytorch

Implementation of the Hybrid Perception Block and Dual-Pruned Self-Attention block from the ITTR ...

01 Apr 2022 33