slot-attention

Implementation of Slot Attention from GoogleAI

MIT License

Downloads
453
Stars
380
Committers
3
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
2
28
Total Committers
1
3
Avg. Commits Per Committer
2.0
9.33
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
5
Merged Pull Requests
0
2
Total Issues
2
7
Time to Close Issues
about 2 hours
1 day
Package Rankings
Top 14.42% on Pypi.org
Related Projects
AoA-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Vi...

07 Nov 2020 40
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
lightweight-gan

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image gen...

11 Nov 2020 1,623
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

05 Mar 2021 1,049
deformable-attention

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deforma...

17 Mar 2022 273
flash-attention

Fast and memory-efficient exact attention

19 May 2022 11,791
bidirectional-cross-attention

A simple cross attention that updates both the source and target in one step

27 Mar 2022 143
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
isab-pytorch

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

26 Oct 2020 53
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 373
omninet-pytorch

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

02 Mar 2021 53
dilated-attention-pytorch

(Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000...

09 Jul 2023 47
halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Paramete...

24 Mar 2021 200