bidirectional-cross-attention

A simple cross attention that updates both the source and target in one step

MIT License

Downloads
258
Stars
143
Committers
1
View Code on GitHub
Ecosystems: Python

Bot releases are visible (Hide)

bidirectional-cross-attention - 0.0.5 Latest Release

Published by lucidrains 10 months ago

bidirectional-cross-attention - 0.0.4

Published by lucidrains over 2 years ago

bidirectional-cross-attention - 0.0.3

Published by lucidrains over 2 years ago

bidirectional-cross-attention - 0.0.2

Published by lucidrains over 2 years ago

bidirectional-cross-attention - 0.0.1

Published by lucidrains over 2 years ago

Package Rankings
Top 14.31% on Pypi.org
Related Projects
Perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

12 Apr 2021 86
flash-attention-jax

Implementation of Flash Attention in Jax

12 Jul 2022 189
TimeSformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classif...

11 Feb 2021 689
memory-compressed-attention

Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizin...

25 Jul 2020 71
omninet-pytorch

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

02 Mar 2021 53
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 373
kronecker-attention-pytorch

Implementation of Kronecker Attention in Pytorch

27 Aug 2020 17
perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver ...

18 Jun 2022 86
AoA-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Vi...

07 Nov 2020 40
perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

05 Mar 2021 1,049
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
deformable-attention

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deforma...

17 Mar 2022 273
spear-tts-pytorch

Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch

19 Jun 2023 252
Awesome-Vision-Attentions

Summary of related papers on visual attention. Related code will be released based on Jittor grad...

01 Sep 2021 2,692