favor

Simple implementation of FAVOR attention layer

BSD-3-CLAUSE License

Stars
6
View Code on GitHub
Ecosystems: Python

Statistics for this project are still being loaded, please check back later.

Related Projects
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
nystrom-attention

Implementation of Nyström Self-attention, from the paper Nyströmformer

11 Feb 2021 120
flash-attention-jax

Implementation of Flash Attention in Jax

12 Jul 2022 189
attention-cnn

Source code for "On the Relationship between Self-Attention and Convolutional Layers"

25 Jun 2019 1,077
point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

18 Dec 2020 587
msa-transformer

MSA Transformer reproduction code

20 Feb 2021 48
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
flash-attention

Fast and memory-efficient exact attention

19 May 2022 11,791
memory-compressed-attention

Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizin...

25 Jul 2020 71
AoA-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Vi...

07 Nov 2020 40
slot-attention

Implementation of Slot Attention from GoogleAI

29 Jun 2020 380
bidirectional-cross-attention

A simple cross attention that updates both the source and target in one step

27 Mar 2022 143
halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Paramete...

24 Mar 2021 200
attention-is-all-you-need

Pytorch implementation of the reknowned "Attention Is All You Need" paper - NeurIPS 2017

21 Jan 2024 3