perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

MIT License

Downloads
1.7K
Stars
1K
Committers
4
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
0
70
Total Committers
0
4
Avg. Commits Per Committer
0.0
17.5
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
9
Merged Pull Requests
0
4
Total Issues
1
59
Time to Close Issues
N/A
4 days
Package Rankings
Top 4.91% on Pypi.org
Related Projects
perceiver-io

Unofficial implementation of Perceiver IO

28 Aug 2021 117
g-mlp-pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

18 May 2021 422
Perceiver

Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow

12 Apr 2021 86
memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attenti...

03 Mar 2022 355
bidirectional-cross-attention

A simple cross attention that updates both the source and target in one step

27 Mar 2022 143
perceiver-ar-pytorch

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver ...

18 Jun 2022 86
glom-pytorch

An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts fro...

02 Mar 2021 190
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
local-attention

An implementation of local windowed attention for language modeling

05 Jul 2020 373
equiformer-pytorch

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and...

29 Oct 2022 242
PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architectu...

09 Dec 2022 7,595
make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

29 Sep 2022 1,852
flash-attention

Fast and memory-efficient exact attention

19 May 2022 11,791
self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

31 Jan 2021 1,171
se3-transformer-pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repo...

09 Jan 2021 253