video-transformers

Implementations of Transformers for Video

APACHE-2.0 License

Stars
22
View Code on GitHub View on X
Ecosystems: Python

video-transformers

PyTorch implementations of video transformers.

Models

TODO:

  • timesformer base code
  • timesformer with ViT intialisation
  • timesformer base 16_224
  • timesformer other base/large models
  • "frozen in time" attention modification
  • other video transformers
Related Projects
transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

29 Oct 2018 132,459
robotic-transformer-pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch

13 Dec 2022 373
feedback-transformer-pytorch

Implementation of Feedback Transformer in Pytorch

02 Feb 2021 104
multistream-transformers

Implementation of Multistream Transformers in Pytorch

29 Jul 2021 54
TimeSformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classif...

11 Feb 2021 689
hourglass-transformer-pytorch

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

08 Nov 2021 74
transformer

A TensorFlow Implementation of the Transformer: Attention Is All You Need

17 Jun 2017 4,253
transformers-from-scratch

Modular Python implementation of encoder-only, decoder-only and encoder-decoder transformer archi...

16 Jul 2024 0
fast-transformers

Pytorch library for fast transformer implementations

15 Jun 2020 1,624
vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with ...

03 Oct 2020 19,872
transformer

Build English-Vietnamese machine translation with ProtonX Transformer. :D

22 Jun 2021 60
performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

03 Oct 2020 1,084
fast-transformer-pytorch

Implementation of Fast Transformer in Pytorch

23 Aug 2021 171
xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

13 Oct 2021 7,730
frozen-in-time

Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]

03 Apr 2021 339