attn-attn

CS194 Project: Attention + Transfer Learning + Domain Adaption

Stars
9
View Code on GitHub Visit Website View on X
Ecosystems: Jupyter Notebook

File Structure

Conv block with attention

  • AttentionModule.ipynb
  • AttentionModule.py
  • AttentionModuleV2.ipynb

Data Visualization

  • Vis-V1.ipynb shows the grid of attention is perserved across independent runs.
  • ckpt contains the data for visualization

ResnetConvAttention

  • ResnetConvAttention.ipynb
  • ResnetConvAttentionV2.ipynb
  • ResnetConvAttentionV3.ipynb
  • ResnetConvAttentionV4.ipynb
  • ResnetConvAttentionV5.ipynb

Misc Raw Data

  • loss_history/fc_9_epoch.txt
  • res_fc_attn_train.py

Notes

Related Projects
SimSiam-TF

Minimal implementation of SimSiam (https://arxiv.org/abs/2011.10566) in TensorFlow 2.

29 Nov 2020 96
AdaptiveAttention

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Capti...

23 Feb 2017 333
HieCoAttenVQA

27 May 2016 347
visual_prompting

Official implementation and data release of the paper "Visual Prompting via Image Inpainting".

05 Sep 2022 274
faceswap-GAN

A denoising autoencoder + adversarial losses and attention mechanisms for face swapping.

23 Dec 2017 3,372
moving_mnist

Exploring Moving Mnist dataset with forecasting algorithms

10 Jul 2020 31