Phil Wang

Working with Attention. It's all we need

Ecosystems: Python, PyTorch, Crystal, Cuda

Projects

evolutionary-design-molecules

Implementation of the algorithm detailed in paper "Evolutionary design of molecules based on deep learning and a genetic algorithm"

Python - Released: 19 Sep 2023 - 21

deep-linear-network

A simple implementation of a deep linear Pytorch module

Python - Released: 16 Oct 2020 - 18

kronecker-attention-pytorch

Implementation of Kronecker Attention in Pytorch

Python - Released: 27 Aug 2020 - 17

holodeck-pytorch

Implementation of a holodeck, written in Pytorch

Python - Released: 13 Nov 2022 - 17

coordinate-descent-hierarchical-memory

Implementation of a hierarchical memory module using coordinate descent routing

Python - Released: 27 May 2023 - 17

enformer-tensorflow-sonnet-training-script

The full training script for Enformer - Tensorflow Sonnet

Python - Released: 05 Jan 2022 - 16

crystal-genetic-algorithm

A simple toy genetic algorithm in Crystal

Crystal - Released: 12 May 2024 - 4

all-normalization-transformer

A simple Transformer where the softmax has been replaced with normalization

Python - Released: 09 Sep 2020 - 17

esbn-transformer

An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols

Python - Released: 07 Jun 2021 - 14

scattering-compositional-learner

Implementation of Scattering Compositional Learner in Pytorch

Python - Released: 12 Jul 2020 - 5

attention-tensorflow-mesh

Tools for building attention networks for Tensorflow Mesh

Python - Released: 01 Aug 2020 - 4