Learning Artistic Style From Language Features

Doing style transfer with grounding OpenAI's CLIP.

Typical Style Transfer

Under normal circumstances, one would use a method like that of Gatys et al. to transfer the style of one image to the content of another. This only encompasses one photo and has no true concept of space.

CLIP-based Style Transfer

Using a similar technique to that of Gatys et al. we trade Gram Matrices for CLIP activations. Given your image and a phrase, CLIP can transfer (somewhat successfully) the artist or painting's style that you specify!

Special Features of this Method

1. There is an understanding of spatial relationships.
2. Ghost faces and self-portraits.
3. Abstract/general style and motif comprehension.