Modern Art: A Deep Learning Approach · IABM Copyright 2018 @THEIABM References Gatys et al, 2015,...

IABM Copyright 2018 www.theiabm.org @THEIABM

Modern Art: A Deep Learning Approach

Computers can turn you into a good painter (among other things)


About myself

● PhD student @ LIS (univ-tln)

● AI R&D SWE @ Hexaglobe

Booth 14.A16, Hall 14, Content Everywhere

[email protected]

[email protected]

mailto:[email protected]

mailto:[email protected]


Feature visualization(Feeding your nightmares since 2015)


Invert convolutions


Mike Tyka


Deep Dream


Analyze

Whatever you see, augment it


Neural Artistic Style


Analyze

Analyze

Optimize under constraints


Analyze

Analyze

Optimized


Neural Doodle


Deep Painterly Harmonization


Deep Photo Style Transfer


Image Translation


Generative adversarial networks


pix2pix


CycleGAN


Last but not least


What’s next?

● Creation from textual description● Better temporal coherence in video generation● Better quality / remove artifacts● Better conditioning / More control● Music generation● What can you think of?


Thanks for listening!Any questions?


ReferencesGatys et al, 2015, A Neural Algorithm of Artistic Style, https://arxiv.org/abs/1508.06576

Fujun et al, 2018, Deep Painterly Harmonization, https://arxiv.org/abs/1804.03189Inceptionism: Going Deeper Into Neural Networks, https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html Fujun et al, 2017, Deep Photo Style Transfer, https://arxiv.org/abs/1703.07511Isola et al, 2016, Image-to-Image Translation with Conditional Adversarial Networks, https://arxiv.org/abs/1611.07004Zhu et al, 2017, Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks, https://arxiv.org/abs/1703.10593

https://arxiv.org/abs/1508.06576


https://ai.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html




Modern Art: A Deep Learning Approach · IABM Copyright 2018 @THEIABM References Gatys et al, 2015,...

Documents

Transcript of Modern Art: A Deep Learning Approach · IABM Copyright 2018 @THEIABM References Gatys et al, 2015,...