Deep Learning and Artistic Style Transfer for Videos

Sam Putnam

6/6/2017

Want to learn more? I am teaching the Deploying Data Science Masterclass at Data Science Conf®

Tickets are available now: www.DataScienceConf.com

Deep Learning

Sam PutnamDeep Learning and Artistic Style Transfer for Videos

6/6/2017

Artistic Style Transfer

6/6/2017

https://arxiv.org/abs/1604.08610

Butterfly Demo

6/6/2017

https://twitter.com/samdeeplearning/status/854332749695602720

Part 1 of 3

Deep Learning

6/6/2017

Deep Learning

6/6/2017

Deep Learning

6/6/2017

Deep Learning

6/6/2017

Part 2 of 3

6/6/2017

Sam Putnam

Content and Style Loss Minimization

6/6/2017

Sam Putnam

Total Loss

6/6/2017

Part 3 of 3

Butterfly Demo (Will Go Through This Fast)

Butterfly Demo

6/6/2017

A - Picked NN (Try CUDNN for Speed)

Butterfly Demo

6/6/2017

B - Picked GPU

Butterfly Demo

6/6/2017

C - Use Original Resolution

Butterfly Demo

6/6/2017

D - Successfully Loaded VGG Model

Butterfly Demo

6/6/2017

E - Finishes 2 Hours Later; scp the stylized video onto your computer

Butterfly Demo

6/6/2017

1 - Select Amazon Deep Learning AMI that has Torch and CUDA pre-installed

Butterfly Demo

6/6/2017

Butterfly Demo

2 - Select P2.xlarge GPU instance for Tesla K80

6/6/2017

Butterfly Demo

3 - Allow Incoming Connections on Port 22

6/6/2017

4 - Create a Key Pair - I always use the same one that I named TheanoKeyPair

Butterfly Demo

6/6/2017

Butterfly Demo

5 - Launch Instance

6/6/2017

Butterfly Demo

6 - Wait Until It’s Running

6/6/2017

7 - ssh -i TheanoKeyPair.pem ubuntu@ec2-34-207-200-9.compute-1.amazonaws.

Butterfly Demo

6/6/2017

8 - Try Several Times Until It Connects

Butterfly Demo

6/6/2017

9 - You’re In

Butterfly Demo

6/6/2017

10 - cd torch; sudo apt-get install libprotobuf-dev protobuf-compiler

Butterfly Demo

6/6/2017

11 - luarocks install loadcaffe

Butterfly Demo

6/6/2017

12 - Re-install Torch Because It’s Fast

Butterfly Demo

6/6/2017

13 - wget -c https://gist.githubusercontent.com/ksimonyan/3785162f95cd2d5fee77/raw/

bb2b4fe0a9bb0669211cf3d0bc949dfdda173e9e/VGG_ILSVRC_19_layers_deploy.prototxt

Butterfly Demo

6/6/2017

14 - wget -c --no-check-certificate https://bethgelab.org/media/uploads/deeptextures/

vgg_normalised.caffemodel

Butterfly Demo

6/6/2017

15 - wget -c http://www.robots.ox.ac.uk/~vgg/software/very_deep/caffe/

VGG_ILSVRC_19_layers.caffemodel

Butterfly Demo

6/6/2017

16- wget -c http://pascal.inrialpes.fr/data2/deepmatching/files/DeepFlow_release2.0.tar.gz;

unzipand move ‘static’ file to src directory

Butterfly Demo

6/6/2017

17 - wget -c http://lear.inrialpes.fr/src/deepmatching/code/deepmatching_1.0.2.zip; unzip

and move ‘static’ file to src directory

Butterfly Demo

6/6/2017

18 - Upload Video & Image of Matching Resolution to Github; git clone repo on your instance

Butterfly Demo

6/6/2017

19 - git clone https://github.com/manuelruder/artistic-videos

Butterfly Demo

6/6/2017

20 - SSH in using Your KeyPair.pem and Ubuntu as the User

Butterfly Demo

6/6/2017

21 - ./stylizeVideo.sh Butterfly.mov vanGogh596x336.png

Butterfly Demo

6/6/2017

Thank you

Deep Learning and Artistic Style Transfer for Videos Sam Putnam

Sam@EDeepLearning.com

Thank you to Manuel Ruder et al. Slides are for today only.

Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics

6/6/2017

https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77

Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

Transcript of Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

Software

Transcript of Deep Learning and Artistic Style Transfer for Videos - Enterprise Deep Learning

Saliency-Based Artistic Abstraction With Deep Learning and ......Shakeri, Nixon, and DiPaola: Saliency-based artistic abstraction with deep learning and regression trees with Haeberli’s

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artiﬁcial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

Unsupervised Learning of Artistic Styles with Archetypal ...

UNSUPERVISED DEEP LEARNING - TAUweb.eng.tau.ac.il/.../uploads/2016/12/Unsupervised-Deep-Learning.pdf · UNSUPERVISED DEEP LEARNING Erez Aharonov Noam Eilon Deep Learning Seminar School

fast.ai - Learning Deep Learning

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

OmniArt: Multi-task Deep Learning for Artistic Data AnalysisUniversity of Amsterdam Amsterdam, The Netherlands g.strezoski@uva.nl Marcel Worring ... In such museum-centric collections

Learning Adobe Photoshop CS4 - Artistic Filters

Deep Learning for Depth Learning CS 229 Course Project ...cs229.stanford.edu/...DepthLearning_FinalReport.pdf · Deep Learning for Depth Learning CS 229 Course Project, ... Deep Learning

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Introducing Deep Learning with MATLAB - MathWorks · Introducing Deep Learning with MATLAB7 How A Deep Neural Network ... relevant features of an image. With deep learning, ... Deep

Deep Learning in real world @Deep Learning Tokyo

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

Deep materials informatics: Applications of deep learning in … · deep learning: † Deep learning requires big data: In many cases, the biggest limiting factor for applying deep

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Introducing Deep Learning with MATLAB - Systematics · Introducing Deep Learning with MATLAB6 Inside a Deep Neural Network ... Deep learning is a subtype of machine learning. With

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning.

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Deep Learning with H2O - University of Idahostevel/504/Deep Learning with...Deep Learning with H2O. . 4Deep Learning Overview Unlike the neural networks of the past, modern Deep Learning