Leveraging Deep Learning Applications with CNTK

Dr. Miguel González-Fierro

@miguelgfierrohttps://miguelgfierro.com

LEVERAGING DEEP LEARNING APPLICATIONS WITH CNTK

1. CNTK FRAMEWORK

2. TRANSFER LEARNING WITH DEEP NETWORKS

3. IMAGE RECOGNITION API

1. CNTK FRAMEWORK

MICROSOFT’S COGNITIVE TOOLKIT: CNTK

Dr. Miguel González-Fierro - @miguelgfierro

MPIBrainScript

https://github.com/Microsoft/CNTK

CNTK STRENGHTS: RNN & MULTISERVER GPU

Source:

https://arxiv.org/abs/1608.07249

Multi-server algorithms:

1-bit SGD

Block momentum

Recurrent Neural Networks

CNTK TUTORIALS & EXAMPLES

https://github.com/Microsoft/CNTK/tree/master/Tutorialshttps://github.com/Microsoft/CNTK/tree/master/Examples

GPU VIRTUAL MACHINE

$5.3/h$2.65/h$1.32/h

as of May 2017

DATA SCIENCE VIRTUAL MACHINE (DSVM)

2. TRANSFER LEARNING WITH DEEP NETWORKS

KAGGLE DATA SCIENCE BOWL 2017

$1 million in prizes !

CT scan: horizontal section of lung

Determine

whether a

patient has

cancer or notcompetition

OBJECTIVE: BASELINE SOLUTION

END TO END PROCESS

DSVM & CNTK

less than 1h

Top 10% (Jan 19th)

LUNG SCANS DATASET

1595 patients with a diagnostic

200-500 scans per patient

Images of 512x512

AUTOMATIC FEATURE GENERATOR

Source:

http://vision03.csail.mit.edu/cnn_art/

https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

TRANSFER LEARNING

ImageNet dataset Lung cancer dataset

weight transference

STANDARD TRAINING

input hidden hidden hidden hidden hidden output

Forward and backward propagation

TRANSFERENCE 1: FREEZE N-1 LAYERS

Frozen layers

TRANSFERENCE 2: FREEZE INITIAL LAYERS

Frozen layers

TRANSFERENCE 3: MODEL INITIALIZATION

Weight initialization

PRETRAINED RESNET MODEL

ImageNet ResNet N layers

penultimate

SOLUTION: CNN FEATURIZER

ResNet N-1 layers

penultimate

(53min)k batch

of images= 1 patient

features

SOLUTION: BOOSTED TREE TRAINING

ResNet N-1 layers

penultimate

cancer

(53min)

LightGBM

(2min)

Boosted tree

k batch

of images= 1 patient

features

KAGGLE SUBMISSION

top 10% as of Jan 19th

RESOURCES

Kaggle script Cortana Gallery notebook

Blog in TechNet

https://aka.ms/dsb2017-cntk-notebookhttps://aka.ms/dsb2017-cntk-script https://aka.ms/dsb2017-cntk-blog

+6000 views +1500 views+300 shares on SN

+1500 views+300 downloads

TechNet

3. IMAGE RECOGNITION API

SUCCESS IN IMAGE CLASSIFICATION

3.6%3.1%

5.1% (human)

error (%)

ImageNet (image recognition competition) top-5 error

AlexNet(2012)

VGG(2014)

Inception(2015)

ResNet(2015)

Inception-ResNet(2016)

ARCHITECTURE

Ilia Karmanov: https://github.com/ilkarman/CV_end_to_end

ARCHITECTURE

Dr. Miguel González-Fierro

@miguelgfierrohttps://miguelgfierro.com

QUESTIONS?

Leveraging Deep Learning Applications with CNTK

Technology

Transcript of Leveraging Deep Learning Applications with CNTK

SFO17-509 Deep Learning on ARM Platforms - from the ...connect.linaro.org.s3.amazonaws.com/sfo17/Presentations...Keras: a Python DL library supporting TensorFlow, CNTK, Theano and

Leveraging Posit Arithmetic in Deep Neural Networks

FireCast: Leveraging Deep Learning to Predict Wildfire Spread · FireCast: Leveraging Deep Learning to Predict Wildﬁre Spread David Radke1y, Anna Hessler2 and Dan Ellsworth2 1David

Leveraging Machine Learning for Advancing Smart-X Systems ... · 1.Deep Reinforcement Learning: Use deep neural networks to approximate Q (DQN) 2.Experience replay to reuse past data

Benchmarking and Analyzing Deep Neural Network Trainingpekhimenko/Papers/iiswc18-tbd.pdf · frameworks (TensorFlow [8], MXNet [22], CNTK [89]) across different hardware conﬁgurations

Leveraging Deep Learning Techniques for Malaria Parasite ...

Optimizing Data Aggregation by Leveraging the Deep Memory ...

Benchmarking and Analyzing Deep Neural Network Trainingserailhydra/publications/tbd-iiswc18.pdf · frameworks (TensorFlow [8], MXNet [22], CNTK [89]) across different hardware conﬁgurations

Deep Learning in Microsoft with CNTK - GTC On …on-demand.gputechconf.com/gtc/2016/...deep-learning-microsoft-cntk.pdfDeep Learning in Microsoft with CNTK ... •Ads •Relevance

Microsoft Cognitive Toolkit (CNTK) · CNTK expresses (nearly) arbitrary neural networks by composing simple building blocks into complex computational networks, supporting relevant

Precipitation Nowcasting: Leveraging Deep Convolutional ... · Build a Precipitation Nowcasting deep learning model Gain insights into the full deep learning workflow Improve the

Microsoft Computational Network Toolkit (CNTK) · PDF fileMicrosoft Computational Network Toolkit (CNTK) A Tutorial Given at NIPS 2015 Workshops Dong Yu and Xuedong Huang {dongyu |

Accelerating Deep Learning with MVAPICHmvapich.cse.ohio-state.edu/static/media/talks/slide/awan...Performance Benefits: Microsoft CNTK DL framework (25% avg. improvement ) Performance

Workshop: Redes neurais com keras, cntk e tensorflow no Azure … · 2019-05-16 · 1 Workshop: Redes neurais com keras, cntk e tensorflow no Azure machine learning

A Survey on Leveraging Deep Neural Networks for Object ......Deep Learning for Object Tracking - End-to-End A Survey on Leveraging Deep Neural Networks for Object Tracking| Sebastian

I Understand What You Are Saying: Leveraging Deep ... › bitstream › 10125 › ...2.3. Deep Learning in Text Analytics collection. In addition to Traditional machine learning techniques

Leveraging deep learning hyperparameter tuning frameworks · Leveraging deep learning hyperparameter tuning frameworks Derek Jensen, Donald Lucas, Cli˙ord Anderson-Bergman, Sonia

The Market Opportunity for Productive Use Leveraging Solar … · 2019-10-03 · Kenya Market Deep Dive vi.Zimbabwe Market Deep Dive vii.Côte d’Ivoire ... Insights and Findings

Inspire 2014 – Deep Root Analytics: Leveraging Big Data & Advanced Analytics in Politics

Deep Virtual Stereo Odometry: Leveraging Deep Depth ...openaccess.thecvf.com/content_ECCV_2018/papers/Nan_Yang_Deep… · Deep Virtual Stereo Odometry: Leveraging Deep Depth Predictionfor