The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ......
Transcript of The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ......
![Page 1: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
The Rise of Engineering-Driven
Analytics
Loren Shure
Consulting Application Engineer
Language of Technical Computing
![Page 2: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/2.jpg)
2
The Rise of Engineering-Driven Analytics
![Page 3: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/3.jpg)
3
The Rise of Engineering-Driven Analytics
![Page 4: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/4.jpg)
5
Descriptive & Diagnostic
Predictive
Prescriptive
Apply robust, statistically-motivated methods to data produced from complex systems to
understand what has happened and why,
predict what will happen, and
suggest decisions or actions.
Past FutureAnalysis AnalyticsData
![Page 5: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/5.jpg)
6
DecisionSupport
DecisionAutomation
Limited
users, scope
& technology
Pervasive
users, scope,
& technology
Analytics are now pervasiveApply robust, statistically-motivated methods to data produced from complex systems to
understand what has happened and why,
predict what will happen, and
suggest decisions or actions. DecisionSupport
Descriptive & Diagnostic
Predictive
Prescriptive
![Page 6: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/6.jpg)
7
Big Data Compute Power Machine Learning
We have data• Engineering
• Business
• Transactional
We have compute• Desktop
Multicore, GPU
• Clusters
• Cloud computing
• Hadoop with Spark
We know how• Neural Networks• Classification
• Clustering
• Regression
• …and much more…
Analytics are pervasive – Why Now?
![Page 7: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/7.jpg)
8
Business Data
Social profile
Geolocation
Keystroke logs
Transactions
Engineering DataImages
Predictive Model
Offer to Customer
IMPROVED
Use Image Processing
to add image data to the model,
improving performance
Analytics in e-commerce
![Page 8: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/8.jpg)
9
Transactions
Keystroke logs
Geolocation
Social profile
Sensor
Images
Audio
Video
Using now
Source: Gartner Big Data Industry Insights, March 2016
Engineering Data
Business Data
Level of Industry / User Adoption
Consider the Data in Data Analytics
![Page 9: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/9.jpg)
10
Transactions
Keystroke logs
Geolocation
Social profile
Sensor
Images
Audio
Video
Using now
Planned
Source: Gartner Big Data Industry Insights, March 2016
Engineering Data
Business Data
Level of Industry / User Adoption
Consider the Data in Data Analytics
![Page 10: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/10.jpg)
11
The Rise of Engineering-Driven Analytics
![Page 11: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/11.jpg)
12
Architecture of an analytics system
Data from businesssystems
Data from instruments and connected systems
Analyticsand MachineLearning
![Page 12: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/12.jpg)
13
Architecture of an analytics system
Data from businesssystems
Data from instruments and connected systems
Analyticsand MachineLearning
Predictive Model deployed in smart and embedded systems
Predictive Model deployed on cloud and business systems
MATLAB & Simulink Integrates in Embedded Systems and Enterprise
IT Workflows
![Page 13: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/13.jpg)
14
Example – BuildingIQAdaptive building energy management
![Page 14: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/14.jpg)
15
![Page 15: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/15.jpg)
16
25% cost reduction
![Page 16: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/16.jpg)
17
Real-time, closed-loop optimization algorithms
Predictive Model deployed on cloud with client system and real-time data feeds
DATA - Billions of data points:Physics, energy cost, power, internal temperatures, ambient temperatures, ambient humidity, building operation schedule, comfort bounds, etc.
Weather Feeds
Current energy costs & demand
Analytics and Machine Learningplus system identification,control theory & more
MATLAB Toolboxes Just Work –
and work together!
![Page 17: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/17.jpg)
18
We could rapidly translate our prototypes into production algorithms that deal reliably with real-world noise and uncertainty
Borislav Savkovic, BuildingIQ
Why MATLAB?
Robust numerical algorithms
Extensive visualization and analytics tools
Industry-robust and reliable mathematical optimization routines
Good object-oriented framework
Ability to interface with Java (for backend work)
Running MATLAB in the cloud in production
Unit-testing framework
MATLAB Impeccable Numerics for Trusted Results
Why MATLAB?
Robust numerical algorithms
Industry-robust and reliable mathematical optimization routines
![Page 18: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/18.jpg)
19
Example – ScaniaAutomatic emergency braking using sensor fusion and analytics
![Page 19: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/19.jpg)
20
![Page 20: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/20.jpg)
21
Using Model-Based Designto build and deploy the analyticsin an embedded control system
MATLAB Integrates Analytics and
Model-Based Design
![Page 21: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/21.jpg)
22
Implementing Sensor Fusion at Scania
Predictive Model deployed on vehicle
Vehicle logs
of video and radar data
Machine learning
to develop fusion algorithms
for situation detection
![Page 22: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/22.jpg)
24
The Rise of Engineering-Driven Analytics
Medical Devices
AeronauticsOff-highway vehiclesAutomotive
Oil & GasIndustrial Automation Clean Energy
Retail Finance Healthcare management Internet
![Page 23: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/23.jpg)
25
Sensor Data (~1 minute)10-100 sensors/machine
Quality State (~40 minutes)
Classification using Statistics, Machine Learning, and Neural Networks
Predictive Maintenance for polymer-based production machines
![Page 24: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/24.jpg)
26
Deployment – a MATLAB App used by machine operators
M153
M157
State OK
State NOT OK
(C2) Implementing machine learning algorithm using MATLAB for prognostics purpose of airplane hydraulic system
Mitsubishi Heavy Industry
![Page 25: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/25.jpg)
27
![Page 26: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/26.jpg)
28
The need for data scientists
Domain expertise
Coding and integration skills
Statistical and mathematical
knowledge
![Page 27: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/27.jpg)
29
What they say• Expand university programs• Train existing analysts
![Page 28: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/28.jpg)
30
![Page 29: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/29.jpg)
31
![Page 30: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/30.jpg)
32
IoT open data platform for students and makers
Built-in MATLAB analysis Simulink support via Raspberry Pi
![Page 31: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/31.jpg)
33
IoT open data platform for students and makers(D1) Implementing machine learning algorithm using MATLAB for prognostics purpose of airplane hydraulic system
Hitachi
(D1) Development of IOT system to detect anomaly operations of production system
Hitachi
![Page 32: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/32.jpg)
34
Student Contestuse process control data to improve semiconductor yields
21 teams competed
Wafer Big Data in Hadoop
MATLAB used by winning team and 2nd place team
![Page 33: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/33.jpg)
35
MATLAB lets you be your own data scientist
MATLAB & Simulink are Designed and Documented to be Easy for Engineers and Scientists to Use
![Page 34: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/34.jpg)
36
Big DataCompute
Power
Machine
Learning
Limited
users, scope,
& technology
Pervasive
users, scope,
& technology
• Engineering
• Business
• Transactional
• Neural Networks
• Classification
• Clustering
• Regression• …and much more…
In MATLAB
NEW for MATLABAudio System Toolbox R2016aVision HDL Toolbox R2015a
• Native support for engineering data
• Database interfaces
• Streaming
• Desktop -Multicore, GPU
• Clusters
• Cloud computing
• Hadoop with Spark
![Page 35: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/35.jpg)
37
Big DataCompute
Power
Machine
Learning
Limited
users, scope,
& technology
• Native support for engineering data
• Database interfaces
• Streaming
• Datastoretext, image, video, Excel files
• Timetable, string, and tall arrays 2016b
Pervasive
users, scope,
& technology
• Engineering
• Business
• Transactional
• Desktop -Multicore, GPU
• Clusters
• Cloud computing
• Hadoop with Spark
• Neural Networks
• Classification
• Clustering
• Regression
In MATLAB
![Page 36: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/36.jpg)
38
• Native support for engineering data
• Database interfaces
• Streaming
• Datastoretext, image, video, Excel files
• Timetable, string, and tall arrays 2016b
Big DataCompute
Power
Machine
Learning
Limited
users, scope,
& technology
Pervasive
users, scope,
& technology
• Engineering
• Business
• Transactional
• Neural Networks
• Classification
• Clustering
• Regression
In MATLAB• Multicore & GPU
• MATLAB Distributed Computing Serverand EC2 Support
• Hadoop with Spark support R2016b
• MATLAB Production Server
MATLAB is fast:
- heavily optimized libraries
- JIT compiled
- takes advantage of the
compute power you have
• Desktop -Multicore, GPU
• Clusters
• Cloud computing
• Hadoop with Spark
![Page 37: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/37.jpg)
39
Big DataCompute
Power
Machine
Learning
Limited
users, scope,
& technology
Pervasive
users, scope,
& technology
• Engineering
• Business
• Transactional
• Neural Networks
• Classification
• Clustering
• Regression
In MATLAB • Statistics and Machine Learning Toolbox
• Classification Learner App R2015a
• Neural Network Toolbox
• CNNs for Deep learning R2016a
• Machine learning with code generation
• Multicore & GPU
• MATLAB Distributed Computing Serverand EC2 Support
• Hadoop with Spark support R2016b
• MATLAB Production Server
• Native support for engineering data
• Database interfaces
• Streaming
• Datastoretext, image, video, Excel files
• Timetable, string, and tall arrays 2016b
• Desktop -Multicore, GPU
• Clusters
• Cloud computing
• Hadoop with Spark
![Page 38: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/38.jpg)
40
Classification Learner App in Statistics and Machine Learning Toolbox
![Page 39: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/39.jpg)
41
MATLAB Apps for Data Analytics
Distribution Fitting
System Identification
Signal Analysis
Wavelet Design and Analysis
Neural Net Fitting
Neural Net Pattern Recognition
Training Image Labeler
and many more…
With MATLAB Apps, you can complete data
science tasks more quickly and easily than
custom programming
![Page 40: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/40.jpg)
42
Using
MATLAB R2016a
App Designer
![Page 41: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/41.jpg)
43
Using
MATLAB R2016a
App Designer
![Page 42: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/42.jpg)
44
Deep Learning with Neural Network Toolbox - New in R2016a
![Page 43: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/43.jpg)
45
Deep Learning with Neural Network Toolbox - New in R2016a
![Page 44: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/44.jpg)
46
Example –First consumer otoscope in a mobile device using machine learning and computer vision
![Page 45: The Rise of Engineering-Driven Analytics · improving performance Analytics in e-commerce. 9 ... Social profile Sensor Images Audio Video Using now Source: Gartner Big Data Industry](https://reader033.fdocuments.in/reader033/viewer/2022060409/5f102f7d7e708231d447de03/html5/thumbnails/45.jpg)
47
The Rise of Engineering-Driven Analytics
Be your own Data Scientist!
Big DataCompute
PowerMachine Learning
Limited users, scope, & technology
Pervasive users, scope, & technology