Microsoft Developer Daydownload.microsoft.com/download/B/7/B/B7B9BFC3-AAC... · Azure Big Data and...
Transcript of Microsoft Developer Daydownload.microsoft.com/download/B/7/B/B7B9BFC3-AAC... · Azure Big Data and...
Microsoft Developer Day
Microsoft Developer Day
Dr Graham Williams
Director of Data Science, Pacific Asia,Data Group, Cloud and Enterprise
Data Scientists
Transform Data into Information
Data Scientists
Information into Knowledge using Machine Learning
Data Scientists
Through Wisdom turn that Knowledge into Intelligent Action
Source: http://prlab.tudelft.nl/content/pattern-recognition
X2
X1
Class A
Class BClassifier
Training set Representation Generalization
Feature space
Machine Learning: Data to Knowledge
RegressionClassification AnomalyDetection
Recommenders
-0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2
-0.6
-0.4
-0.2
0
0.2
0.4
error
error
3210-1-2-3-4
-3
-2
-1
0
1
2
3
4
Machine Learning
From collections of historic data we extract knowledge and represent it as models used to describe, predict and to prescribe actions.
Data Scientist: Skills and Process
Source: Dataconomy
DomainKnowledge
Communications
Presentation
Inquisitiveness
ProblemSolving
BusinessAnalysis
BusinessStrategy
BusinessValue
Free software environment and language for statistical computing and graphics
Available on UNIX platforms, Windows and MacOS.
R-Core team of 20 leading international computational statisticians
Over 7000 packages from users/statisticians world wide.
Vendor independent and future proof.
Data Scientist’s Toolkit: R Language
• “I think it addresses a niche market for high-end data analysts that want free, readily available code. We have customers who build engines for aircraft. I am happy they are not using freeware when I get on a jet.”
The New York Times, January 2009 quoting marketing director of a data science vendor on competition from Open Source R.
Data Scientist’s Toolkit: R Language
Traditional Vendor View of Open Source R
Data Scientist’s Toolkit: R LanguageAustralian Department of Immigration: Data Scientists deliver sophisticated risk models to protect Australia's borders. McCairns says “the department bought $15million worth of software---but it's gathering dust.'‘
Vendor responded: “R in a productionsystem, it can be scary … has severelimitations …”
Every Australian Tax Returnlodged is risk scored by an R model to decide on what action is to be taken or what advise to provide to the tax payer.
http://www.itnews.com.au/news/what-immigration-did-with-just-1m-and-open-source-software-390687
Data Science Platform – End to End
Transform your data into intelligent action
• Any Data - relational, non-relational, text, images, video, audio, time series
• Any Analytics – ETL, transactions, big data, machine learning, visualization
• Any Scale – small data, big data
• Any Speed – batch, streaming, interactive
• Any Location – on-premise, cloud, hybrid
• Any Source – best of open source, best in class enterprise grade software
SQL 2016
ServerAzure DBAzure DW
SQL server R servicesOn-prem and cloud(Windows, Linux)
Cortana Intelligence Suite
Azure Big Data and Analytics Hadoop, Data Lake, Machine
learning, PowerBI, Data Factory, Streaming,
Perceptual IntelligenceOn-prem connectivity
Microsoft R server
Analytics Hadoop Teradata
On-prem and cloud(Windows, Linux)
Data and Analytics – 3 PillarsDelivering our vision of an end-to-end platform for the data scientists to develop intelligent applications driven by data analytics.
Cortana Intelligence Suite
Continuous enhancements
SQL Server 2016the first cloud-born release
Incorporating R forin database advanced analytics
Hybrid cloud
Mission critical OLTP
Cloud-first approach
Code Portability Across Platforms
Azure VMAzure HDI, SparkAzure MLPowerBIOffice 365…
LinuxWindows
Teradata, SQL Server
HortonworksClouderaMapR
In the Cloud
Workstations & Servers
EDW
Hadoop
DistributedR
ScaleR
ConnectR
DevelopR
Microsoft R Server: Write Once, Deploy Anywhere
• Microsoft R Open• Microsoft R Server• SQL Server 2016 R Services• R Tools for Visual Studio (RTVS)• Data Ingestion to Cortana Intelligence Suite• Azure Machine Learning and R• Data Visualization using Power BI Dashboard
Demonstration
Visit:https://azure.microsoft.com/en-us/services/machine-learning/
Empowered for Data ScienceBegin a journey to turn Data into Intelligent Action
Cortana Intelligence Resources and Competition
The Cortana Intelligence Gallery enables our growing community of developers and data scientists to share their analytics solutions.
Join a competition to help advance the state of the art in interpreting brain signals and to help patients to have a chance at a healthier life using real data from patients undergoing neurosurgery.
Cortana Intelligence Galleryhttps://gallery.cortanaintelligence.com/
Cortana Intelligence Competitionhttp://aka.ms/decodesignals
Azure Portalhttp://azure.microsoft.com
Azure Updateshttp://azure.microsoft.com/blog/
Thank youBlog:
https://blogs.technet.microsoft.com/machinelearning
Follow us online
Microsoft Developer Day