Microsoft

Two offerings which interoperate really well

Cortana Intelligence Suite SQL Server 2016

On-premises

Cloud IAAS Enterprise PAAS Cloud Storage Service

SQL Server 2016: Everything built-in

The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research

publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties,

expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Consistent experience from on-premises to cloud

Microsoft Tableau Oracle

$120

$480

$2,230

Self-service BI per user

In-memory across all workloads

built-inbuilt-in built-in built-in built-in

TPC-H 10TB non-clustered results as of 04/06/15, 5/04/15, 4/15/14 and 11/25/13, respectively. http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster

at massive scale

0 14

0 03

34

29

22

15

5

22

6

43

20

69

18

49

3

0

10

20

30

40

50

60

70

80

2010 2011 2012 2013 2014 2015

SQL Server Oracle MySQL SAP HANA TPC-H

Oracle is #5#2

SQL Server

#1

SQL Server

#3

SQL Server

National Institute of Standards and Technology Comprehensive Vulnerability Database update 10/2015

9

Business is being transformed by three trends

IntelligenceCloudBig Data

Stay ahead of the curve with Cortana Intelligence Suite

Business apps

Custom apps

Sensors and devices

People

Automated systems

Data Intelligence

Cortana Intelligence

Action

Apps

Transform data into intelligent action

Intelligence

Dashboards &

Visualizations

Information

Management

Big Data Stores Machine Learning

and Analytics

CortanaEvent HubsHDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Intelligence Action

People

Automated Systems

Apps

Web

Mobile

Bots

Bot

FrameworkSQL Data

WarehouseData Catalog

Data Lake

Analytics

Data Factory Machine

LearningData Lake Store

Cognitive

Services

Power BI

Data

Sources

Apps

Sensors

and

devices

Data

Platform Services

Infrastructure Services

Web AppsInfrastructure

MobileBackends

APIManagement

API AppInfrastructure

Business ProcessAutomation

PushNotifications

Content DeliveryNetwork (CDN)

Live & ODMedia Streaming

B2BIntegration

HybridConnections

Pub/SubQueuing

SimpleQueuing

HybridOperations

Server DataBackup

Hybrid/IntelligentData Backup

DisasterRecovery

Bulk Data ImportAnd Export

RelationalSQL Database

DocumentDatabase Service

DistributedIn-MemoryCache

SearchSimpleKey/ValueStore

DataWarehouse

Directory Health Monitoring

PrivilegedIdentity Management

OperationalAnalytics

StatelessCompute

ScheduledCompute Jobs

Virtual AppStreaming

DistributedCompute

DevelopmentTools

ApplicationInstrumentation

Software DevelopmentKits

Software LifecycleManagement

Domain Join &Policy Management

Big DataAnalytics

PredictiveAnalytics

Data StreamAnalytics

Data Pipelines

Device DataCollection

MobileAnalytics

Big Data Storage

IoT DeviceManagement

Data SourceManagement

Security & Management

User/Group Directory Store

Multi-FactorAuthentication

Scheduled ServiceManagement

Service Creation& Configuration

Encryption KeyStore

Software/SolutionMarketplace

Pre-Build VMImages

Identity Sign-Up and sign-in

TaskScheduler

Applications

Clients

Infrastructure

Management

Databases &

Middleware

App Frameworks

& Tools

DevOps

PaaS &

DevOps

Azure is an open cloud

•

•

•

•

•

•

•

•

Dartmouth-Hitchcock Demo + Video

Information Management

Data

Sources

Apps

Sensors

and devices

Data

Information

Management

Event Hubs

Data Catalog

Data Factory

Compose and orchestrate data services at scale

INGEST

SQL

<>

SQL

DATA SOURCES

{ }

SQL

• Create, schedule, orchestrate, and manage data pipelines

• Visualize data lineage

• Connect to on-premises and cloud data sources

• Monitor data pipeline health

• Automate cloud resource management

• Move relational data for Hadoop processing

• Transform with Hive, Pig, or custom code

Information

Management

Event Hubs

Data Catalog

Data Factory

Get more value from your enterprise data assets

Information

Management

Event Hubs

Data Catalog

Data Factory

• Spend less time looking for data, and more time getting value from it

• Register enterprise data sources, discover data assets and unlock their potential, and capture tribal knowledge to make data understandable

• Bridge the gap between IT and the business, allowing everyone to contribute their insights, tags, and descriptions

• Intuitive search and filtering to understand the data sources and their purpose

• Let your data live where you want; connect using tools you choose

• Integrate into existing tools and processes with open REST APIs

Ingest events from websites, apps and devices at cloud scale

• Log millions of events per second in near real time

• Connect devices using flexible authorization and throttling

• Use time-based event buffering

• Get a managed service with elastic scale

• Get a managed service with elastic scale

• Reach a broad set of platforms using native client libraries

• Pluggable adapters for other cloud services

Azure

API

Management

Backend Services

Data

Information

Management

Event Hubs

Data Catalog

Data Factory

Data sources

Apps

Sensors and devices

Event Hubs

SQL Database Machine Learning

HDInsightStorage

Power BIStream Analytics

ThyssenKrupp Demo + Video

Big Data Stores

Big Data Stores

SQL Data

Warehouse

Data Lake Store

Data

Sources

Apps

Sensors

and devices

Data

Information

Management

Event Hubs

Data Catalog

Data Factory

A hyper-scale repository for big data analytics workloads

• A Hadoop Distributed File System for the cloud

• No fixed limits on file size

• No fixed limits on account size

• Unstructured and structured data in their native format

• Massive throughput to increase analytic performance

• High durability, availability, and reliability

• Azure Active Directory access control

LOB

Applications

SocialDevices

Clickstream

Sensors

Video

Web

Relational

HDInsight

ADL Analytics

Machine Learning

Spark

R

ADL Store

Big Data Stores

SQL Data

Warehouse

Data Lake Store

Elastic data warehouse as a service with enterprise-class features

• Petabyte scale with massively parallel processing

• Independent scaling of compute and storage—in seconds

• Transact-SQL queries across relational and non-relational data

• Full enterprise-class SQL Server experience

• Works seamlessly with Power BI, Machine Learning, HDInsight, and Data Factory

Power BI

App ServiceSQL Database

SQL Data Warehouse

Machine Learning

Hadoop

Intelligent App

Big Data Stores

SQL Data

Warehouse

Data Lake Store

WebHDFS

YARN

U-SQL

ADL Analytics ADL HDInsight

Store

HiveCompute

Data

Azure Data Lake (Store, HDInsight, Analytics)

Hive

Microsoft Azure Data Lake

YARN

U-SQL

Analytics Service HDInsight

Store

HDFS

Hadoop in IaaS Hadoop in PaaS Big Data as a Service

Pros

Complete Control

On-Demand Cluster Sizing

Storage - Local or Cloud

Cons

Only VMs managed for HA

Administration required

Clusters need to stay active

Pros

Fully managed – SLA bound

Flexible resizing

Pay-on-use

Customization Options

Deployed in minutes

Cons

Forgo some control

Pros

Abstracted from clusters

Automated resource alignment

Easy to use interface and APIs

Familiar languages

Faster time to market

Cons

Even Pricing is abstracted

Recent Forrester Wave Report on Big Data Hadoop Cloud

Machine Learning and Analytics

Big Data Stores

SQL Data

Warehouse

Data Lake Store

Data

Sources

Apps

Sensors

and devices

Data Intelligence

Information

Management

Event Hubs

Data Catalog

Data Factory

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

Easily build, deploy, and share predictive analytics solutions

• Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions.

• Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source.

• Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

http://demos.datasciencedojo.com/demo/titanic/

https://sanddance.azurewebsites.net/beachPartyApp/BeachPartyApp.html

Azure Machine Learning : https://studio.azureml.net/

Big data analytics made easy

• Analyze data of any kind and size

• Develop faster, debug and optimize smarter

• Interactively explore patterns in your data

• No learning curve—use U-SQL, Spark, Hive, HBase and Storm

• Managed and supported with an enterprise-grade SLA

• Dynamically scales to match your business priorities

• Enterprise-grade security with Azure Active Directory

• Built on YARN, designed for the cloud

Data Lake Analytics

SQL DW SQL DB Storage BlobsData Lake Store SQL DB in a VM

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

Comprehensive set of managed Apache big data projects

• Scale to petabytes on demand

• Process unstructured and semi-structured data

• Develop in Java, .NET, and more

• Skip buying and maintaining hardware

• Deploy in Windows or Linux

• Spin up an Apache Hadoop cluster in minutes

• Visualize your Hadoop data in Excel

• Easily integrate on-premises Hadoop clusters

Core Engine

Batch

Map Reduce

Script

Pig

SQL

Hive

NoSQL

HBase

Streaming

Storm

In-Memory

Spark

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

Real-time stream processing in the cloud

• Perform real-time analytics for your Internet of Things solutions

• Stream millions of events per second

• Get mission-critical reliability and performance with predictable results

• Create real-time dashboards and alerts over data from devices and applications

• Correlate across multiple streams of data

• Use familiar SQL-based language for rapid development

Event Hubs

Blob Storage

Stream

Analytics

SQL Database

Event Hubs

Power BI

Blob Storage

Table Storage

http://melnyrides75xlb64pcm2yuaws.azurewebsites.net/

Dashboards & Visualizations

Dashboards &

Visualizations

Power BI

Information

Management

Big Data Stores Machine Learning

and Analytics

CortanaEvent HubsHDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Intelligence

Bot

FrameworkSQL Data

WarehouseData Catalog

Data Lake

Analytics

Data Factory Machine

LearningData Lake Store

Cognitive

Services

Data

Sources

Apps

Sensors

and

devices

Data

Keep a pulse on your business with live, interactive dashboards

Event Hubs

Stream Analytics

Machine Learning

Storage

SQL databaseHDInsight

Power BI

Power BI

• Analytics for everyone, even non-data experts

• Your whole business on one dashboard

• Create stunning, interactive reports

• Drive consistent analysis across your organization

• Embed visuals in your applications

• Get real-time alerts when things change

Power BI

Dashboards &

Visualizations

Power BI

• Custom Visual Gallery

Intelligence

Intelligence

Cortana

Bot

Framework

Cognitive

Services

Big Data Stores

SQL Data

Warehouse

Data Lake Store

Data

Sources

Apps

Sensors

and devices

Data

Information

Management

Event Hubs

Data Catalog

Data Factory

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Lake

Analytics

Machine

Learning

Dashboards &

Visualizations

Microsoft Cognitive Services:

Introducing the Seeing AI app

At Build, Microsoft previewed Seeing AI, a research

project that helps people who are visually impaired

or blind to understand who and what is around

them.

The app will use computer vision, image & speech

recognition, natural language processing and

machine learning from Microsoft Cognitive

Services and technology from Office Lens.

The app is under development and is not available

today.

Watch Video HereRead Blog Here

Microsoft Cognitive ServicesGive your apps a human side

Microsoft Cognitive ServicesGive your apps a human side

Cognitive Services API Collection

Computer Vision API

Distill actionable information from

images

Video API

Analyze, edit, and process videos within

your app

Face API

Detect, identify, analyze, organize, and

tag faces in photos

Emotion API

Personalize experiences with

emotion recognition

Vision

Speech

Bing Speech API

Convert speech to text and back again, and understand its intent

Speaker Recognition API

Give your app the ability to know who's talking

Custom Recognition Intelligent Service

Fine-tune speech recognition for anyone,

anywhere

Bing Spell Check API

Detect and correct spelling mistakes within your app

Language Understanding Intelligent Service

Teach your apps to understand

commands from your users

Web Language Model API

Leverage the power of language models trained on web-scale

data

Linguistic Analysis API

Easily parse complex text with language

analysis

Text Analytics API

Detect sentiment, key phrases, topics, and language from

your text

Language

Search

Bing Web Search API

Connect powerful search to your apps

Bing Video Search API

Trending videos, detailed metadata,

and rich results

Bing Autosuggest API

Give your app intelligent autosuggest

options for searches

Bing Image Search API

Bring advanced image and metadata search to your app

Bing News Search API

Link your users to robust and timely

news searches

Developer Resources

Documentationhttp://www.projectoxford.ai/doc

Client SDKshttps://github.com/Microsoft/ProjectOxford-ClientSDK

https://github.com/felixrieseberg/project-oxford (nodejs)

https://github.com/southwood/project-oxford-python

Example Codehttps://github.com/jsturtevant/happy-image-tester-django

https://github.com/jsturtevant/happy-image-tester-nodejs

Your bots – wherever your users converse

Intelligence

Cortana

Bot

Framework

Cognitive

Services

• Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter, and more.

• Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot

• Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences

Transform data into intelligent action

Intelligence

Dashboards &

Visualizations

Information

Management

Big Data Stores Machine Learning

and Analytics

CortanaEvent HubsHDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Intelligence Action

People

Automated Systems

Apps

Web

Mobile

Bots

Bot

FrameworkSQL Data

WarehouseData Catalog

Data Lake

Analytics

Data Factory Machine

LearningData Lake Store

Cognitive

Services

Power BI

Data

Sources

Apps

Sensors

and

devices

Data

Cortana IntelligenceCompetitions

Thank you & Next Steps

Learn more

Email: MESHAH@Microsoft.com

And

Visit the Cortana Intelligence page ▶

Remembering Marvin Minsky

“NO computer has ever been designed that is ever aware of What it’s doing; but most of the time we aren’t either.”

© 2016 Microsoft Corporation. All rights reserved.