Engage 2013 - Big Data
11
What is Big Data? Gordon D’Souza BI Team Lead, Avtex PJ Johnson Architect, Microsoft
-
Upload
avtex -
Category
Technology
-
view
110 -
download
0
description
Learn the true definition of big data and how to leverage it for organizational value.
Transcript of Engage 2013 - Big Data
What is Big Data?
Gordon D’SouzaBI Team Lead, Avtex
PJ JohnsonArchitect, Microsoft
WHAT IS BIG DATA?
Data Complexity: Variety and Velocity
Terabytes
Gigabytes
Megabytes
Petabytes Big
DataLog files
Spatial & GPS coordinates
Data market feeds
eGov feeds
Weather
Text/image
Click stream
Wikis/blogs
Sensors/RFID/devices
Social sentiment
Audio/video
Web 2.0
Web Logs
Digital Marketing
Search Marketing
Recommendations
Advertising
Mobile
Collaboration
eCommerce
ERP/CRM
Payables
Payroll
Inventory
Contacts
Deal Tracking
Sales Pipeline
3
20%Structured Data
80%Unstructured Data
Click StreamSocial
GeolocationMachine Data
LogsVideos
ImagesText
Sensors
Big Data is about building new analytic applications based on new types of data, in order to better serve your customers and drive a better competitive advantage
David McJannet, Hortonworks
http://www.informationweek.com/big-data/news/big-data-analytics/big-data-a-practical-definition/240160412#disqus_thread
Info
rmati
on P
rod
uct
ion
From Data to Value
GPS Telemetry
Log Files
Recorded Voice
Satellite Images
Ambient Data
Ambulance Response Times
Disease Diagnosis
Pothole Detection
Customer Sentiment
New Business Insight
How do I optimize my fleet based on weather and traffic patterns?
SOCIAL & WEB ANALYTICS
LIVE DATA FEEDS
ADVANCED ANALYTICS
What’s the social sentiment for my brand or products
How do I better predict future outcomes?
A NEW SET OF QUESTIONS
COMMON BIG DATA CUSTOMER SCENARIOSGAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY
Web app optimization
Smart meter monitoring
Equipment monitoring
Advertising analysis
Life sciences research
Fraud detection
Healthcare outcomes
Weather forecasting
Natural resource exploration
Social network analysis
Churn analysis
Traffic flow optimization
IT infrastructure optimization
Legal discovery
Data RefinementAggregation/Compression/Transformation/Extraction
Data ConsumptionAnalysis/Modeling/Query/Reporting/
Visualization
Data AcquisitionStreaming/Trickle/Bulk Transfer
Discover data with Data Explorer
Combine with information from other sources via Azure Marketplace
Refine with advanced analytics
Connecting with the World’s Data
Microsoft Big Data
Immersive insights for all users
Insights on any data
Embedded insights with simplified programming
Immersive Insight, Wherever you are
Enterprise-ready Hadoop
Windows simplicity and Manageability for Hadoop
Extend data warehouse with Hadoop
Scale & elasticity of the cloud
Open Big Data Platform
Any Data, Any Size Anywhere
MICROSOFT BIG DATA
Parallel Data Warehouse PowerPivot/Power View
PowerPivot/Power View
InsightManage Enrich
Hortonworks Server
HDInsight Service
Power Query Excel Add-in
Example: Yahoo!
24TB MOLAP Cube
Adhoc Query/Visualization
Optimization Application
464B rows of event level
data/qtr• Dimensions: 24• Attributes: 247• Measures: 207
Avg Query Time:6 secs
Avg Query Time:2 secs
Next StepsRead a bitHDInsight Documentation and TutorialsProgramming Hive Book http://blogs.msdn.com/cindygross
Sign up: Windows Azure HDInsight Service http://www.windowsazure.com/en-us/home/features/preview/
Download Microsoft HDInsight Developer Preview http://www.microsoft.com/web/gallery/install.aspx?appid=HDINSIGHT-PREVIEW
Download Power Queryhttp://www.microsoft.com/en-us/download/details.aspx?id=36803
Download Power Maphttp://www.microsoft.com/en-us/download/details.aspx?id=38395
