Post on 08-Mar-2016
description
BIG DATA ANALYTICS
Asst. Prof. Natawut Nupairoj, Ph.D.
Head of Department
Department of Computing Engineering
Chulalongkorn University
natawut.n@chula.ac.th
https://natawutn.wordpress.com
Data is a new class of economic asset, like currency and gold - World Economic Forum
BIG DATA
Source: IBM
..
BIG DATA
40,000+ = 500+Wifi + NAT
Log
90 = 39,000,000,000 events (6.5TB)
Internal External
Structured Unstructured
USHAHIDI2007
Kenya
2010
Haiti
Chile
Washington DC
Russia
2011
Christchurch
Middle East
India
Japan
Australia
US
Macedonia
2012
Balkans
2014Kenya
BIG DATA ARCHITECTURE
Data Source
Data Source
Data Source
Data Source
Data
Ingestion
Fast Data Path
Big Data Path
Data Stream Processors
Data Lake
(Landing Zone)
Data Refinery /
Data Analytics
Da
ta V
isu
aliz
atio
n
Traditional Data Warehouse / Reporting tools
NOSQL
Python R
Data Science
(Data Analytics)
Data Engineering
(Big Data)
( )
GPS
VDO Streaming /
:
?
?
?
DATA ANALYTICS
DATA VALUE CHAIN
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
DATA VALUE CHAIN
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
Data Engineering
Data Science
DATA VALUE CHAIN IT LOG
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
Data Engineering
Data Science
BIG DATA Bigger / Faster / More Up-to-Date Data Warehouse
Social Listening / Crowdsourcing
Workforce Planning / Economics Planning
Smart Education
Precision Agricultural / Resource Management
Preventive Healthcare
Fraud Detection (e.g. Tax, Social Security, etc.)
Video Analytics / Satellite Image Analytics
Real-Time Data Warehouse
Data Driven Organization