Forecast of Big Data Trends
-
Upload
imc-institute -
Category
Technology
-
view
5.243 -
download
2
description
Transcript of Forecast of Big Data Trends
![Page 1: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/1.jpg)
Forecast ofBig Data Trends
Assoc. Prof. Dr. Thanachart NumnondaExecutive DirectorIMC Institute3 September 2014
![Page 2: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/2.jpg)
2
Big DataBig Data transforms Business
![Page 3: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/3.jpg)
3
Data created every minute
Source http://mashable.com/2012/06/22/data-created-every-minute/
![Page 4: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/4.jpg)
4
The Rise of Big Data
![Page 5: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/5.jpg)
5
Data Growth
![Page 6: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/6.jpg)
6
Big data is data that exceeds the processing capacity of conventional database systems.
The data is too big, moves too fast, or doesn’t fit the structures of your database architectures.
To gain value from this data, you must choose an alternative way to process it.
Big Data Now: O'Reilly Media
What is Big Data?
![Page 7: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/7.jpg)
7
Three Characteristics of Big Data
Source Introduction to Big Data: Dr. Putchong Uthayopas
![Page 8: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/8.jpg)
8
Big Data Supply Chain
![Page 9: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/9.jpg)
9
Big Data Application Area
Source: BIG DATA Case Study,Anju Singh
![Page 10: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/10.jpg)
10
Big Data Use Cases
![Page 11: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/11.jpg)
11
Hospitality Industry Captures
Source McKinsey & Company
![Page 12: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/12.jpg)
12
Next Product to Buy
Source McKinsey & Company
![Page 13: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/13.jpg)
13
Big Data Landscape
Source: Big Data in the Enterprise. When to Use What?
![Page 14: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/14.jpg)
14
Big Data Solution
Sensors Devices Bots Crawlers ERP CRM LOB APPs
Unstructured and Structured Data
Parallel Data Warehouse
Hadoop On Cloud
Hadoop On Private Server
Connectors
S S RS
BI Platform
Familiar End User ToolsSpreadsheet Embedded BIPredictive Analytics
Data Market Place
Data Market
Petabytes of Data (Unstructured)
Hundreds of TB of Data (structured)
![Page 15: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/15.jpg)
15
“ The market for big data will reach $16.1 billion in 2014,
growing 6 times faster than the overall IT market. ”
IDC
![Page 16: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/16.jpg)
16
Prediction #1 Hadoop will gain in stature
![Page 17: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/17.jpg)
17
A scalable fault-tolerant distributed system for data storage and processing
Completely written in javaOpen source & distributed under Apache license
What is Hadoop?
![Page 18: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/18.jpg)
18
Hadoop is growing
Hadoop will continue to displace other IT spending, disrupting enterprise data warehouse and enterprise storage.
IDC predicting the co-habitation for the foreseeable future of RDBMS with the newer Hadoop ecosystem and NoSQL databases.
Hadoop software revenue was $209.2 million or 11 percent of the total big data software market in 2012.
The comprehensive Hadoop market (combined hardware, software, & services) bagged 23 percent of the big data market in 2012, which was projected to grow to 31 percent in 2013. [IDC]
![Page 19: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/19.jpg)
19
Prediction #2 SQL holds biggest promise
for Big Data
![Page 20: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/20.jpg)
20Source: 2013 Big Data Opportunities Survey, Unisphere Research May 2013
Big Data Technologies Adopted or To Be Adopted in Next 24 Months
![Page 21: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/21.jpg)
21
SQL development for Hadoop
Hadoop uses MapReduce to process Big Data.
SQL development for Hadoop enables business analysts to use their skills and SQL tools of choice for big data projects.
Developers can now choose– Hive
– Impala
– Jaql
– Hadapt
Source: www.eweek.com
![Page 22: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/22.jpg)
22
Prediction #3 Big Data vendor
consolidation begins
![Page 23: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/23.jpg)
23
Worldwide Big Data Revenue 2013
Source: Wikibon.org
![Page 24: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/24.jpg)
24
Hadoop Distribution
Amazon
Cloudera
MapR
Microsoft Windows Azure
IBM Infosphere BigInsights
EMC Greenplum HD Hadoop distribution
Hartonwork
![Page 25: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/25.jpg)
25
![Page 26: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/26.jpg)
26
Hadoop clone wars end
Expects to see consolidation among big data startups
Some companies will start to close their doors, while others will probably get acquired.
Cloudera competes against the likes of tier-one megavendors like IBM and Oracle.
![Page 27: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/27.jpg)
27
Prediction #4 Internet of things grow
![Page 28: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/28.jpg)
28
![Page 29: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/29.jpg)
29
Internet of things
The Internet is expanding beyond PCs and mobile devices into enterprise assets such as field equipment, and consumer items such as cars and televisions.
Over 50% of Internet connections are things.
Enterprises should not limit themselves to thinking that only the Internet of Things (i.e., assets and machines) as the potential to leverage the four "internets” (people, things, information and places).
![Page 30: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/30.jpg)
30
![Page 31: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/31.jpg)
31
Prediction #5 More data warehouses will deploy
enterprise data hubs
![Page 32: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/32.jpg)
32
Hadoop roles in data warehouses
Data hubs offload ETL processing and data from enterprise data warehouses to Hadoop
Hadoop acting as a central enterprise hub.
10 times cheaper and can perform more analytics for additional processing or new apps.
Source: www.eweek.com
![Page 33: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/33.jpg)
33
Data Warehouse Offload
![Page 34: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/34.jpg)
34
Enterprise Data Hub
![Page 35: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/35.jpg)
35
Prediction #6 Business intelligence (BI) will be
embedded on smart systems
![Page 36: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/36.jpg)
36
Embedded BI
Embedded data analytics and “business intelligence” begin to emerge.
Sales forces may manage their customer relationships through embedded, smart apps with built-in analytics to make decisions
Progressively, smart software in mobile and enterprise systems will make decisions and make data scientists redundant.
Source: http://www.experfy.com
![Page 37: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/37.jpg)
37
Evolution of Embedded BI
Source: http://www.b-eye-network.com/
![Page 38: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/38.jpg)
38Source: Jaspersoft
![Page 39: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/39.jpg)
39
Prediction #7 Less relational SQL,
more NoSQL
![Page 40: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/40.jpg)
40
Data Management Trends
Source KMS Technology
![Page 41: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/41.jpg)
41
NoSQL
NoSQL means “Not only SQL”, rather than “the absence of SQL”
There are many ways to look at data other tham structure and ordered approach that SQL requires.
The industry is begining to seatle on a few major of players
![Page 42: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/42.jpg)
42
Popular NoSQL/New SQL Distributions
![Page 43: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/43.jpg)
43
Prediction #8 Hadoop will shift to real-time processing
![Page 44: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/44.jpg)
44
MapReduce (Job Scheduling/Execution System)
Hadoop 1.0 Ecosystem
HDFS(Hadoop Distributed File System)
Hive
Zo
oke
pp
er
Flu
me
HBase
Source Big Data Hadoop: Danairat Thanabodithammachari
Pig
![Page 45: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/45.jpg)
45
Limitation of Hadoop 1.x
No horizatontal scalability of NameNode
Does not support NameNode high availability
Not possible to run Non-MapReduce Big Data applications on HDFS
Run as a batch job
Does not support Multi-tenancy
![Page 46: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/46.jpg)
46
Hadoop 2.0
![Page 47: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/47.jpg)
47
Prediction #9 Big Data as a Service (BDaaS)
![Page 48: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/48.jpg)
48
Compute as a Service
Storage as a ServiceStorage as a Service
Data as a Service(Database, No SQL, Hadoop, in-Memory)
Data as a Service(Database, No SQL, Hadoop, in-Memory)
Analytics Software as a ServiceAnalytics Software as a Service
![Page 49: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/49.jpg)
49
Big Data as a Service
The IDC estimates for Hadoop-as-a-service market in 2012 was about $130 million, projected to grow by 145 percent to $318 million in 2013.
More Cloud provider will offer Hadoop as a Service– Amazon AWS
– Microsoft Azure HD Insight
– IBM Bluemix
– Qubole
![Page 50: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/50.jpg)
50
![Page 51: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/51.jpg)
51
![Page 52: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/52.jpg)
52
![Page 53: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/53.jpg)
53
Prediction #10External data is as important
as internal data
![Page 54: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/54.jpg)
54
External Data
The explosive growth of social media, mobile devices, and machine sensors is generating a wealth of bits.
Some of this data is generated within an organization, but a larger percentage comes from the outside
In 2014, businesses will find more ways to harness this mix of structured and unstructured data
![Page 55: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/55.jpg)
55
Hadoop & BI
Hadoop
Fast Database BI Tool
Internal
External
Source: Big Data and BI Best Practices: YellowFin
![Page 56: Forecast of Big Data Trends](https://reader033.fdocuments.in/reader033/viewer/2022051314/54b724664a795903798b4857/html5/thumbnails/56.jpg)
56
www.facebook.com/imcinstitute