The Big Data Explosion - Are You Ready?
-
Upload
manu-marchal -
Category
Data & Analytics
-
view
338 -
download
0
Transcript of The Big Data Explosion - Are You Ready?
![Page 1: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/1.jpg)
THE BIG DATA EXPLOSIONAre you ready?
MANU MARCHALManaging Director EMEA
![Page 2: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/2.jpg)
AN IoT RICH DATA DAY
![Page 3: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/3.jpg)
80 MILLION PEOPLE1300 MESSAGES A SECOND 24 Hours a Day / 365 Days a Year
Information is requested and amended more than 2.6 BILLION times a year
Has enabled over 42 MILLION Summary Care Records to be created and stored
Has transmitted over 1.3 BILLION prescription messages. 1800 messages/s
£21m savings in first year. 700hrs saved every day
NHS Data Spine
![Page 4: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/4.jpg)
Smart Thermostat Market is expected to grow from $146.9 million in revenue in 2014 to $2.3 billion by 2023. -Navigant
THE CONNECTED HOME
Store historical date for analytics
Store User Schedules
Sessions Storage for Connected Users
![Page 5: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/5.jpg)
1.5 TRILLION RECORDS PER DAY 400% Year Over Year Increase
Ability to Monitor entire IT environment from Single Portal
Array of Real-Time Statistics and Insight
Centralize & Correlate Events, Alerts, and Notifications
![Page 6: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/6.jpg)
Cloud-based management tools and data analytics usually only accessible to larger companies. Millions of transactions each day.
POS FOR OVER 20K SMALL BUSINESSES
Quick Service
Retail
Restaurant & Bar
![Page 7: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/7.jpg)
20 TERABYTES OF DATA PER DAY BILLIONS OF MOBILE DEVICES
10 BILLION data transactions a day – 150,000 a second – Apple
Forecasting 2.8 BILLION locations around the world
Generates 4GB OF DATA every second
We’re focusing on helping people make better
decisions with the weather.
![Page 8: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/8.jpg)
WEATHER FORECAST PREDICTS WALMART’S SALES
Ideal BERRY weather turns out to be low wind with
temperatures below 28C.
People are more likely to eat STEAK when it's warm out with
higher winds but no rain, but not if it gets too hot.
![Page 9: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/9.jpg)
WHAT ARE THE IMPLICATIONS?Enterprises must choose: Modernize or Sink!
• Adopt technologies to successfully manage data generated by new data sources and consumed by users accessing complex data types from around the world, 24 hours a day.
• Organizations must make plans to handle data ingestion, data storage, and analytics in order to bring value to the business.
• Increasingly look to distributed systems to help manage the influx of traffic, and ease current operational challenges.
![Page 10: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/10.jpg)
DISTRIBUTED WORKLOADS
App App App App
Virtualization
Server
App
Aggregation
Server Server Server Server
Client-Server Era:SMALL APPSBIG SERVERS
ONE LOCATION
Cloud Era:BIG APPS
SMALL SERVERSMANY LOCATIONS
![Page 11: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/11.jpg)
Everything works at small scale
What happens when something goes wrong
The customer experience matters
WHY DISTRIBUTED SYSTEMS?
Scale out, up and down predictably and linearly
Survive server, network or data center failures
Data locality enables data operations close to end-users
DISTRIBUTED SYSTEMS
DEVELOPERS OPERATIONS CUSTOMERS SALES
![Page 12: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/12.jpg)
The growing hype surrounding data lakes is causing substantial confusion in the information management space
Gartner
Challenge 1 – Isolation of Data
![Page 13: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/13.jpg)
Challenge 2 – Consistency of Data
To Be or Not To Be Consistent?
Understand the question…
C A
PX
The CAP TheoremDr Eric Brewer
Describes the trade-offs involved in distributed systems
![Page 14: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/14.jpg)
Challenge 3 – Data Gravity
Apps
Services
Lower Latency&
Higher BandwidthGrowth
Over TimeData
Gravity
Gravity
![Page 15: The Big Data Explosion - Are You Ready?](https://reader035.fdocuments.in/reader035/viewer/2022070520/58f1a0a71a28abf06a8b45b7/html5/thumbnails/15.jpg)
“Perhaps the biggest challenge is that the IoT has the
potential to generate orders of magnitude more data
than any other source in existence today. So, in the
world of the IoT we will test the limits of ‘big.’”
Bill Franks, Chief Analytics Officer for Teradata
Putting Challenges In Perspective