4 Best Practices to Achieve Operational Excellence Across Multiple Big Data Technologies
-
Upload
driven-inc -
Category
Technology
-
view
147 -
download
0
Transcript of 4 Best Practices to Achieve Operational Excellence Across Multiple Big Data Technologies
Confidential2
TRUSTEDby over 10,000
companies as their big data app platform
BACKEDby top Silicon Valley
investors True Ventures,Rembrandt VP, Bain
Capital
FOUNDEDin 2008, with
headquarters in San Francisco
Confidential
WHY NOW?
3
As Big Data applications become the engine driving innovation and new revenue models, they graduate to 1st class citizens demanding higher standards of quality, reliability, and manageability
Confidential
PERFORMANCE MANAGEMENT FOR BIG DATA APPLICATIONS
your big data apps
MONITORto resolve
issues fasterbig data apps
more effectively
MANAGECOLLABORATE
Confidential5
Heterogeneous Application Environments Cluster Performance Monitoring Application Performance Monitor
Production Hadoop Environments Contain a Variety of Application Technologies
CHALLENGES
Confidential6
Application Performance MonitorCluster Performance MonitoringHeterogeneous Application Environments
Cluster Monitoring Products Do Not Provide Application Insight
CHALLENGES
Confidential7
Cluster Performance Monitoring Application Performance MonitorHeterogeneous Application Environments
Existing Tools Offer Limited Value for Monitoring Application PerformanceLeaving us blind to business context, priority, ownership and performance of our data applications
CHALLENGES
Confidential8
Enterprise Scale Monitoring and Management for Big Data Apps
Business & Operational Context
Data & TechnologyConnecting Business and Data
PERFORMANCE MONITORING & VISIBILITY
Confidential
ACHIEVING OPERATIONAL EXCELLENCE
9
Balancing a fully operational data processing cluster and customer demands is challenging.
Performance monitoring and visibility for big data applications• See everything in one place with a single view of all data applications real-time
performance metrics across the entire enterprise
Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution
Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
1
3
2
4
Confidential
ACHIEVING OPERATIONAL EXCELLENCE
10
2
1
3
4
Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution
Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
ACHIEVING OPERATIONAL EXCELLENCE
11
3
1
2
4
Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution
Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
ACHIEVING OPERATIONAL EXCELLENCE
12
4
3
2
1Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution
Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
NURTURE A CULTURE OF OPERATIONAL EXCELLENCE
13
Ensure that business, development, IT operations can collaborate seamlessly when it matters
Confidential
End-to-end operational telemetry metadata for big data applicationsAccessible via Web browser, command-line interface (CLI), or simple search queriesEasy integrations through JMX and upcoming Driven SDK
SCALABLE, SEARCHABLE METADATA STORE
17
Telemetry metadata(SSL)
YARN
HADOOP APPS AND INFRASTRUCTURE
APPLICATIONS
Plugin
HADOOP CLUSTERS
WAR
files Web App
Server
Server
Web CLI JMX
Web AppServer
SCALE OUT
SCALE OUT