Analytics, Everywhere. Keys to Effective Analytics and Data Discovery
-
Upload
dlt-solutions -
Category
Technology
-
view
38 -
download
0
Transcript of Analytics, Everywhere. Keys to Effective Analytics and Data Discovery
1 © Cloudera, Inc. All rights reserved.
Analy9cs, Everywhere Keys to Effec9ve Analy9cs and Data Discovery
2 © Cloudera, Inc. All rights reserved.
Data is your most important asset
your data can help achieve your objec9ves and mission.
…only if...
3 © Cloudera, Inc. All rights reserved.
Finance Healthcare Regulatory Intelligence Defense
Where is the Public Sector data?
• Ac9vity-‐Based Data
• Video / Surveillance
• Online Ac9vity • Mobile Ac9vity • Sensors • Geospa9al Data • Social / Sen9ment • Associa9ve Data
• Inventory / Supply Chain
• Theater Opera9ons
• NeWlow / Packet Capture
• Ci9zen Data • Demographic /
Census Data • Social / Sen9ment
• Trade Data • Ci9zen Data • Research /
Publica9ons • Communica9ons
/ Documenta9on • Environmental /
Clinical Data • Policy Data • Internet of
Things
• Market Data • Trade Data • Policy Data • Demographic /
Census Data • Communica9on /
Documenta9on • Research /
Publica9ons
• EMRs / EHRs • Claims /
Insurance Data • Policy Data • Ci9zen Data • Research /
Publica9ons • Clinical Studies • Popula9on
Health
4 © Cloudera, Inc. All rights reserved.
Data silos
5 © Cloudera, Inc. All rights reserved.
Data silos
Limited frameworks
6 © Cloudera, Inc. All rights reserved.
Data silos
Limited frameworks
Fragmented admin & security
7 © Cloudera, Inc. All rights reserved.
An analyst sees an event worth inves9ga9ng.
Ac9ng on data is a clunky process
1
8 © Cloudera, Inc. All rights reserved.
Ac9ng on data is a clunky process
1
2
She wants a broader, more comprehensive picture of the event by correla9ng informa9on from mul9ple silos of data. She makes a data request to IT.
9 © Cloudera, Inc. All rights reserved.
Ac9ng on data is a clunky process
1
2 3
The IT request stalls – it will require custom development that will take 3 months to complete.
10 © Cloudera, Inc. All rights reserved.
Ac9ng on data is a clunky process
2 3
1 4
In the mean9me, she con9nues with her limited data, spends too much 9me manually sieing through other sources, and makes gut decisions.
11 © Cloudera, Inc. All rights reserved.
Ac9ng on data is a clunky process
2 3
1 4
5 She guesses wrong, misallocates her team’s assets and resources, and achieves limited success in her mission.
X
12 © Cloudera, Inc. All rights reserved.
Analy9cs in the 9me of big data
13 © Cloudera, Inc. All rights reserved.
Unified data
Unified security & administra9on
Unified framework
Advocate openness Promote efficiency Con9nue the familiar Extend security Encourage governance
Develop an enterprise data hub
14 © Cloudera, Inc. All rights reserved.
Cloudera Enterprise powered by Apache Hadoop™
A new kind of data plaWorm. • One place for unlimited assets, informa4on, and collabora4on
• Unified, mul4-‐framework data access
Only with Cloudera: • Leading performance
• Enterprise system and data management
• Fundamentally secure • Open source, open standards
Security and Governance
Data and Insights
Process Discover Model Serve
Deployment Flexibility
On-‐Premises Appliances Engineered Systems
Public Cloud Private Cloud Hybrid Cloud
15 © Cloudera, Inc. All rights reserved.
Pervasive analy9cs
Innovate
Extend Empower
16 © Cloudera, Inc. All rights reserved.
Imagine if this could be different
1
An analyst monitors and iden9fies events in near real 9me.
17 © Cloudera, Inc. All rights reserved.
Imagine if this could be different
1 2
She has immediate access to unified analy9cal and exploratory views into mul9ple data sources.
18 © Cloudera, Inc. All rights reserved.
Imagine if this could be different
1 2 3
She receives recommenda9ons, grounded on historic trends and baselines and the current event environment, on the best tac9cal ac9ons for further inves9ga9on.
19 © Cloudera, Inc. All rights reserved.
Imagine if this could be different
1 2 3 4
She incorporates the recommended tac9cs into her inves9ga9on.
20 © Cloudera, Inc. All rights reserved.
Imagine if this could be different
1 2 3 4 5
She employs her team’s assets and resources effec9vely and achieves mission success.
21 © Cloudera, Inc. All rights reserved.
Trust enables collabora9on
Security and Governance
Data and Insight
Process Discover Model Serve
22 © Cloudera, Inc. All rights reserved.
Digital Globe – full bleed Can we add more detailed data streams to bener model the impact to the
watershed of actual day-‐to-‐day ac9vity and occurrences?
23 © Cloudera, Inc. All rights reserved.
What trading panerns should we look out for tomorrow that may indicate
market manipula9ons?
24 © Cloudera, Inc. All rights reserved.
Star9ng the journey
25 © Cloudera, Inc. All rights reserved.
1
2
3
4
Collect your exis.ng data
Create new data channels
Explore, enrich, analyze your data
Opera.onalize your insights
Steps to pervasive analy9cs
26 © Cloudera, Inc. All rights reserved.
Iterate to success
Explore, enrich
Analyze, embed
Collect, create
Real-‐9me ingest/serve
New data sources
More complex analysis
Add …
… over 9me
27 © Cloudera, Inc. All rights reserved.
Site clickstream
Unique visitors, enter/exit URLs
CRM transac9ons
Service trends Reports,
email outreach
Phase 1: Single data set analysis
Explore, enrich
Analyze, embed
Collect, create
Explore, enrich
Analyze, embed
Collect, create
Dashboards, page design
28 © Cloudera, Inc. All rights reserved.
Clickstream + CRM
Cross-‐dataset iden9ty matching, path analysis of poten9al issues
Enriched profiles, issue iden9fica9on
Phase 2: Mul9-‐data set analysis
Explore, enrich
Analyze, embed
Collect, create
29 © Cloudera, Inc. All rights reserved.
Preference matching, predic9ve offer crea9on
Enriched profile + inventory
Reports, page design,
email outreach
Phase 3: Predic9ve modeling
Explore, enrich
Analyze, embed
Collect, create
30 © Cloudera, Inc. All rights reserved.
Enriched profile + clickstream
Site personaliza9on, email personaliza9on,
issue aler9ng
Phase 4: Opera9onal analy9cs
Explore, enrich
Analyze, embed
Collect, create
Iden9ty matching, ac9vity and offer correla9on
31 © Cloudera, Inc. All rights reserved.
1 + 1 = 3 Why Cloudera and Informa9ca
32 © Cloudera, Inc. All rights reserved.
Informa9ca Big Data Edi9on
Profile Parse Cleanse ETL Match
Simple visual development environment Prebuilt transforma9ons and reusable business rules Executes na9vely in Hadoop Enables up to 5X developer produc9vity over hand-‐coding scripts
33 © Cloudera, Inc. All rights reserved.
Ingest All Types of Data at Any Latency
Oracle DB2 SQL Server Sybase
Word, Excel PDF StarOffice Email, LDAP
Informix Teradata Netezza ODBC/JDBC
WebSphere MQ JMS MSMQ SAP NetWeaver
Web Services TIBCO webMethods
Flat files HTTP/HTML RPG ANSI
AST FIX SWIFT MVR
Exadata Netezza Pivotal/Greenplum Vertica
Teradata Aster
SAP NetWeaver SAP NetWeaver BI SAS Siebel
JD Edwards Lotus Notes Oracle E-Business PeopleSoft
Salesforce RightNow NetSuite Oracle OnDemand
EDI–X12 EDI-Fact RosettaNet HL7/HIPAA
XML LegalXML IFX cXML
Applications
Messaging
Facebook Twitter LinkedIn Datasift
Databases / Data Warehouses
Data Formats
ebXML HL7 v3.0 ACORD Replicate
Stream
Batch
Archive
Informatica Connectors
Informatica Ingestion
34 © Cloudera, Inc. All rights reserved.
Big Data Meets Data Governance
Informa9ca Big Data Edi9on Tracking the end-‐to-‐end lineage of data before, during, and aeer Hadoop processing with metadata management and lifecycle management
Cloudera Navigator Minimize risk and maintain compliance with the only na9ve end-‐to-‐end data governance solu9on for Apache Hadoop.
35 © Cloudera, Inc. All rights reserved.
A new way forward
36 © Cloudera, Inc. All rights reserved.
Yesterday – Limited structured data storage Today – Unlimited structured and unstructured storage
37 © Cloudera, Inc. All rights reserved.
Yesterday – Scanered, limited processing and analy9cal frameworks Today – Unified, diverse, relevant, familiar frameworks
38 © Cloudera, Inc. All rights reserved.
Yesterday – Segmented management and security Today – Unified data & system security and management
39 © Cloudera, Inc. All rights reserved.
The future of data management: analy9cs, everywhere. What’s your strategy?
Thank you! [email protected] // @wmudge
Learn more about Informa9ca and Cloudera at: hnp://www.cloudera.com/content/cloudera/en/solu9ons/partner/Informa9ca.html