Paris live eddiesatterly_022013

Copyright © 2012, Splunk Inc. Listen to your data.

Getting Real Time Value From Data

Eddie SatterlyChief Big Data Evangelist, Office of [email protected]


What Does Big Data Look Like?Volume | Velocity | Variety | Variability | Value

4

GPS,RFID,

Hypervisor,Web Servers,

Email, MessagingClickstreams, Mobile,

Telephony, IVR, Databases,Sensors, Telematics, Storage,

Servers, Security devices, Desktops

Machine-generated data is one of the fastest growing, most complex

and most valuable segments of big data


Big Data Ecosystem

Distributed File System(semi-structured)

Key/Value, Columnar or Other (semi-structured)

Relational Database(highly structured)

Map / Reduce

TeraDataGreenplum

CassandraCouchDBMongoDB

Big Data Technologies

SQL &Map / Reduce

NoSQL

Temporal, UnstructuredHeterogeneous

Hadoop

6

RDBMSSharding

HDFS Storage + Map / Reduce

Real Time Indexing


Splunk as a Data Platform

7

GPS, RFID, Hypervisor,

Web Servers, Email,

Messaging, Clickstreams,

Mobile, Telephony, IVR,

Databases, Sensors,

Telematics, Storage,

Servers, Security devices,

Desktops, CDRs Splunk storage

Data

Dat

a

Dat

a

Report and analyze

Custom dashboards

Monitor and alert

Ad hoc search

DeveloperPlatform


Hadoop Connect – Read/Write HDFS

8

Search

Splunk storage

Data

Dat

a


HadoopOps

Host

Operating System

Infrastructure

splunkHadoopOpsDashboards, alerts and

notifications, powered by splunk search

splunkHadoopOpsForwarder Package on every host Rich UI

FrameworkMonitor &

AlertDistributed

SearchAdd

KnowledgeCollect & Index

Data


Cassandra Connect – Read / Write

10

• V1 will provide remote lookups to Cassandra

• Will enable Splunk searches to write results to Cassandra

• Will allow Column Family creation from Splunk UI

• Future version will add support for other Key Value stores

• Private Beta now and released to Splunkbase as template app in Feb 2013


Splunk - The Big Data Platform

Reliably deliver data from Splunk

11

Sources


Questions ?

[email protected]

Paris live eddiesatterly_022013

Documents

Transcript of Paris live eddiesatterly_022013