2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup
-
Upload
stephan-reimann -
Category
Technology
-
view
240 -
download
1
Transcript of 2013-12-13 Lightning talk Streaming Analytics @ Munich Big Data Meetup
© 2013 IBM Corporation
It's not just the size, it's the motion - Streaming analytics for real time big data with Infosphere Streams Stephan Reimann – IT Specialist Big Data - [email protected]
@stereimann de.linkedin.com/in/stephanreimann/ www.xing.com/profiles/Stephan_Reimann2
© 2013 IBM Corporation
Traditional approach
– Historical fact finding
– Analyze persisted data
– (Micro-) Batch philosophy
– PULL approach
Streaming analytics
– Analyze the current moment / the now
– Analyze data directly “in Motion” – without storing it
– Analyze data at the speed it is created
– PUSH approach
Streaming analytics is a paradigm shift from pull to push analytics in real time, directly „on the wire“, data does not need to be persisted
Repository Insight Analysis Data Insight Analysis Data
© 2013 IBM Corporation
InfoSphere Streams is the result of an IBM research project, designed for high-throughput, low latency and to make streaming analytics easy
Volume Millions of Events per Second
Variety All kinds of data Complex analytics: Everything you can express via an algorithm
Velocity Analyzes data at the speed it is created
Latencies down to µs
Immediate action in real time
+ +
In
foSp
here
Str
eam
s
Cap
abili
ties
How
it w
orks
– Define apps as flow graphs consisting of sources (inputs), operators & sinks (outputs)
– Extend the functionality with your code if required for full flexibility
– The clustered, distributed runtime on commodity HW scales nearly limitless
– GUIs for rapid development and operations make streaming analytics easy
© 2013 IBM Corporation
Free Quickstart Edition
Developer Community
Streaming analytics is about analyzing all the data, continously, just in time, it enables a completely new generation of big data apps
www.ibmdw.net/streamsdev/ www.ibm.com/software/data/infosphere/streams/quick-start/
Stop just dreaming of real time big data Start with streaming analytics!!!
Star
t her
e!! +
Radio astronomy Healthcare TelCo Transport Smart Grid IoT
Streaming Analytics is already reality ... and is a key component of many innovations
... ...
Tutorials, Labs, Forum, ...