BIAG_mzm

40
1 BIAG: IBM and BI Mouzzam Hussain FUIEMS CSC - VII [email protected]

Transcript of BIAG_mzm

Page 1: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 1/40

1

BIAG: IBM and BIMouzzam Hussain

FUIEMS

CSC - VII

[email protected]

Page 2: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 2/40

2

Contents

Introduction

How to Achieve this Goal

Smarter Cities

Smarter Organisations

Some Projects

Stream Computing

System-S

References

Page 3: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 3/40

3

Whats a Smarter Planet???

+ + =

INSTRUMENTED INTERCONNECTED INTELLIGENT

Page 4: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 4/40

Changing the way the world works Smarter Planet

I Need to Work 

Smart

I Need to Work 

SmartI Need Efficiency

I Need EfficiencyI Need to

Respond Quickly

I Need to

Respond Quickly

New Intelligence

New Intelligence Smart Work 

Smart Work Green & Beyond

Green & BeyondDynamic

Infrastructure

Dynamic

Infrastructure

I Need Insight

I Need Insight

4

Page 5: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 5/40

Focusing on the challenges and opportunity for improvement in many key factors in our

lives today

Smarter

=

Planet

Page 6: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 6/40

6

Benifits of a Smarter Planet

Page 7: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 7/40

7

INTERCONNECTED

People, systems and objects can now communicateandinteract with each other in entirely new ways.

INSTRUMENTEDWith the advent of new, low cost sensors, we now have the

ability to measure, sense and see the condition of most things

INTELLIGENT

We can now sense & respond to changes more quickly and

accuratelyget better results, and begin predict future conditions.

Page 8: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 8/40

With the advent of new, low cost sensors, wenow have the ability to measure, sense and

see the condition of most things.

Today, there are 1 billion transistors per

humancosting 1/10,000,000 of a cent.

By now, there are almost 30 billion RFID tags

embedded across our entire ecosystem.

Everything will become instrumented:

- transportation networks

- supply chains- cities

- even natural systems like rivers.

Instrumented

Page 9: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 9/40

People, systems and objects can nowcommunicateand interact with eachother in entirely new ways.

The internet of people is nearly 2 billion strong.Almost one third of the worlds population is on theweb.

There are already about 4 billion mobile phonesubscribers worldwide..

The Connectivity of things:

from vehicles to appliances, cameras,

roadways, pipelines, even livestock will grow into the trillions of connections.

9

Interconnected

Page 10: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 10/40

We can now sense & respond to changes morequickly and accuratelyget better results, and

begin predict future conditions.

Every day, 15 petabytes of new information are

being generated. This is 8x more than the

information in all U.S. libraries.

An average company with 1,000 employees

spends $5.3 million a year to find information

stored on its servers.

Business Analytics & Optimization:

is necessary to help us make sense out of themassive amounts of data generated by these

intelligent devices.

10

Intelligent

Page 11: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 11/40

11

The world is getting Smarter.

Smart trafficsystems

Smart water management

Smart energygrids

Smarthealthcare

Smart foodsystems

Intelligentoil fieldtechnologies

Smartregions

Smartweather 

Smartcountries

Smart supplychains

Smart cities

Smart retail

Page 12: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 12/40

Interconnect systems and industries to create a seamless and efficient

societal structure.

12

EDUCATION TRANSPORTATION SOCIAL SERVICES UTILITIES ENERGY HEALTHCARE COMMUNICATIONS

RETAIL AUTOMOTIVE FINANCE MANUFACTURING FOOD POSTAL SERVICE TECHNOLOGY DEFENSE CUSTOMS

Page 13: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 13/40

13

To realize the benefits of sustainability, an organization must take

a systemic view of its value chain .

WORKFORCE

MANUFACTURING

SUPPLY CHAIN

IT CUSTOMERS

TRANSPORTATION FACILITIES

Smarter Organisations

Page 14: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 14/40

14

Intelligent systems gather, synthesize and apply information

Smart water

Apply monitoring andmanagement technologies tohelp reduce the use of water, aswell as related energy andchemicals.

Smart traffic

Use real-time traffic predictionand dynamic tolling to reducecongestion and its byproductswhile positively influencingrelated systems.

Smart energy

Analyze customer usage andprovide customized productsand services that help to boostefficiency from the sourcethrough the grid to the enduser.

Water

Energy

Chemicals

Carbonemissions

Congestion

Publictransportation Smart home

Carbon

emissions

Energysources

Energy grid

Energy

Noisepollution

Page 15: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 15/40

IBMs Automotive 2020 Study confirmed that Business Intelligence

provides the opportunity to innovate and act in new ways:

Smarter Vehicles

Smarter Decision Support Tools

Smarter Supply Chains

15

From an Information Complexity Perspective

+ + =

Page 16: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 16/40

16

Some Projects ...

Page 17: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 17/40

17

- 19%

- 26%

- 22%

ClearlyMeasurableResults

25% reduction in traffic entering cordon «.. 50% reduction in commute time

15% reduction in CO2 emissions

$120M/yr in revenue to City of Stockholm; payback in 4 years

Congestion charges will fund transit improvements

Smarter transportation managing congestion:

Stockholm

Page 18: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 18/40

Page 19: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 19/40

19

Smart Work for Oil Production

Efficiency

Working Smarter

Smart wireless sensors forsubsurface monitoring

Interdisciplinary collaboration

Real-time data access

Smarter Business Outcomes

2X the industry productionaverage

30% reduction in

maintenance costs

Page 20: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 20/40

20

Working Smarter

New framework to integratecustomer-facing processes

Stronger insight to maximize valueof customer relationships

Smarter Business Outcomes

90% reduction in new

mobile account activation time

1.5 million new customers

processed per month

Smart Work for Mobile

Communications Agility

Page 21: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 21/40

2121

SMARTER IS Reducing a citys traffic congestion

and emissions through road usage

tolls

 And today

SMARTER IS

Getting real-time line of sightacross the transportation supply

chain

Stockholm, Sweden: An intelligent toll system in the city centerresulted in 20% less traffic, 40% lower emissions and 40,000additional users of the public transportation system.

SMARTER IS Knowing where your in-process

components are on the factory

floor

BMW: Implemented RFID container tracking system

improving utilization by 10-20%.

SMARTER IS

Knowing real-time aboutinventory changes in your supply

chain

Building a Smarter Planet

Page 22: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 22/40

22

Lets Build a Smarter Planet

Page 23: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 23/40

23

The Stream Computing Paradigm

Page 24: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 24/40

24

What is Stream Processing?

Database/data

warehouse

Data Sources

data

Stream Processing System

 Process data as it is

continuously generated 

 Extracting and organizing 

information and intelligence

 Minimizing time to react 

Page 25: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 25/40

25

Without Stream Processing?

Database/data

warehouse

Data Sources

data

 Process data as it is

continuously generated 

 Extracting and organizing 

information and intelligence

 Minimizing time to react 

Transaction

processing Batch

processing

Page 26: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 26/40

26

Stream processing will be everywhere

Page 27: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 27/40

27

What Makes a Stream Processing

System?

Stream Processing System

ToolingDeveloper UI

Composition

UIAnalyst UI

Hardware Platform Servers, networks, storage,

operating system, file system

Runtime Environment Job management, resource

management, content routing,

programming model, object store

Application Interconnection of operators

Page 28: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 28/40

28

Continuous Event and Stream

Processing

Analysis Complexity

Time Sensitivity

Event/Data Volume & Diversity

High Volume

Complex Analysis

Time Sensitive

Stream Processing enables

 ± high message/data rates,

 ± low (msec-secs) latency,

 ± advanced analysis

Todays Complex Event Processing (CEP) solutions target

 ± 10K messages/sec,

 ± secs-minutes latency,

 ± rules-based analysis

Page 29: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 29/40

29

System S Stream Processing

System S  High-Perf ormance St ream Comput i ng Pl at  f orm

Olivier Verscheure

IBM T.J. Watson Research Center

Page 30: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 30/40

30

System S Stream Processing

New st ream computing paradigm

Pull information from anywhere in real time

Ultra-low latency, ultra-high throughput

Scalable

Page 31: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 31/40

31

Application Programming

Consumable

Reusable set of operators

Connectors to external staticor streaming data sources andsinks

Source Adapters Sink AdaptersOperator Repository

SPADE: Stream processing dataflow scripting language

Automated Application Composition

Platform Optimized Compilation

Page 32: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 32/40

32

SPADE

SPADE (St ream Pr ocessi ng A ppli cat i on Decl ar at ive Engi ne) is an

intermediate language for streaming applications.

 ± Simplifies design of applications used by System S

 ± Hides complexities of 

manipulating data streams (e.g., contains generic language support fordata types and building block operations)

fanning out applications to distributed heterogeneous nodes

transporting data through diverse computer infrastructures (ingesting

external data, routing intermediate results, looping in feedback, branching,

outputing the results, ...)

Page 33: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 33/40

33

Page 34: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 34/40

34

Page 35: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 35/40

35

Page 36: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 36/40

36

Page 37: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 37/40

37

Page 38: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 38/40

38

Current Projects

Software imaging with cleaning

 ± Joint algorithmic/software/hardware optimization

 ± in collaboration with Tim Cornwell et al.

Astronomical Signature Clustering

 ± in collaboration with Bo Thide, Jan Bergman, Lars K Daldorff 

Page 39: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 39/40

39

References...

http://www.ibm.com/smartercties

http://www.ibm.com/think

http://www.media.mit. edu

http://www.media.mit.edu/research/groups/smart-cities

http://asmarterplanet.com/

http://www.worldcommunitygrid. org/

Page 40: BIAG_mzm

8/8/2019 BIAG_mzm

http://slidepdf.com/reader/full/biagmzm 40/40

Email me at [email protected]