BI Forum 2010 - High Performance BI: The Future of BI

HIGH PERFORMANCE BI:THE FUTURE OF BI

THIERRY WINCKELMANS,AREA LEAD ARCHITECT, INTELLIGENT ENTERPRISE

Prague. November 9, 2010

2 – Company Confidential – November 9, 2010

WHO IS

SYBASE?

Sybase delivers

mission-critical enterprise

software to manage, analyze

and mobilize information.


Scale

25 Years of Innovation

Proven

Global Reach

Leadership

Momentum

Pioneered C/S Relational Database , Column-based Analytics, Enterprise Mobility

Platform, Mobile Services

34,000 customersThe top 25 global banks use Sybase

Reach 4.5 billion mobile phone subscribers through 900 operators

Ranked as a leader in 3 Gartner Magic Quadrants and 3 Forrester Wave Reports

4,300 new customers in 2009

Operations in 60 countriesStandalone business within SAP, the

world’s largest business software company

SYBASE—AT A GLANCE


Devices Expand

Decisions Points Expand

Data Expands

3KEY TRENDS


DATA VOLUMES EXPAND…

Data volumes are doubling every 18 months as more people are accessing more data.

Volume of Data

2010’sUnwired Enterprise

1990-2000’sInternet

1980’sClient/Server

1960’sMainframe


… AND IT NOW LIVES EVERYWHERE

Data is now available when and where you need it.

CLOUD

DATACENTER

REMOTELOCATION

MOBILECONSUMER

REGIONALOFFICE

MOBILEWORKER

DESKTOP


DECISION POINTS EXPAND

More people are using more data to make more decisions to drive superior business performance.

TodayPast

Executives

Managers/

Line Workers

Systems

Consumers

8 – Company Confidential – November 9, 2010MOBILIZEANALYZEMANAGE

INTEGRATION COLLABORATION

DECISION-READY

INFORMATION

Analytics Solutions

Risk Analytics

Unified market analytics platform targeted at the capital markets sector to support better trading

and portfolio decisions across the trade lifecycle.

Analytics Server

Column-based, special purpose analytics server that redefines

usability, scalability and performance.

Real-time Market Analytics

Highly optimized real-time risk and trade analytics for

streaming data

THE UNWIRED ENTERPRISE

9 – Company Confidential – November 9, 2010MOBILIZEANALYZEMANAGE

INTEGRATION COLLABORATION

DECISION-READY

INFORMATION

Risk Analytics

RAP—The Trading Edition

Real-time Market Analytics

CEP

Analytics Solutions

THE UNWIRED ENTERPRISE

Analytics Server

Sybase IQ


MODERN OPERATIONAL BI PLATFORM REQUIREMENTS

• The architecture must be designed to :

Integrate into business processes and organizations, creating interactions between Business Intelligence and Transactional processes

Produce a consolidated picture of the business (master data, ODS, physical/virtual data marts, pre-built cubes, …), integrating the archive of detailed historical data

Shorten latency between transactional and analytical worlds

BI together with Transactional processes run the business

« Database technology generated the concept of datawarehouse.

If technology was powerfull enough, there would be no need for

separating operational and analytical environments.»

Pascal Paulin, Head Architect Dexia Group

“We can't solve problems by using the

same kind of thinking we used when

we created them.”

Albert Einstein

11 – Company Confidential – November 9, 2010COMPANY

CONFIDENTIAL

11

SYBASE IQ’S SECRET CORE INGREDIENT:COLUMN-BASED ARCHITECTURE

Conventional Database

c5

c4

c3

c2

c1

…c9

c8

c7

c6

r1

r2

r3

r4

r5

SYBASE IQ

c5

c4

c3

c2

c1

…c9

c8

c7

c6

r1

r2

r3

r4

r5

Data is stored & retrieved vertically

Each column is stored separately – the data is the index

Retrieve only columns used in the specific query

Dramatically reduce system I/O – dramatically increase query speed and accuracy

Data is stored & retrieved horizontally

Querying without indexes and views is extremely I/O intensive

Building indexes and views is a huge time and resource drain, and views/summaries do not give complete picture

Database footprint must be dramatically expanded to make the environment efficient for querying


Conventional DBMS

LOAD

Base table: 0.2 - 0.5 TB

Indexes: 0.05 - 0.3 TB

Aggr/Summ: 0 - 0.1 TB

Indexes

0.5 – 3 TB

Base table“RAW data”no indexes

0.9 – 1.1 TB

2.4-6

TB

Same INPUT data:

Conventional DW

is 3x-6x larger than

Sybase IQ DW

0.25 - 0.9

TB

INPUT DATA:

1 TBSource: flat files,

ETL, replication, ODS

LOWEST TCO FROM DATA COMPRESSION

LOAD

SummariesAggregates

1 – 2 TB


“How many MALES are NOT INSURED in CALIFORNIA?

Gender

M

M

F

M

M

-800 Bytes/Row

20M

ROWS

State

NY

CA

CT

MA

CA

-

RDBMS

Insured

Y

Y

N

Y

N

800 Bytes x 20M 16K Page

= 1.000,000 I/Os

Process large amounts of unused data

Often requires full table scan

M Y CA

M N CA

F Y NY

M N CA

1

2

4

3

Gender Insured State

= 2+ +

1

1

0

1

1

1

0

1

0

1

0

1

20M

Bits

20M Bits x 3 col / 816K Page

= 470 I/Os

Dramatic Reduction In I/O


ALL TOGETHER

Sybase IQ

Column

Based

Advanced

Optimizer

Real Time Load

(24x7)

Simple

Administration

SQL

Standard Tools

Secure

Hardware Efficiency


TELSTRA BUSINESS CASE

• Telstra offers a broad range of telecommunications and information services throughout Australia, including fixed telephone lines, two mobile phone networks, and Internet services. Telstra was the sole telecommunications provider for the 2000 Olympic Games in Sydney.

• Telstra needed technology that would provide near-real-time information on call traffic so it could adjust its mobile cell management system to meet demands.

• “We wanted to operate a flawless, congestion-free, mobile telephone network during the Olympics,” said Anthony Goonan, regional network manager, Telstra OnAir.

• Telstra’s challenge, particularly for the mobile service, was to provide virtually congestion-free access to the network. “There was a huge range of unknowns—from how many people would come to Sydney to their usage of mobile phones—and the call traffic generated by the international broadcast and print media,” Goonan says. “We needed to adapt to those needs by seeing how the network was performing in real time.”


TELSTRA SOLUTION

• In designing the network, Telstra implemented a capability for moving capacity from one part of the network to another, depending on where the customers were making calls. “When we searched for that capability, we found that Compudigm’s seePOWER, powered by Sybase IQ, would meet that need,” Goonan says.

• At the Olympic Park, Telstra implemented over 200 mobile phone cells within an area of about five square miles. “We needed our engineers to see the performance of all of those cells at the same time,” Goonan said. “The application gave us the capability to view the entire network at Olympic Park on one screen and identify hot spots in near real time. That allowed us to adjust the network to meet our customers’ needs.”

• Sybase IQ gathered large amounts of data from the 200-plus cells throughout the Sydney Olympic Park. “That’s the first time that we’ve had this combined capability while operating a cellular mobile network,” Goonan said. “Sybase IQ delivered that data in real time to the seePOWER application, which visually gave us the information our engineers needed to manage the network and give customers the service that they required.”

• Despite demand averaging around 720,000 minutes of telephone conversations daily, Telstra handled all Olympic demands without incident. During the Opening Ceremony, about 500,000 calls were placed or received, with 125,000 of those made from within the Olympic Stadium. “We had zero customer complaints about our service,” Goonan said.

Analytical Applications

SeePower

• Advanced GIS-

based information

analysis

• Near real-time

display

• Historical trend

spotting

• Dynamic data

viewing

Legend

100 200 300 400 500+

Calls per minute (simulation only)


SeePower

• Telstra Olympic mobile coverage

• Real time

• Mobile cell receivers

• ‘provides immediate feedback to the network operators on the levels of demand on the mobile network’ – Telstra spokesperson


SeePower in Action

BI Forum 2010 - High Performance BI: The Future of BI

Technology

Transcript of BI Forum 2010 - High Performance BI: The Future of BI