Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were...

30

Transcript of Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were...

Page 1: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload
Page 2: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2

Page 3: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Business Intelligence Solution-in-a-Box Oracle Database Appliance

Will Hutchinson, Master Principal Sales Consultant Michael Mrazek, Principal Sales Consultant Oracle Corporation August 2014 Affordable

High Value Fast

3

“Enterprise-Class BI for organizations with Enterprise-Class needs but without enterprise budgets or enterprise staff.”

Page 4: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Performance Report Agenda

1

2

3

4

5

Business Intelligence Challenges

Solution-In-A-Box

Performance Testing Goals and Assumptions

Observations and Recommendations

Q & A

4

Page 5: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Challenges

• Unprecedented pace of change in business today

• Budget constraints and the need to justify all new IT investments

• Data growth and new sources of data

• Maintaining an IT infrastructure that will allow you to quickly scale and grow

• Ability to find highly qualified and trained people

Based on surveys reported publicly by Techaisle, others & Oracle customer interaction

To meet these challenges you need a scalable and flexible

infrastructure that allows you to respond quickly

Page 6: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Market Opportunities

• Grow the business

• Need to attract and retain high value and profitable customers

• Ability to quickly respond to new and changing market opportunities

• Respond to pressures from large and small competitors

• Maintain and measure operational cost controls to increase profitability

Based on surveys reported publicly by Techaisle, others & Oracle customer interaction

To take advantage of these opportunities, you need more than data.

You need insight from your data

Page 7: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 7

Customer Reality

• Delayed, inaccurate reporting

• Conflicting, department-biased results

Sales

Data

Marketing Operations Finance Sales

Analyses, Reports Executives

IT

• Lack of business performance insight

• Sub-optimal enterprise performance

Operations

Data 1

Finance

Data N

Finance

Data 1 Operations

Data N

Marketing

Data

Page 8: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Typical Best Practice Analytics Architecture

OLTP

Applications

Legacy

Data Mart or

Data Warehouse

ETL (Extract,

Transform, and Load)

Business Intelligence

Systems Management

Database Analytics

Third Party

Page 9: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle’s Analytics Platform

OLTP

Applications

Legacy

Oracle Database

Oracle Data integrator

Oracle Business

Intelligence Foundation

Suite

Systems Management – Diagnostics and Tuning

Single Vendor

Single HW Platform

Integrated

Single Support Number

Vast Analytics

Capabilities

Scalable

Single Systems Management

solution

Lower total cost of Ownership

Database Analytics

Oracle Database Appliance

Third Party

Page 10: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle BI Solution-in-a-Box Simplifies deploying Data Analytic solutions

The Oracle approach

• Lowest cost, fastest implementation

Everything is included & pre-configured

• Like buying complete houses integrated into a thriving neighborhood

Can be redecorated and extended if desired

Build it yourself • Select all the tools and integrate them yourself

• Costly, time-consuming, and error prone

• Nothing is pre-built or integrated

• Like buying lumber and a saw on a plot of land

Page 11: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Solution Architecture Hardware. Software. Complete.

• X4-2 Database Appliance

– 2 Servers, each with

• 24 cores & 256GB RAM

– Oracle Linux & VM

• Oracle BI Foundation Suite

• Oracle Data Integrator

• Oracle Database EE

– DB Partitioning

– DB Diagnostics & Tuning Packs

6+ TB of High Performance Usable Storage

Oracle VM

Oracle Business

Intelligence and

Data Integrator

Server 1 Server 2

Oracle Database

Partitioning

Diagnostics

Tuning

Page 12: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Solution Description

•Emtec certified to do installation

–~4 days to set up

•Other offerings being developed

–Managed services

–Implementation packages

Page 13: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

}

Tim

e

Co

st

Build Your Own

SAVINGS

Simple to Install, Manage and Maintain

Installation Expertise

Optimization

Expertise

Network Administration

Storage

Administration

System Administration

Oracle Appliance Manager

Page 14: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Option 1: Build Your Own License 48 Cores for Anticipated Growth

Year 2 Year 3

Option 2: Buy Database Appliance License as You Grow and Save Significantly

Year 1 Year 2 Year 3 Year 1

Purchase Capacity Up Front Purchase Capacity-on-Demand

Capacity On Demand Licensing

Add Capacity When You Need It

4 Cores

8 Cores

32 Cores

12 Cores

24 Cores

16 Cores

OR

48 Cores

Page 15: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Database

Three Sizes: Small, Medium, and Large

Base Size Description

Small Up to 25 Named Users

2 cores active

and licensed

per Server

Medium Up to 50 Named Users

4 cores active

and licensed

per server

Large Up to 100 Named Users

8 cores active

and licensed

per server

BI & DI

BI & DI

BI & DI

Database

Database

Database

Page 16: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Flexible Payment Options

• Pay to own – financing – 3 year fully amortized loan

• Pay to use 3 year operating lease – Limiting balance sheet impact

• Support payments rolled into hardware and software payments

• One invoice from Oracle Financing for hardware, software, support

Monthly or Quarterly payments

Hardware Software

Services

Page 17: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Test Database 1.167 TB of Raw Data

17

• Schema based on a subset of the Oracle Retail Data Model

• 10 years of transaction data

• Header, Payment, and Line Item tables range-partitioned by week with hash sub-partition

• No indexes

• No materialized views

Transaction Line Item

7,796,440,024 Rows

Transaction Payment

517,784,971 Rows

Transaction Header

517,784,971 Rows

Venue

130,080 Rows

Product

54,931 Rows Time

4,383 Rows

Page 18: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Test Database Detail

Table Name Total Rows Avg Rows

Per Year Avg Rows

Per Month Avg Rows Per Week

TRX_MASTER 517,784,971 51,778,497 4,314,874 995,740

TRX_DETAIL 7,796,440,024 779,644,002 64,970,333 14,993,153

TRX_PAYMENT 517,784,971 51,778,497 4,314,874 995,740

REF_VENUE 130,080 130,080 130,080 130,080

REF_PRODUCT 54,931 54,931 54,931 54,931

REF_TIME 4,383 4,383 4,383 4,383

18

During an average week, approximately 1 million orders and 15 million line items are processed.

Page 19: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

8 billion rows filtered to

60 million rows Aggregate

60 million rows joined with

4 million rows Sum

SQL Result

Set

Filter Aggregate Join Sum

SQL Result

Set

Test Workload

19

1 TB Data Set

8 Billon Row Fact Table

500 Million Row Dimension Tables

Scan 1 TB Data Filter subset from 8 billion facts and 500 million dimensions

Join the result set Sort and group the result set

Summarize the result set

Example

Each query processed large data sets

Page 20: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Test Workload using OBIEE Generated SQL

• OBIEE Dashboards were created

• Two typical OBIEE-generated SQL were captured, representing two workload sizes: Big and Bigger

Big SQL – 8 second performance goal Bigger SQL – 30 second performance goal

“Sales for 1 Million Orders and 15 Million Transaction Line Items summarized over a given period of time.”

“Sales for 4 Million Orders and 60 Million Transaction Line Items summarized over a given period of time.”

3 Table Join that processes/aggregates 15M Transaction Detail rows 1M Transaction Payment rows 4K Reference Time rows

3 Table Join that processes/aggregates 60M Transaction Detail rows 4M Transaction Payment rows 4K Reference Time rows

Page 21: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Single User Performance

• With all tests, including single-user tests, Degree of Parallel (DOP) was capped at 4 for each SQL

– Capping DOP is a best practice for leveraging parallelism in multi-user systems

• Baseline Tests

Single User Test Response Time

Big SQL Bigger SQL

Goal 8 seconds or less 30 seconds or less

Observed 3.01 seconds 10.99 seconds

Page 22: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Multi-User Performance Scaling Tests

• The Test System was a “Medium Configuration” with 4 physical cores

– A “Medium Configuration” is targeted to support up to 50 Named Users

• A “Named User” is an authorized user that is entitled to use the system

– Peak processing concurrency for a 50 Named User system is estimated at 10% or 5 concurrent and active executing SQL

– Using the Big SQL and Bigger SQL, scripts were used to execute multi-user tests, where each SQL queried against different data subsets

– The concurrency scripts launched SQL at the exact same time

• No think time or staggering, to represent worse-case concurrency

22

50 Authorized Named Users

10 Connected Users (20%)

5 Active SQL (10%)

“What happens if everyone runs a big un-cached SQL, with everyone hitting the submit button at the exact same instant.”

Page 23: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Multi-User Performance

Average Response Time in Seconds

1 SQL 2 SQL 3 SQL 4 SQL 5 SQL 6 SQL 7 SQL 8 SQL

Goal 8.00 8.00 8.00 8.00 8.00 8.00 8.00 8.00

Observed 3.01 3.19 4.18 5.58 7.47 8.48 9.58 10.84

Scaling Test Results – Big SQL

Success: 5 concurrently active Big SQL with response time less than 8 seconds.

3.01 3.19 4.18 5.58

7.47 8.48

9.58 10.84

0

4

8

12

1 SQL 2 SQL 3 SQL 4 SQL 5 SQL 6 SQL 7 SQL 8 SQL

Observed

Page 24: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Multi-User Performance

Average Response Time in Seconds

1 SQL 2 SQL 3 SQL 4 SQL 5 SQL 6 SQL 7 SQL 8 SQL

Goal 30.00 30.00 30.00 30.00 30.00 30.00 30.00 30.00

Observed 10.99 11.80 15.86 21.85 26.31 31.85 36.55 42.47

Scaling Test Results – Bigger SQL

Success: 5 concurrently active Bigger SQL with response time less than 30 seconds.

10.99 11.8 15.86 21.85

26.31 31.85

36.55 42.47

01020304050

1 SQL 2 SQL 3 SQL 4 SQL 5 SQL 6 SQL 7 SQL SQL

Observed

Page 25: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Why Business Analytics? Why now?

Area ROI %/yr

Production 277%

Financial Management 139%

CRM 55%

IDC reports on median ROI

of analytic projects

Area High performers

Low Performers

Have significant analytic capabilities 65% 23%

Value analytic insights to a very large extent

36% 8%

Have above average analytic capability within industry

77% 33%

Use analytics across their entire organization

40% 23%

Davenport and Harris studied attitudes

toward analytics in Competing on Analytics

You can now afford these capabilities

Page 26: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Why Oracle?

ORC International Gartner

Labor

Hours

/user TCO:

Database BI Tool Sources: ORC International, “Time Savings and Ease of Deployment Study, Oracle Database Appliance vs. SQL Server, January 2012.

Sallam, Rita L. Gartner Research Note G00211906, “BI Platform Survey 2011: Customers Rate Their BI Platform Vendor Cost of Ownership

Page 27: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

BI Solution-in-a-Box

• Lower total cost of ownership

– Automated patching for firmware, O/S, database, VM

– Lower effort to deploy/maintain/Support DB

– Lower TCO Business Intelligence, Data Integration tools

– Easy migration to production if used as test or dev system

– Integrated Lights Out Management and Phone Home capability standard

• Emtec Providing Fast Time to Value

• Scalable

– Expandable while maintaining your skills and programming investments

• Easy to find expertise

“Enterprise-Class BI for organizations with Enterprise-Class needs

but without enterprise budgets or enterprise staff.”

Page 28: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Page 29: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Confidential – Internal/Restricted/Highly Restricted

29

Page 30: Safe Harbor Statement - Emtec Inc...Test Workload using OBIEE Generated SQL •OBIEE Dashboards were created •Two typical OBIEE-generated SQL were captured, representing two workload