Intelligent BI Testing. Key to Reliable Information. Data to Impact.

|

Intelligent BI Testing. Key to Reliable Information. Data to Impact.

Sanjay Nayyar Delivery manager Business Intelligence & Analytics, Sogeti

‘t Spant Bussum, 23 november 2015

1 Sogeti BI & Analytics | Intelligent BI Testing

|

Data Explosion

Sogeti BI & Analytics | Intelligent BI Testing 2

Data Generated from dawn of civilization till 2003 was around

5.000.000.000.000.000.000 bytes (1018B)

or to make it simple 5 Exabyte

Data Generated everyday is around

2.500.000.000.000.000.000 bytes (1018B)

or to make it simple 2.5 quintillion bytes

| Sogeti BI & Analytics | Intelligent BI Testing 3

Reference – https://www.domo.com/blog/2014/04/data-never-sleeps-2-0/

|

How is Data explosion impacting us


Customer

Experience

Business Intelligence and Analytics

Digital Transformation Internet of Things (IOT)

|

Market Trend on QA & Testing


18% 23%

26%

35% 40%

0%

10%

20%

30%

40%

50%

2012 2013 2014 2015 2018

Testing Proportion of Budget

Testing Proportion of Budget

Reference - https://www.capgemini.com/thought-leadership/world-quality-report-2015-16

|

Key recommendations from the report:

1. Refocus QA and Testing on customer

experience and business assurance.

2. Transform the traditional Test Center of

Excellence (TCOE) using agile and

DevOps practices.

3. Expand testing teams’ skills beyond

manual test towards test automation.

4. Prioritize testing with predictive

analytics and continuous feedback.

World Quality Report 2015-2016

Sogeti BI & Analytics | Intelligent BI Testing 6 Reference - https://www.capgemini.com/thought-leadership/world-quality-report-2015-16

|

BI Testing Maturity Model


Time

Va

lue

• Basic Reporting

• Manual Effort

• Disjoined Solutions Unaware

• Improved Information Access & Delivery

• Department & functional data marts

• Subject Area datawarehouse Tactical

• Information Integration

• Enterprise Warehouse and Integrated Reporting Stragey

• Single Version of Truth

• Integrated MDM Focused

• Integrated Business Performance Management • Enterprise alignment, accountability

• Advanced Analytics Strategic

• Information On Demand

• Information to the Masses (Internal and External)

• EmbeddedAnalytics Pervasive

• BI Testing Process is not clearly defined

• No integrated BI Test planning & Strategy

based on BI Vision

• Reactive & Manual Initial

• Defining BI Test Policy & Test Strategy

(Manual & automation Testing)

• Test Planning

• BI Test Monitoring & Control Managed

• Implementing BI Test Policy & Test Strategy

(Manual & automation Testing) across all

the projects & BICC

• Testing end to end Enterprise Warehouse

• Testing MDM

• Non-Functional Testing

Defined

• Test Measurement & Test Matrix

• BI Quality Evaluation

• Comparing against Industry standards Measured

Optimization

• BI Defect prevention

• Test Process improvement

• BI Automation Testing

• Quality Control

Gartner’s BI Maturity Model

Sogeti’s BI Testing Maturity Model

|

BI Testing Approach (DWH)


CRM

ERP

FINANCE

ETL

FLAT FILES

(CSV,TXT, .XLS, XML)

DATA SOURCE

DATA WAREHOUSE

Star – Schema Model

Data vault Model

Data Marts

OLAP

DATA MINING

DATA VISUALUZATION

REPORTS

DASHBOARDS

ALERTS

BI RESULTS DATA FLOW

METADATA & SECURITY

Test Entry points 2 Test Entry points 3 Test Entry points 4 Test Entry points 5

Test

En

try p

oin

ts

1

DATA EXTRACTION

DATA PROFILING

DATA CLEANING

DATA TRANSFORMATION

DATA LOADING

DATA VALIDATION

|

BI Testing Approach(Big Data)

AP

PLI

CA

TIO

NS

DA

TA S

YST

EM

SOU

RC

ES

RDBMS EDW MPP

Emerging Sources (Sensor, Sentiment, Geo, Unstructured)

HANA

BusinessObjects BI

OPERATIONAL TOOLS

DEV & DATA TOOLS

Existing Sources (CRM, ERP, Logs, Structured)

INFRASTRUCTURE

Test Entry points 3

Test Entry points 2

Metadata Management (HCatalog)

Test Entry points 1

Test E

ntry

po

ints

4

Test Entry points 5


|

BI Testing Tool model


Test Environment

Test Execution Test Design

Manual/Automated Test

Design Manual/Automated

Functional test

Manual/Automated

Performance & Security test

Manual/Automated Unit test Manual/Automated

Data Quality test

Defect Management

Quality Reporting

Testware Management

Progress Reporting

Test Data Management Test Environment Management

Test Control

|

BI Testing Tool model


Test Environment

Test Execution Test Design

Manual/Automated Test

Design Manual/Automated

Functional test

Manual/Automated

Performance & Security test

Manual/Automated Unit test Manual/Automated

Data Quality test

Defect Management

Quality Reporting

Testware Management

Progress Reporting

Test Data Management Test Environment Management

Test Case Generator

SFQC ETL Toolbox

Test Control

Reporting Toolbox

|

Toolboxes

BI Testing Maturity Toolbox – Takes 2-4 weeks to provide roadmap Source Files Quality Checker Testing Toolbox – Saves 30% of effort Data Quality Testing Toolbox – Saves 30% of effort ETL Testing Toolbox Source Target Comparer Testing Toolbox – Saves 30% of effort Test Case Generator – Saves 35% of effort

Report Testing Toolbox – Saves 40% of effort Test Datamanagement Toolbox – Saves 30% of effort

Sogeti PowerPoint Referentie 2014 12

|

Intelligent BI testing makes BI testing fun and interesting. Able to detect defects much

earlier in the Data Flow chain. Helps them concentrate on the

critical functional areas of testing.

Reduces time taken by monotonous testing activities.

Conclusion

Sogeti PowerPoint Referentie 2014 13

| Sogeti PowerPoint Referentie 2014 14

Thank You !! ..and your Questions

Intelligent BI Testing. Key to Reliable Information. Data to Impact.

Documents

Transcript of Intelligent BI Testing. Key to Reliable Information. Data to Impact.