Dan Querimit - BI Portfolio
Transcript of Dan Querimit - BI Portfolio
Table of Contents
• Data Warehouse Design – MS Visio
• ETL Process – SQL Server 2005 Integration Services
• OLAP – SQL Server 2005 Analysis Services and MDX
• Reporting – SQL Server 2005 Reporting Services, Excel Services, Performance Point Server 2007
Data Warehouse Design
• Introduction: Design a Data Warehouse Schema that allows All Works to report on areas of business including labor, customer, materials, and overhead information.
• Project Goals: – Select the Business Process by understanding business requirements
with an understanding of available data.– Declare the grain for each functional business area.– Choose the Dimension that will be used in the Data Warehouse
design.– Identify the facts to that will serve as measures all works will report
on.
Data Warehouse DesignThis Diagram Shows the Relational Database Design for the OLAP Database. If a MOLAP (Multidimensional Online Analytical Processing) cube is to be part of the solution, this area is known as the Staging Area.
This is an example of multiple snowflake schemas.
ETL Process – SSIS Overview
• Introduction: Design an ETL Process that uploads source data in to the Staging Area.
• Project Goals: – Identify the correct data sources.– Develop ETL Processes for the dimensions (Attributes).– Develop ETL Processes for the Facts (Measures).– Develop Staging Database Maintenance tasks.– Implement appropriate Notifications for the processes.
ETL Process – SSIS
This is an example of loading a slowly changing dimension table.
It will use a surrogate key to verify the employee exists, if not it will write the row to an error log and send a notification email.
The package will then update new employee rate data or add new employee rates.
ETL Process – SSIS
This is an example of loading fact table from multiple text files.
It will use a surrogate key to verify the employee and job exists, if not it will write the row to an error log and send a notification email.
The package will then check for closed job and write those rows to an error log.
Finally, new timesheet entries are added and changed timesheet entries are updated.
ETL Process – SSIS
ETL Process – SSIS
ETL Process – T-SQLThis is an example T-SQL code written to upload data into the Time Dimension table.
OLAP – SSAS Overview
• Introduction: Design an OLAP solution for Reporting and KPIs. • Project Goals:
– Identify a Storage Mode• MOLAP (Multidimensional OLAP) “Using a Cube”
– High Latency (Data is only updated after Processing Cube) . – High Performance (Up to 1000 Times faster then ROLAP)
• ROLAP (Relational OLAP) “Reporting from Staging Area”– Low Latency (Data is Real Time) . – Low Performance
• HOLAP (Hybrid OLAP) There are Several Types in SSAS 2005– One example is Real Time HOLAP where it will use MOLAP while the data is up to date and ROLAP while
the data is updated.
– Specify a Partitioning Strategy.– Develop the Cube Structure, Dimension Usages, Calculations, and KPIs
as Needed.
OLAP - SSAS
OLAP - SSAS
OLAP – SSAS - Calculations
OLAP – SSAS - KPIs
OLAP - SSASThis Partition Strategy partitions each fact table by two year period and aggregates to approximately a 50% performance balance.
OLAP – MDX Code
OLAP - MDX Code
Reporting - Overview
• Introduction: Create Reports in SQL Server 2005 Reporting Services, Excel Services, Performance Point Server 2007
• Project Goals:– Create various reports to specification.– Create a dashboard for these reports where necessary.– Publish these reports to Sharepoint.– Create Report Subscription Schedules as requested.
Reporting - SSRS
Reporting – SSRS - SharePoint
Reporting – Excel Services - SharePoint
Reporting – Excel Services - SharePoint
Reporting – Performance Point
Reporting – Performance Point
Reporting – Performance Point
Reporting – Additional KPIs