Unit 2 - educlash · PDF fileWhere does OWB fit in? The Oracle Warehouse Builder is a tool...
130
Unit 2 www.educlash.com
Transcript of Unit 2 - educlash · PDF fileWhere does OWB fit in? The Oracle Warehouse Builder is a tool...
Unit 2
www.educlash.com
UNIT 2CHAPTER 1,2
DATAWAREHOUSING
www.educlash.com
1.An Introduction to Oracle WarehouseBuilder
Installation of the database and OWB, About hardware andoperating systems, Installing Oracle database software,Configuring the listener, Creating the database, Installing the OWBstandalone software, OWB components and architecture,Configuring the repository and workspaces.
www.educlash.com
Where does OWB fit in? The Oracle Warehouse Builder is a tool provided by Oracle, which
can be used at every stage of the implementation of a datawarehouse, from initial design and creation of the table structureto the ETL process and data-quality auditing.
www.educlash.com
Installation of the database andOWB
Installing Oracle database software1. run the setup.exe This will launch the Oracle Universal Installer program One of the first questions the installer will ask us is about
setting up our ORACLE_HOME—the destination to install thesoftware on the system and the name of the home location.
default—OraDb11g_home1
www.educlash.com
www.educlash.com
click on the Next button to continue and the installprogram will perform its prerequisite checks to ensureour system is capable of running the database That should show a status of Succeeded for all the checks
www.educlash.com
The install screens will proceed to the Summary screenwhere we can verify the options that we selected for theinstallation before actually doing it .
www.educlash.com
WHAT WE ARE INTRESTED IN
click on the Install button to proceed with the installation
www.educlash.com
www.educlash.com
Configuring the listener
Run Net Configuration Assistant to configure the listener.
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
Creating the database We can install a new database using Database Configuration Assistant,
which Oracle provides to walk us step-by-step through the process ofcreating a database.
www.educlash.comwww.educlash.com
www.educlash.com
Create a Database option inStep 1.
www.educlash.com
2.We will be creating a databaseusing an existing template.
www.educlash.com
We are going to choose the DataWarehouse option
www.educlash.com
3.This step of the database creation willask for a database name.
Since we're creating this database for the datawarehouse of ACME Toys and GizmosCompany, we'll choose a name that reflectsthis—ACME for the company name and DW fordata warehouse, resulting in a database nameof ACMEDW.
www.educlash.com
www.educlash.com
4.This step of the database creation process askswhether we want to configure Enterprise Manager.The box is checked by default and leave it as is.
www.educlash.com
There are two options for controlling a database:registering with Grid Control or local management Grid Control is Oracle's centralized feature for
controlling a grid, a network of loosely coupled modularhardware and software components that can be joinedand rejoined together on demand to meet businessneeds. That is what the "g" in Oracle Database 11g stands for
www.educlash.com
5. can set the database passwords On this screen (step 5) we can set the database passwords on
the system accounts using a different one for each account,or by choosing one password for all four. Click on the option to Use the Same Administrative Password
for All Accounts and enter apassword.
www.educlash.com
www.educlash.com
6.This step is about storage. We'll leave it at the default of File System for storage management.
www.educlash.com
7.The next screen is forconfiguring recovery options
www.educlash.com
8.create some sample schemasin the database
This step is where we can have the installation program createsome sample schemas in the database for our reference, andspecify any custom scripts to run.
The text on the screen can be read to decide whether they areneeded or not. We don't need either of these for this book, so itdoesn't matter which option we choose.
www.educlash.com
www.educlash.com
9.Initialization Parameters The next screen is for Initialization Parameters. These are
the settings that are put in place to define various optionsfor the database such as Memory options We're just going to leave the defaults set on this screen,
which will set the basic parameters for us based on theamount of memory and disk space detected on ourmachine.
www.educlash.com
10.Database Storage locations where database files are to be created
www.educlash.com
11.Creation options
any or all can be selected
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
Password Management Click on the Password Management button and on the
resulting Password Management screen, we'll scroll downuntil we see the OWBSYS schema and click on the checkbox to uncheck it (indicating we want it unlocked) and thentype in a password and confirm it.
www.educlash.com
www.educlash.com
Installing the OWB standalone software
If we are going to run the OWB client on the samecomputer as we just installed the Oracle database on, wedon't need any more installations.
www.educlash.com
OWB components andarchitecture
OracleWarehouse Builder is composedon the client of the Design Center (including the Control Center
Manager) and the Repository Browser. The server components are the Control Center Service, the
Repository (includingWorkspaces), and theTarget Schema.
www.educlash.com
www.educlash.com
The Design Center is the main client graphical interface for designing our datawarehouse. This is where we will spend a good deal of time to define our sources and
targets, and describe the extract, transform, and load (ETL) processes we use toload the target from the sources.
We will use the Control Center Manager for managing the creation of thatphysical implementation by deploying the designs we've created into theTargetSchema.
TheTarget Schema is where OWB will deploy the objects to, and where theexecution of the ETL processes that load our data warehouse will take place.
The Repository is the schema that hosts the design metadata definitions wecreate for our sources, targets, and ETL processes. The Repository is aWarehouse Builder software component for which a separate
schema is created when the database is installed—OWBSYS. The Repository is created in the OWBSYS schema during the database
installation. Repository information and workspaces no longer requires SYSDBA privileges
for the user to install the Repository.
www.educlash.com
Configuring the repository and workspaces Repository Assistant application to configure the repository,create
a workspace, and create the objects in the repository that areneeded for OWB to run.
www.educlash.com
www.educlash.com
The steps for configuration
Step 1.
launch the Repository Assistant application on the server
www.educlash.com
www.educlash.com
www.educlash.com
Determining what port yourlistener is listening on.
www.educlash.com
Finding your database instancename
www.educlash.com
Step 2.
what option we'd like to perform
www.educlash.com
Step 3.
what we'd like to do with workspaces
www.educlash.com
Step 4.
specify an owner for the workspace
www.educlash.com
Toperform the first option, we will need to specify adatabase user who has DBA privileges that are required to beable to create a new user in the database. The second option is to specify an existing database user
to become the owner of the workspace.This user must havethe OWB_USER role assigned to be able to successfullydesignate it as a workspace owner. We'll specify a new user for the ACME Toys and Gizmo's
warehouse, since we've just installed this database and noother users are created yet.
www.educlash.com
Step 5. If we are creating a new user, it will ask us for an existing
user with DBA privileges in the database. The SYSTEM account is the default provided there
www.educlash.com
Since we're specifying a new user, we will put in thepassword for the system user and proceed to the next step.
www.educlash.com
STEP 6.
Enable optional features
www.educlash.com
Step 7. specify the new username, password, and workspace name
SIDDHU
SIDDHU
www.educlash.com
Step 8. This step will ask for the password for the OWBSYS user
siddhu
www.educlash.com
Step 9.
tablespace names for the OWBSYS schema.
www.educlash.com
Step 10. select a base language for the repository, so we'll make the
appropriate selection. The Repository Assistant will automatically assign the base
language depending on the locale that is assigned to thecomputer we're installing on.
www.educlash.com
www.educlash.com
Step 11. is the optional step 10 to specify any workspace users from
existing database users
www.educlash.com
www.educlash.com
Click on the Finish button and it will begin theinstallation, presenting us with a scroll bar moving to theright as it progresses through the installation.The very firsttime it runs, it will take around 5 to 10 minutes to run beforereporting the success pop up, as it has to initialize therepository in the OWBSYS schema.
www.educlash.com
2. Defining and ImportingSource Data Structures
An overview ofWarehouse Builder Design Center, Importing/defining sourcemetadata, Creating a project, Creating a module, Creating an Oracle Databasemodule, Creating a SQL Server database module, Importing source metadata froma database, Defining source metadata manually with the Data Object Editor,Importing source metadata from files.
www.educlash.com
NEEDS to begin building our data warehouse format in which the data is currently stored and where it is
stored. Whether the database is an Oracle database or another
vendor's database such as Microsoft SQL Server. Whether there are any flat files of information saved.(CSV
file, )
www.educlash.com
Preliminary analysis The analysis will tell us where the data is located, and in what
format, so that we can begin to define our source data structuresin the Warehouse Builder The high-priority information that they would like to see from this
data warehouse project is sales-related data for all their stores They don't have an idea about the comparative sales in the various
stores, so they need some way to view all that data together to do ananalysis that shows how well, or poorly, the stores are doing In the future, they would also like to be able to compare store
sales with their web site sales, but that will not be required forthis first data warehouse we build
www.educlash.com
ACME Toys and Gizmos sourcedata This system maintains data in a Microsoft SQL Server
database named ACME_POS, and tracks individual salestransactions that occur for all of ACME's toys and gizmos.
IT department that runs the web site for ACMEToys andGizmos has its own database that supports the web site ordermanagement process.
Scripts have been provided on the Packt web site at http://www.packtpub.com/files/code/5746_Code.zip. Wealso have a CSV file in this code bundle that will be required to import metadata.We have a script to install the SQL
Server database. Instructions to use these files can be found with the code bundle.
www.educlash.com
The POS transactional source database The DBA (Database Administrator—the person
responsible for the maintenance and administrationof the database) is in charge of the POS transactionaldatabase. The DBA has provided an Entity-Relationship (ER)
diagram of the database to help us understand the databaseand the relationships between the various tables. The diagram is in the UML (Universal Modeling
Language) notation. The cardinality indicates how the records in one table
relate to records in the other.
www.educlash.com
The web site order managementdatabase section.
www.educlash.com
The DBA in charge of the Oracle database for theweb site order management system has provided uswith its ER diagram for our information. As with the POStransaction database, an ER diagram is provided here ina shortened version to give us an idea of the tablesinvolved and their relationships with each other.
www.educlash.com
ER diagram is provided here in a shortenedversion of web site order management
www.educlash.com
Warehouse Builder Design Center The Design Center is the main graphical interface that we
will be using to design our data warehouse, but we also use itto define our data sources. The Design Center must connect to a workspace in our
repository The repository is located in the OWBSYS schema that was
the pre-installed schema the database installation providedfor us. The user name chosen was acmeowb and the
workspace name was acme_ws. Now it's time to make use of this user and workspace.
www.educlash.com
Start design center
www.educlash.com
Login screen
SIDDHU
www.educlash.com
www.educlash.com
CONNECTION EXPLORER
GLOBALEXPLORER
PROJECTEXPLORER
www.educlash.com
Three windows in the main Design Center screen.They areas follows:
Project Explorer Connection Explorer Global Explorer
www.educlash.com
Project Explorer window The Project Explorer window is where we will work onthe objects that we are going to design for our datawarehouse. we will need to design an object under the Databases
node to model that source database. If we expand theDatabases node in the tree, we will notice that it includesboth Oracle and Non-Oracle databases.
www.educlash.com
Connection Explorer The Connection Explorer is where the connections are
defined to our various objects in the Project Explorer.Theworkspace has to know how to connect to the variousdatabases, files, and applications we may have defined in ourProject Explorer. Connections are applicable for the entire workspace, and not just the
project we are working on.
www.educlash.com
Global Explorer Global Explorer is used to manage these objects. It includes
objects such as Public Transformations or Public DataRules. A transformation is a function, procedure, or
package defined in the database in Oracle's procedural SQLlanguage called PL/SQL. Data rules are rules that can be implemented to
enforce certain formats in our data.
www.educlash.com
Importing/defining sourcemetadata
Metadata is data that describes our data. Weare going to tell theWarehouse Builder what our source
data looks like and where it is located, so that it can build thecode necessary to retrieve that data when we design and runmappings to populate our data warehouse.
www.educlash.com
right-click on the project name in the Project Explorerand select Rename
We'll name the projectACME_DW_PROJECT.
Creating a project
www.educlash.com
Creating a module before we can define or import a source data definition, we
must create a module to hold it. A module is an object in the Design Center that acts as a
storage location for the various definitions and helps uslogically group them. We have to create an Oracle module for the
ACME_WS_ORDERS database for the web site orders,and a non-Oracle module for the ACME_POS SQLServer database.
www.educlash.com
Creating an Oracle Database module
right-click on the Databases | Oracle node in theProject Explorer of Warehouse Builder andselectNew
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
Creating a SQL Serverdatabase module
create one for the SQL Server POS transactional database:ACME_POS
www.educlash.com
Oracle makes use of Oracle Heterogeneous Services tomake connections to other databases
The agent facilitates the communication with the externalnon-Oracle database. That agent can take one of thesetwo forms: A transparent gateway agent that is tailored specifically to
the database being accessed.(must be purchased and installedseparately ) A generic connectivity agent that is included with the
Oracle Database and which can be used for any externaldatabase.(comes free with the Oracle Database )
www.educlash.com
On Microsoft Windows, we configure DSNs inthe ODBC Data Source Administrator. Thefollowing are the steps for configuring DSN:
Start | Control Panel | AdministrativeTools menu.Theapplication is called Data Sources (ODBC). In ODBC Data Source Administrator, click on the System
DSN tab, and then click on the Add button to add a newsystem DSN. The first screen asks you to select which driver you want to
use for your data source. Scroll down the list until you seethe SQL Server entry and click on it. Now click on the Finishbutton.
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
Configure Oracle to connect toSQL Server
The following are the two steps involved here: Create a heterogeneous service configuration file. Edit the listener.ora file.
www.educlash.com
Creating a heterogeneous serviceconfiguration file.
www.educlash.com
open the file named initdg4odbc.ora Change the configuration HS_FDS_CONNECT_INFO = <odbc data_source_name> HS_FDS_TRACE_LEVEL = <trace_level>
HS_FDS_CONNECT_INFO = ACME_POS HS_FDS_TRACE_LEVEL = 0
save it as initacmepos.ora.
www.educlash.com
Editing the listener.ora file
www.educlash.com
Load the listener.ora file into a text editor Add the following lines to the file
SID_LIST_LISTENER=(SID_LIST=
(SID_DESC=(SID_NAME=acmepos)
(ORACLE_HOME=C:\app\Administrator\product\11.2.0\dbhome_1)(PROGRAM=dg4odbc)
))
www.educlash.com
After we save the listener.ora file, we must restart thelistener for the change to take effect. Wecan restart it by navigating to Start | Control Panel |
AdministrativeTools and then clicking on Services. scroll down until you see the service for your database
listener, which will be named starting with Oracle andending inTNSListener (if it is 11g name isOracleOraDb11g_home1TNSListener )
www.educlash.com
www.educlash.com
Creating the Warehouse Builder ODBC module for SQLServer
Right-click on the ODBC node in the Project Explorer of DesignCenter, and select New... from the pop-up menu.The first screenthat will appear is the Welcome screen, so just click on the Nextbutton to continue.
www.educlash.com
www.educlash.com
www.educlash.com
www.educlash.com
Importing source metadatafrom a database
Weare now at the point where we can finally import ourmetadata.
www.educlash.com
Weare going to begin by right-clicking on theACME_WS_ORDERS module name under the Databases |Oracle node in the Project Explorer and selecting Import...
from the pop-up menu.
Wewill have all theseoptions for an Oracledatabase, but for ourODBC connection tothe SQL Serverdatabase, it will havecheckboxes for justTable andView.
www.educlash.com
www.educlash.com
Summary and Import page where it will summarize theselections we've made and tell us the action it is going totake for each selection—whether to create or re-import theobject.
www.educlash.com
Clicking on the Advanced Import Options
uncheck the preservecheckboxes so ourmanual edits arereplaced with a cleancopy
www.educlash.com
•A Save button whichwill allow us to savean MDL file of theactivity we justaccomplished.
•An MDL is a file theWarehouse Buildercan save that containsinformation from themodel that can beimported later.
www.educlash.com
Defining source metadata manually withthe Data Object Editor
The tool theWarehouse Builder provides forcreating source metadata is the Data Object Editor,which is the tool we can use to create any object in theWarehouse Builder that holds data such as database tables
1. Navigate to the Databases | Non-Oracle | ODBCnode, and then select the ACME_POS moduleunder this node.
2. right-click on this node and select New, from the pop-up menu . we are presented with the Data ObjectEditor screen.
www.educlash.com
www.educlash.com
Let's click on the Columns tab next and enter theinformation that describes the columns of the Items table.
Items source table in the POS1. ITEMS_KEY number(22)2. ITEM_NAME varchar2(50)3. ITEM_CATEGORY varchar2(50)4. ITEM_VENDOR number(22)5. ITEM_SKU varchar2(50)6. ITEM_BRAND varchar2(50)7. ITEM_LIST_PRICE number(6,2)8. ITEM_DEPT varchar2(50)
www.educlash.com
When completed, our column listshould look like this
WE-ITTUTORIAL.PHNO:8097071144/55
Wecan save our work atthis point and close theData Objectwindow nowproceeding. So
Editorbefore
we'llselect Diagram | SaveAll from themenu of the
toolbarData
Object Editor, or pressthe Ctrl + S keycombination to save ourwork.
www.educlash.com
Wenow have to continue this process to define the metadata for theremaining SQL Server tables that we'll need.
• STORES• STORES_KEY number(22)STORE_NAME varchar2(50)STORE_ADDRESS1 varchar2(60)STORE_ADDRESS2 varchar2(60)STORE_CITY varchar2(50) STORE_STATEvarchar2(50) STORE_ZIP varchar2(50)REGION_LOCATED_IN number(22)• STORE_NUMBER varchar2(10)
• REGIONS• REGIONS_KEY number(22)REGION_NAME varchar2(50)CONTINENT varchar2(50) COUNTRYvarchar2(50)
REGISTERSREGISTERS_KEY number(22)REGISTER_MANUFACTURER varchar2(60)MODEL varchar2(50)LOCATION number(22)SERIAL_NO varchar2(50)
POS_TRANSACTIONSPOS_TRANS_KEY number(22)SALES_QUANTITY number(22)SALES_ASSOCIATE number(22)REGISTER number(22)ITEM_SOLD number(22)DATE_SOLD dateAMOUNT number(10,2)
www.educlash.com
Importing source metadata from files
One final object type we need to discuss before we wrap upthe source metadata importing and defining is the import ofmetadata from a file. The file format must be delimited, usually with commas
separating each column and a carriage return at the end of arecord (CSV file)
The process of creating the module and importing themetadata for a flat file is still the same as importing fromOracle or non-Oracle databases, but there are some minordifferences
www.educlash.com
The steps involved in creating the moduleand importing the metadata for a flat file
1. Project Explorer under our project2. Files node right below the Databases node3. We will launch the Create ModuleWizard4. but we'll do it on the Files node and not the Databases
node.We'll right-click on the Files node and select Newfrom the pop-up menu to launch the wizard.
1. click on the Next button on theWelcomescreen2. The Step 1 of the Create Module wizard only asks for a
name and description3. enter a name of ACME_FILES and click on the Next button
www.educlash.com
1. Weneed to edit the connection in Step 2 just as we did for thedatabase previously.
2. So we'll click on the Edit button
Give pathof .csv file
click on the OK button
www.educlash.com
We'll then check the box for Import after finish and clickon the Finish button
The Import Metadata Wizard appearsnext
www.educlash.com
The next screen is the Object Selection screen
select the counties.csv file, click on the right arrow (>),and then move onto the Next step
www.educlash.com
red X in the Status column.
It contains no other information that could describe to theImport Wizard what these column namesare called,or what kind of data the columns hold
use the Sample button toenter that information
www.educlash.com
This is Flat File Sample Wizard, which has nowbeen started.
WE-ITTUTORIAL.PHNO:8097071144/55
www.educlash.com
carriage return <CR>characte will indicate the
end of a row
www.educlash.com
www.educlash.com
The records are all of a Single Record type. Soleaving that checked as the default,
www.educlash.com
Check thebox that
says Use thefirst recordas the field
names
Change thedefaulttypes to
appropriateone
www.educlash.com
Click on Next to get a summary screen of what thewizard will do, or just click on the Finish button tocontinue.
This will take us back to the Import Metadata Wizardscreen where we can see that the red X has now changedto a green check mark.
It will create our file module under the Files node andwe will be able to access it in the Project Explorer
Wecan see that the imported file is displayed asCOUNTIES_CSV
We'll make sure to select Save All from the Design menuin Design Center to save the metadata we just entered.
www.educlash.com
END OF UNIT 2
DATAWAREHOUSE
www.educlash.com
