Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS.
19
Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS
-
Upload
russell-wilcox -
Category
Documents
-
view
222 -
download
5
Transcript of Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS.
Enterprise Information Services (EIS) - Review
Ray ChaseManager, EIS
EIS Vision
Provide reliable, innovative, centralized, and comprehensive decision support and business intelligence systems to ERCOT, the Market, and the PUCT.
Why?
Protocol Requirements – Market Data Collection and Use (section 17)
Collect an Accurate Historical Record of all Source Systems Intra-day Capture – All Data Auditability
Single System Source Data Integration Opportunity to Offset Source System Load
Robust Reporting Environment Ease of Use Centralized Tools One Version of the Truth
Data Modeling Oversight Future ERCOT and Market Decision Support Opportunities
Overview
Data Collection Data Archiving/Roll-off Data Integration Data Transparency and Delivery SOA Framework Data Modeling and Analysis Business Intelligence and Reporting Legacy System Transition Current Project Relationships Current Statistics
Data Collection
All Operational Source Systems feed into ODS Replication is near real-time All intra-day transactions Nearly all tables (rules)
PaperFree
Lodestarlodstar
Lodestarlodstar
Lodestarlodstar
Siebel
TCH
RSS
Lodestarlodstar
EMMSomsappdev
EMMSercot
EMMShis_user
SiebelPaperFree
TCH
ODS
TCR
Data Archiving/Roll-off
Uses a table based, data partitioning strategy Performance Long-term Historical Data Archiving
Source System ODSRSS
Record Record Record
Record
Record
Record
Insert, Update, Update, Update
Insert, Update, Update, Update
Insert Insert Insert
Current
History
Table_A Table_A Table_A
200101
200102
200103
Long-termTape
Multi-source system data integration Removes fragmentation of solutions Single version of the truth Reusability
Various 2005 projects with integration 50017 – Collateral Calc 50130 – ESIID Lookup 40015 – TCR Reporting 50001 – BI Foundations
Data Integration
Business Intelligence
ODS
Lodestarlodstar
EMMSomsappdev
TCR
CollateralCalculation
Portal Views
Data Transparency and Delivery
Single Design - Multiple Solutions Large Scale Market Participant Extraction Public Data Extraction Market Reporting Tool (2006) Web Service Delivered Data (50024 – SCR740, ESIID)
Type-1 – Scheduled Data Delivery Type-2 – Real-time Data Delivery
Business Intelligence
RSS ODS
CDW
Market
Data Extracts
Web Services
Report Tool
ERCOT Service Orientated Architecture Framework
URL XML
MP System
URL XML
MP System
SOAPRequest
SOAPReply
ERCOT’s Service Orientated Architecture Framework will provide four methods to access ERCOT’s information and services
Use an ERCOT supplied Web Interface
URL XML
XSLT
URL HTML
Build your own interface utilizing our XML REST Web Services
System to System utilizing our XML REST Web Services
System to System utilizing our SOAP Web Services
SOA Framework
www.amazon.com/gp/browse.html?node=3435361
Data Modeling and Analysis
Provides a framework for decision support, business intelligence, and data modeling and analysis
Business Intelligence
RSS ODS
CDW
PC.xls
.xls
.xls.xls
PC.xls
.xls
.xls.xls
PC
.xls
.xls
.xls.xls
Legacy
Current
Lodestar
EMMS
PC
MS Access .xls
.xls
.xls
.xls
PC
MS Access .xls
.xls
.xls
.xls
PC
MS Access .xls
.xls
.xls
.xls
Business Logic
…
Data Modeling and Analysis
Data Warehouse Marts
Business Intelligence
ODS
TCH
Siebel
CDW
Proposed
Lodestarlodstar
EMMSomsappdev
EMMSercot
EMMShis_user
ETSData Mart
PC
.xls
.xls
.xls
.xls
PC
.xls
.xls
.xls
.xls
PC
.xls
.xls
.xls
Data Modeling and Analysis
Potential External Data Source Additions
Business Intelligence
RSS ODS
CDW
PC
.xls
.xls
.xls
.xls
PC
.xls
.xls
.xls
.xls
PC
.xls
.xls
.xls
Census
Geographic
DetailedWeather
Business Intelligence & Reporting
Centralized view foundation Provides standardized querying of all data Secure - Prevents direct access to the ODS database objects Ensures all private data is protected by the ODS security layer
Application Security
Operational Data Store (ODS)
API
Views APIRef Cursor
In-Bound
Out-Bound
Application Security
Conformed Data Warehouse (CDW)
API
Views APIRef Cursor
In-Bound
Out-Bound
Business Intelligence & Reporting
Web-based tool for universal use
B.I. tool allows “drilling-thru” to lower levels of granularity
Extremely efficient for quickly & visually going from “10,000 foot” view to “extreme close-up”
Prompts provide a way quickly choosing your selection criteria
Operational DataStores
ReplicatedSource Systems
Source Systems
EIS Systems & Applications
ETS
Report Net
SummaryReporting
Business Intelligence Foundation
Application Replication & Security Framework
Security Foundations
Standard Views
Standard APIs
Custom Views
Custom APIs & BLAPIs
Application Administration
Data Delivery Module (DDM)
Web Service Based Data Delivery
Lodestar ODS
EMMS ODS
TCR ODS
EIS System Transition
Siebel ODS
Paperfree ODS
TCH ODS
Lodestar RSS
EMMS RSS
Lodestar
EMMS
TCR
Siebel
Paperfree
TCH
Siebel RSS
Paperfree RSS
TCH RSS
DetailedReporting
Extracts
Data Mart
Data Mart
Data Mart
Real-TimeReporting
ConformedData Warehouse
(CDw)
DataTransparency
T
D
6
D
D
6
6
66
6
6
6
D
Current Project Relationships
40042_07EDW EMMS ODS
50001_02Price Spike Analysis
50001_03Replacement Reserves
Market Ad Hoc Reporting
50001_04Ad Hoc Access to QSE
Down-Balancing ComplianceReport Data
40100RTCA Archiving
40084Outage SchedulerEnhancements P2
40098Performance Monitoring forSCADA / State Estimator
30183_01R4 Project Rollover
30105Congestion Management
Reports
30084CSC Thermal & Volt Limits
Calculations / Posting
40015_02TCR Report Enhancements
50004EDW BI Reporting Tool
50017CO – Collateral Calculation
40072MPCE Correction
50024Enhancements to SCR727
50121_03Market Information
Distribution
50005EDW EMMS Reports
50030EDW Lodestar & EMMS
Transition
50023Potential Load Loss
50025Enhance ESI ID Look-Up
Function
40042_06EDW Standard LodeStar
Extracts
MO - 40104Zero Charge
Enhancements
30026EPS Meter Data (RID)
40007SCR 727 Phase II
MO - 40044ADAM Integration
50007Enhancements to Fas Trak
Tools
50002MOMS – Enhancements to
Potomac Software
50003MOMS – Enhancements to
AREVA Study Tools
2005 EIS ProjectRelationships
40108Disclosure of Local
Congestion
50001_01Ancillary Services
Stand-Alone Projects
P
P
P
P
P
P
P
P
Initiated Project
Completed Project
Cancelled or Deferred Project
Planning Project
Executing Project
Legend
MO
CO
SO
IO
RO
Project NOT Started
P Affected by Parsing
P
Proposed 2006 EIS Projects
Source Committee Src Doc Project Proj. No. Impact Area
Add'l Info
PriorityRan
k
PUCT IO EDW BI Foundation P2 - Repl Reserves Market Ad-hoc Reporting 50001_03 Market
Monitoring
EDW 1.1a 22
PUCT IO EDW BI Foundation P2 - Ad-hoc Access to QSE Rpt Data 50001_04 Market
Monitoring
EDW 1.1a 23
PUCT IO EIS BI Foundations III New Market
Monitoring
EDW 1.1a 24
PUCT IO EIS Conformed Data Warehouse Foundations New Market
Monitoring
EDW 1.1a 27
PUCT IO EIS CDW Data Marts New Market
Monitoring
EDW 1.1a 28
ERCOT RO EDW Siebel Transition 50059 Infrastructure EDW 1.1b 48
ERCOT RO EDW TCH (Transaction Clearinghouse) Transition 50060 Infrastructure EDW 1.1b 49
ERCOT RO EDW EAI Transition (inc. PaperFree & NAESB) 50061 Infrastructure EDW 1.1b 50
ERCOT RO ETS (ESIID Tracking System) Transition to EDW 50088 Infrastructure EDW 1.1b 51
ERCOT IO EDW Lodestar Decommission 50030 Infrastructure EDW 1.1b 67
ERCOT IO EDW EMMS Decommission 50031 Infrastructure EDW 1.1b 68
ERCOT IO EIS Reporting Tool II New Market
Monitoring
EDW 1.1b 69
ERCOT MO Lodestar Web Services New Market Impact EDW 1.2 93
Current ODS Statistics
Migration - ~2 billion historical transactions from Lodestar and EMMS Replication – no lost information to date
Daily Average ~15 million transactions Total transactions posted
Developed/Installed Code Base
Source System Replicated
LODSTAR 1,273,023,928
EMMS 890,651,313
HIS_USER 181,868,288
2,345,543,529
Object Count Lines
INDEX 787
PACKAGE 1,501 150,935
PACKAGE BODY 1,500 610,481
PROCEDURE 682 45,400
TABLE 794
TRIGGER 762 69,763
VIEW 3,535 103,208
9,561 979,787
Conclusion
Comments? Questions? Thank You!
