R8’s Transition to WQX(Abridged)

Michael PippMontana DEQ

2007 STORET/WQX User’s Conference

Austin, Texas

R8 WQX Transition Project Schedule

2007 2008 2009

O N D J F M A M J J A S O N D J F M A

Contract Awarded

Kick-off meeting

Project Plan Delivered

Design Document Delivered

Database Delivered

Beta Application

Beta Test Period

Production Application Delivered

Production Test Period

Montana’s Current STORET-based Data Flow

National STORET Warehouse

Web SIM Montana

Regional STORET Warehouse

DEQ Staff Collected Field

Data

DEQ Data Management

System (SUDS)

SIM Local STORET

STORET Reports

Pre-Planning Documents

(SAP, Workplan)

Lab Results

Externally Collected Field

Data

Contractor Data

Management System

Contracted Workplan & SAP

Lab Results

Data Consumption (Data Use &

Decision Making)

GranteeData

DEQ’sData

System Overview

National WQX Data Store

CDX

LOCAL NODE

XML

Local WQX based dBData

Management System

WQX App(XML Translator)

View

Input

XML

Email

WQX App(Validation Engine )

WQX App (WQX Loader)

Log File

View

Edit

WQX App (U/I)

Contractor Data

Management System

Email

Web XML Generator

View / print

FLAT FILE

Report

BATCH LOAD TOOL (Internal Data)

To be Developed

Flat File

1

2

3

4

5

6National WQX/STORET WarehouseCDX

ENODE

XML

Local WQX based dBStates Data Management System

BLT (XML Generator)

XML

Email

BLT (Validation Engine )

BLT (WQX Loader)

Log File

FUNCBLT (U/I)

BATCH LOAD TOOL (Outside Data )

National WQX/STORET WarehouseCDX

ENODE

XML

Local WQX based dB

DEQ Data Management

System (BF/DZ/SD)

BLT (XML Translator)

XML

Email

BLT (Validation Engine )

BLT (WQX Loader)

Log File

FUNC

BLT (U/I)

BLT ( Web Interface ? )

Contractor Data

Management System

Web XML Generator

XMLFLAT

2

1

3

6

5

4

Field Data Exchange Network

RAW DATA

PROCESS & EXPORT

WQX Local Database

Local DMSWQX/STORET

Data StoreWQX Load & View

ApplicationWQX Load & View

Application

DATA FILE

BATCHLOAD

VIEW / EDIT

XML FILE

VALIDATIONLOGDATA LOAD

XMLGENERATION

DELIMITEDEXPORT

R8 WQX Data Management dB - Simplified

Basic Design Requirements

1. WQX v2.0 Plus (core schema) 1. R8 Additional Fields:

1. Personnel2. Station establishment date3. Travel Directions4. Affiliation of Personnel5. Lab Batch ID6. Lab Sample ID

2. Database Platform1. Oracle (primary)2. SQL Server (secondary)

3. Locally-added and managed tables

LocalWQX dB

WQX v2.0 (.R8)

R8 WQX Data Management Tool - Simplified

Local Data Management Tool / Apps.

WQ Data BatchValidation, Load, View, & Edit Tool

(Web-based)

.txt

Exchange

Network

Exchange

Network

.xmlBasic Design

Requirements1. .Net framework (C#)2. Full validation of WQX v2.0

business rules3. Data visualization4. dB Dependent (Oracle)5. Audit Tracking6. Flexible to recognize custom

WQX schema add-ons7. Partial data loads (2)8. Translations (2)9. Error reporting (2)10.XML Generation (3)

LocalWQX dB

National CDX / WQX

System

Questions?

“Everything that exists in time,runs out of time some day…”

Bruce CockburnMighty Trucks Of Midnight

from Nothing But A Burning Light