EnviroInsite training workshop - Database fundamentals

35
Understanding Data Flow EnviroInsite Training Workshop HydroAnalysis, Inc.

description

Presentation from EnviroInsite training workshop covering data flow and database schema used by EnviroInsite

Transcript of EnviroInsite training workshop - Database fundamentals

Page 1: EnviroInsite training workshop - Database fundamentals

Understanding Data Flow

EnviroInsite Training WorkshopHydroAnalysis, Inc.

Page 2: EnviroInsite training workshop - Database fundamentals

Data Flow

EnviroInsite Database

EI Data

Well Id

Wells

Well Id, Coordinates, surface elevation, top casing elevation, class

Screens

Well Id, Screen Id, top/bottom elevations

Observations

Well Id, Screen Id, Date, Constituent, Media, Fraction, Value, Formatted ValueWell Id

Screen Id

Constituents

Constituent, Media, Fraction, Units, Standard Name, Standard

ConstituentMedia

Fraction

Page 3: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Wells Table

Field Content / Comments Type

Well Well id Text

Easting Consistent coordinate system, can be left blank

Numeric

Northing Consistent coordinate system Numeric

Surface Elevation Screen depth relative to this elevation

Numeric

Top of Casing Can be left blank Numeric

Well Bottom Elevation

Elevation of bottom of hole Numeric

Page 4: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Wells Table

Field Content / Comments Type

Class User-specified category used for querying data

Text

Azimuth Slope direction clockwise from due north

Numeric

Incline Well angle relative to vertical Numeric

(Optional Fields) Used in full-page boring logs Text

Page 5: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Screens Table

Field Content / Comments Type

Well Well id – must be in Wells table Text

Screen Unique id for each well Text

Top Elevation Numeric

Bottom Elevation Numeric

(Optional Fields) Used in full-page boring logs Text

Page 6: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Wells – Screens – Observations (one to many)

MW-1

D

1/1/2011, TCE, 1.0

1/1/2011, PCE, 1.0

1/1/2013, TCE, 1.0

S

1/1/2011, TCE, 1.0

Wells

Screens

Observations

Page 7: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

PCE, water, -

MW-1, D, 1/1/2001, 1

MW-2, D, 1/1/2001, 1

MW-1, S, 1/1/2001, 1

Constituents

Observations

Constituents – Observations (one to many)

Mercury, water, dissolved

MW-1, D, 1/1/2001, 1

MW-2, D, 1/1/2001, 1

MW-1, S, 1/1/2001, 1

Constituents

Observations

Page 8: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

In DatabaseWell Easting Northin

gSurface Elevation …

MW-1 23456 7890 75

MW-2 12345 6789 75

Wells

Well Screen Top Elevation

Bottom Elevation

MW-1 S 50 45

MW-1 D 0 -10

Screens

Constituent

Media Fraction Units …

Mercury Water D mg/L

PCE water - µg/L

Constituents

Well Screen

Constituent

Media

Fraction

Value …

MW-1 S Mercury Water D 2

MW-1 D Mercury Water D 1

Observations

Page 9: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What about data not at a well?

All measured data occurs at a “Well” and a “Screen”including

• Samples from a well

• Soil samples

• Air measurements

• Surface water measurements

Page 10: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What about data not at a well?

Well A Location

Screen Vertical Horizon

Page 11: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What about data not at a well?

There is an Exception!!!

• Modeled data

• Gridded data

• Any data where location not important

Data you don’t want to load in the database

Page 12: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

You Have Choices

Table Field

Wells Well Bottom Elevation

Screens Top Elevation

Bottom Elevation

Table Field

Wells Well Bottom Depth

Screens Top Depth

Bottom Depth

Elevation Based Depth Based

Convert fields by:In Excel -> Changing header cell text

In Access -> Changing field name

Page 13: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

You Have Choices

Table Field

Wells Easting

Wells Northing

Table Field

Wells Longitude

Wells Latitude

User-Specified Coordinates Lat - Long

Convert fields by:In Excel -> Changing header cell text

In Access -> Changing field name

Page 14: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

If you choose lat – long coordinates

Enter longitude as degrees east (in USA longitude < 0)

• State Plane (feet)

• Universal Transverse Mercator (meter)

Transformation of coordinates prior to plotting to either (you choose which)

Page 15: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What is Formatted Value in Observations table?

• Control over number of digits / display of data flags …

• Populating Formatted Value field is optional

• Used by:• Data Tables• Posted Values

100.00

1,000,000.00

0.01

Without Formatted Value

100.01,000,000

0.01u

With Formatted Value

Page 16: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What about non-detects?

Observations . Flag

• Populate with ND or < to indicate non-detect

Observations . Formatted Value

• Populate with text string as you want values to appear (e.g. <0.1u or ND)

Some plots need a numeric value (ie. Time Charts, pie charts, radial diagrams)

• Put value of your choice in Observations . Value

• Could be 0 or some fraction of detection limit

Page 17: EnviroInsite training workshop - Database fundamentals

Data Flow

EnviroInsite Database

EI Data

Well Id

Wells

Well Id, Coordinates, surface elevation, top casing elevation, class

Stratigraphy

Well Id, top/bottom elevations

Borings

Well Id, top/bottom elevation

Well Id

Page 18: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Borings and Stratigraphy

BoringsDetailed description of soil or geologic profile as would be reported in a boring log

Plotted in 3d, on sections, strip logs, or boring logs

No correlation of units between Borings

StratigraphyGeologist or hydrogeologist interpretation of stratigraphic units that would typically straddle multiple Borings records

Plotted in 3d, on sections, plus fence diagrams and geologic models

Correlation of units between Stratrigraphy locations is implied

Page 19: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Borings Table

Field Content / Comments Type

Well Well id – must be in Wells table Text

Strata Text

Top Elevation Numeric

Bottom Elevation Numeric

(Optional Fields) Used in full-page boring logs Text

Page 20: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Stratigraphy Table

Field Content / Comments Type

Well Well id – must be in Wells table Text

Strata Must be unique for each location Text

Top Elevation Numeric

Bottom Elevation Numeric

Page 21: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

You Have Choices

Table Field

Stratigraphy

Top Elevation

Bottom Elevation

Borings Top Elevation

Bottom Elevation

Table Field

Stratigraphy

Top Depth

Bottom Depth

Screens Top Depth

Bottom Depth

Elevation Based Depth Based

Convert fields by:In Excel -> Changing header cell text

In Access -> Changing field name

Page 22: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Be Careful When Loading Stratigraphy Data

• Don’t repeat units

B1

Sand

Clay

Sand

Clay

NO!

B1

Sand

Clay 1

Deep Sand

Clay 2

OK!

Page 23: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Hints for Entering Stratigraphy Data?

• Don’t repeat units• Be consistent

B1

Sand

Clay 1

Deep Sand

Clay 2

NO!

B1

Sand

Clay 1

Deep Sand

Clay 2

OK!

B2

Sand

Clay 1

Clay 2

Deep Sand

B2

Sand

Clay 1

Deep Sand

Clay 2

Page 24: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Hints for Entering Stratigraphy Data?

• Don’t repeat units• Be consistent• May omit layers

(inferred zero thickness) B1

Sand

Clay 1

Deep Sand

Clay 2

B2

Sand

Deep Sand

Clay 2

OK!

Page 25: EnviroInsite training workshop - Database fundamentals

Data Flow

EnviroInsite Database

EI Data

Well Id

Wells

Well Id, Coordinates, surface elevation, top casing elevation, class

Well Construction

Well Id, material, top/bottom depth, diameter, notes

Fill

Well Id, material, top/bottom depth, diameter

Well Id

We’ll come back to this in a later lesson

Page 26: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

How do I get started?

1. Let EnviroInsite do it for you

• File -> Create Database

• Elevation and North-East based (for now)

2. Copy empty files from Documents\My EnviroInsite Work

• Input.xls

• input.xlsx

• input.mdb

Page 27: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

How do I get started?

3. Borrow from Documents\My EnviroInsite Work\Tutorial

• Existing data can be modified and extra rows deleted

• In Excel – be careful to delete rows (not just cells)

• May be particularly useful for boring logs

4. Export from 3rd party database such as EQuIS or EnviroData

Page 28: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Loading Data…

Sometimes it can be hard…

Page 29: EnviroInsite training workshop - Database fundamentals

Data Flow

Populating Data Files w/o Tears

EI Data

Full Description of Database in EI Tutorial

1. Populate all linking fields

2. Populate filtering fields (e.g. Screen.Group, Well.Class, Screen.ID)

3. Double-check match of linking fields

4. Assume case-sensitivity of linking fields

Page 30: EnviroInsite training workshop - Database fundamentals

Data Flow

Populating Data Files w/o Tears

EI Data

Full Description of Database in EI Tutorial

1. Check consistency of elevation field values

2. Check consistency of depth field values

3. If you don’t know what to do and it’s not a numeric field, enter a single hyphen

4. If all else fails – [email protected]

Page 31: EnviroInsite training workshop - Database fundamentals

Data Flow

Populating MS Excel Data Files w/o Tears

EI Data

Full Description of Database in EI Tutorial

1. No non-numeric data in numeric fields

2. Preface numbers in text fields with single apostrophe ( ‘8)

Page 32: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What’s Wrong?

Well Easting Northing Class

MW-1 300 200

MW-2 100 500 Monitoring well

Wells Table

Screens Table

Well Screen Top Elevation Bottom Elevation

mw-1 d 200 300

MW-2 500 300

Page 33: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

What’s Wrong?

Constituent Media Units Standard

Cadmium Water ug/L 100

Cadmium Soil mg/kg None

Constituents Table

Observation Table

Well Screen Date Constituent Media Value

mw-1 d 20-Mar-1999

Cadmium W 300

MW-2 s Cadmium Soil 300

Page 34: EnviroInsite training workshop - Database fundamentals

EnviroInsite Training

Saving Documents

• File -> Save preserves complete session

• Document extension - vizx or xml

• Automated Backup • Complete file path of

images / database• File -> Package zips all

files into single file – to simplify file exchange

Share vizx Docume

nt

Page 35: EnviroInsite training workshop - Database fundamentals

Data Flow

Hands-on Exercise