NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

62
NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC TALKING ABOUT THESE TRAFFIC STOPPERS STOPPERS

Transcript of NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

Page 1: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 1

WE PROBABLY COULD HAVE MORE WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE FUN TALKING ABOUT THESE

TRAFFIC STOPPERSTRAFFIC STOPPERS

WE PROBABLY COULD HAVE MORE WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE FUN TALKING ABOUT THESE

TRAFFIC STOPPERSTRAFFIC STOPPERS

Page 2: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 2

WHO CLEARLY HAVE WHO CLEARLY HAVE THE RIGHT OF WAY!THE RIGHT OF WAY!

BUT…BUT…

Page 3: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 3

DESIGNING SURVEYS OVER DESIGNING SURVEYS OVER TIMETIME

(PANEL (PANEL SURVEYS)SURVEYS)VARIANCE, POWER and RELATED VARIANCE, POWER and RELATED

TOPICSTOPICS

DESIGNING SURVEYS OVER DESIGNING SURVEYS OVER TIMETIME

(PANEL (PANEL SURVEYS)SURVEYS)VARIANCE, POWER and RELATED VARIANCE, POWER and RELATED

TOPICSTOPICS

N. Scott UrquhartN. Scott UrquhartSenior Research ScientistSenior Research ScientistDepartment of StatisticsDepartment of Statistics

Colorado State UniversityColorado State UniversityFort Collins, CO 80527-1877Fort Collins, CO 80527-1877

Page 4: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 4

BRIEF COMMENTS ON MONITORINGBRIEF COMMENTS ON MONITORINGBRIEF COMMENTS ON MONITORINGBRIEF COMMENTS ON MONITORING

Monitoring is a long-term endeavor for most Monitoring is a long-term endeavor for most (living) natural resources(living) natural resources

Think of it as a legacy for your grandchildren

Many of you have tried to use solid data someoneMany of you have tried to use solid data someoneelse gathered, but documented poorly.else gathered, but documented poorly.

Much good data “dies” when the person who gathered it dies or retires!

Monitoring data requires three things to retain itsMonitoring data requires three things to retain itsvalue:value:

Metadata Storage in a retrievable, maintained, data system Backed up – safe from fires, floods, or earthquakes

Page 5: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 5

SHORT OUTLINE OF THE REST OF SHORT OUTLINE OF THE REST OF THIS TALKTHIS TALK

SHORT OUTLINE OF THE REST OF SHORT OUTLINE OF THE REST OF THIS TALKTHIS TALK

Inference Perspectives & monitoringInference Perspectives & monitoring

Trend, Variance Structures, and Power to Detect TrendTrend, Variance Structures, and Power to Detect Trend

Panels and Panel StructuresPanels and Panel Structures

Putting it all together = Power Curves Putting it all together = Power Curves {and standard errors of estimated current status}{and standard errors of estimated current status}

Status Estimates from Data Over YearsStatus Estimates from Data Over Years

Page 6: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 6

INFERENCE PERSPECTIVESINFERENCE PERSPECTIVESINFERENCE PERSPECTIVESINFERENCE PERSPECTIVES

Design BasedDesign Based Inferences rest on the probability structure

incorporated in the sampling plan Completely defensible; very minimal assumptions Limiting relative to using auxiliary information

Model AssistedModel Assisted Uses models to complement underlying sampling

structure Has opportunities for use of auxiliary information

Model Based (eg: spatial statistics)Model Based (eg: spatial statistics) Ignores sampling plan Defensibility lies in defense of model

Page 7: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 7

APPROACH OF THIS PRESENTATIONAPPROACH OF THIS PRESENTATIONAPPROACH OF THIS PRESENTATIONAPPROACH OF THIS PRESENTATION

Use tools from the arena ofUse tools from the arena of Model-assisted and Model-based analyses

To study the performance of To study the performance of Design based & Model-assisted analyses

WHY?WHY? Without models,

performance evaluations need simulation (Steve

Garman’s topic)

Before substantial data have been gatheredBefore substantial data have been gathered Minimal basis for values to enter into simulation studies

Page 8: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 8

STATUS & TRENDS OVER TIME STATUS & TRENDS OVER TIME IN ECOLOGICAL RESOURCES IN ECOLOGICAL RESOURCES

OF A REGIONOF A REGION

MAJOR POINTSMAJOR POINTS

STATUS & TRENDS OVER TIME STATUS & TRENDS OVER TIME IN ECOLOGICAL RESOURCES IN ECOLOGICAL RESOURCES

OF A REGIONOF A REGION

MAJOR POINTSMAJOR POINTS

Regional trend Regional trend site trend site trend Detection of trend requires substantial elapsed timeDetection of trend requires substantial elapsed time

Regional OR intensive site

Almost all indicators have substantial patterns inAlmost all indicators have substantial patterns intheir variabilitytheir variability

Design to capitalize on this; don’t fight it.

Minimize effect of site variability with plannedMinimize effect of site variability with plannedrevisits – specific plans will be illustratedrevisits – specific plans will be illustrated

Design tradeoffs: TREND Design tradeoffs: TREND vs vs STATUSSTATUS

Page 9: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 9

REGIONAL TREND REGIONAL TREND SITE TREND SITE TREND

The predominant theme of ecology:The predominant theme of ecology: Ecological processes How does a specific kind of ecosystem function

Energy flows Food webs Nutrient cycling

Most studies of such functions must be Temporally intensive

– What material goes from where to where? Consequently spatially restrictive

In this situation: Temporal trend = site trend

Page 10: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 10

REGIONAL TREND REGIONAL TREND SITE TREND SITE TREND( - CONTINUED)( - CONTINUED)

The predominant theme of ecologyThe predominant theme of ecologyversusversus

A Substantial (any) Agency Focus:A Substantial (any) Agency Focus: All of an ecological resource

In an area or region Across all of the variability present there

For Example, National Park ServiceFor Example, National Park Service All riparian areas in Olympic National Park All riparian areas in National Parks in the

coastal Northwest

Page 11: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 11

TREND ACROSS TIME - What is it?TREND ACROSS TIME - What is it?

Any response which changes across time in a Any response which changes across time in a generally generally

Increasing or Decreasing

Manner shows trendManner shows trend Monotonic change is not essential.

If trend of this sort is present, If trend of this sort is present, it WILL BE detectable as linear trend.it WILL BE detectable as linear trend.

This does NOTNOT mean trend must be linear (examples follow)

Any specified form is detectable Time = years, here

Page 12: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 12

TREND ACROSS TIME - What is it?TREND ACROSS TIME - What is it?(continued)(continued)

TREND = YES

50

70

90

1989 1991 1993 1995

Year

TREND = NO; PATTERN = YES

50

70

90

1989 1991 1993 1995 1997

Year

TREND = YES, PATTERN = YES

0

50

100

150

200

250

300

350

400

1955 1965 1975 1985 1995 2005

YEAR

CA

RB

ON

DIO

XID

E

CO

NC

EN

TR

AT

ION

(p

pm

)

TREND = NO; PATTERN = YES

0

50

100

150

200

250

300

350

1955 1965 1975 1985 1995 2005

YEAR

CA

RB

ON

DIO

XID

E

CO

NC

EN

TR

AT

ION

(p

pm

)

Page 13: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 13

TREND = NO; PATTERN = YES

0

50

100

150

200

250

300

350

1955 1965 1975 1985 1995

YEAR

DE

TR

EN

DE

D C

AR

BO

N D

IOX

IDE

C

ON

CE

NT

RA

TIO

N (

pp

m)

Page 14: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 14

TREND DETECTION REQUIRES TREND DETECTION REQUIRES SUBSTANTIAL ELAPSED TIMESUBSTANTIAL ELAPSED TIME

IT IS NEARLY IMPOSSIBLE TO DETECT IT IS NEARLY IMPOSSIBLE TO DETECT TREND IN LESS THAN FIVE YEARS. WHY?TREND IN LESS THAN FIVE YEARS. WHY?

2

2ˆ( )

( )i

vart t

( )t ti 2

Page 15: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 15

POPULATION VARIANCE: POPULATION VARIANCE:

YEAR VARIANCE:YEAR VARIANCE:

RESIDUAL VARIANCE:RESIDUAL VARIANCE:

2( )SITE

2( )YEAR

VARIANCE HAS A LOT OF STUCTUREVARIANCE HAS A LOT OF STUCTUREIMPORTANT COMPONENTS OF VARIANCEIMPORTANT COMPONENTS OF VARIANCE

2( )RESIDUAL

Page 16: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 16

HOW SHOULD YOU ESTIMATE HOW SHOULD YOU ESTIMATE VARIANCE?VARIANCE?

HOW SHOULD YOU ESTIMATE HOW SHOULD YOU ESTIMATE VARIANCE?VARIANCE?

Alternatives:Alternatives: Designed-based

Horwitz-Thompson – extremely variable = don’t use Local Neighborhood Variance Estimator (NBH) – Stevens

– Gives estimate of variance something like residual component of variance, only

– Power nearly impossible to evaluate in this context

Model-assisted Linear models – Urquhart & Courbois (& Williams, now) Gives estimates of site, year and residual variances

Which should you use?

Page 17: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 17

We really aren’t sure, but this topic is underWe really aren’t sure, but this topic is underactive investigationactive investigation

Don Stevens and I are good friends, so this topicDon Stevens and I are good friends, so this topic isn’t a professional conflict. isn’t a professional conflict.

We both want to know the answer!

Results by Courbois (JABES, 2004) suggest this:Results by Courbois (JABES, 2004) suggest this: Unless response values and inclusion probabilities (p)

are highly correlated, they (p) can be ignored.

If this stands up, as I expect it to, practically, linear model estimates of components of variance will be fine.

Answer expected by summer.

HOW SHOULD YOU ESTIMATE HOW SHOULD YOU ESTIMATE VARIANCE?VARIANCE?

(Continued)(Continued)

Page 18: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 18

POPULATION VARIANCE: POPULATION VARIANCE:

Variation among values of an indicator (response) across all sites in a park or group of related parks, that is, across a population or subpopulation of sites

2( )SITE

IMPORTANT COMPONENTS OF VARIANCEIMPORTANT COMPONENTS OF VARIANCE( - CONTINUED)( - CONTINUED)

Page 19: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 19

YEAR VARIANCE: YEAR VARIANCE:

Concordant variation among values of an indicator (response) across years for ALLALL sites in a regional population or subpopulation

NOT variation in an indicator across years at a single site

Detrended remainder, if trend is present Effectively the deviation away from the trend line (or other

curve)

2( )YEAR

IMPORTANT COMPONENTS OF VARIANCEIMPORTANT COMPONENTS OF VARIANCE( - CONTINUED II)( - CONTINUED II)

Page 20: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 20

Residual component of varianceResidual component of variance

Has several contributors

Year*Site interaction This contains most of what ecologists would call year to year

variation, i.e. the site specific part

Index variation Measurement error Crew-to-crew variation

(minimize with well documented protocols and training)

Local spatial = protocol variation Short term temporal variation

IMPORTANT COMPONENTS OF VARIANCEIMPORTANT COMPONENTS OF VARIANCE( - CONTINUED - III)( - CONTINUED - III)

2( )RESIDUAL

Page 21: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 21

SOURCE OF DATA FOR ESTIMATES SOURCE OF DATA FOR ESTIMATES OF COMPONENTS OF VARIANCEOF COMPONENTS OF VARIANCE

EMAP Surface Waters: EMAP Surface Waters: Northeast Lakes Pilot 1991 - 1994 Northeast Lakes Pilot 1991 - 1994

About 450 observationsAbout 450 observations Over four years Including about 350 distinct lakes Design allowed estimation of several residual

components Lakes illustrate what is generally referred to Lakes illustrate what is generally referred to

in this presentation as “sites.”in this presentation as “sites.” Similar patterns appear in other data sets

Both aquatic and terrestrial

Page 22: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 22

COMPOSITION OF TOTAL VARIANCE - NE LAKES

0.00 0.20 0.40 0.60 0.80 1.00

Maximum Temperature

Ln( # rotifer taxa)

Ln( # zooplankton taxa)

Ln(Chlorophyll A)

Ln(Total Phosphorus)

Ln(Total Nitrogen)

Secchi Depth

pH(Closed system)

Ln(Chloride)

Ln(Conductance)

Acid Neutralizing Capacity

PROPORTION OF VARIANCE

RESIDUAL COMPONENT OF VARIANCE

LAKE COMPONENT OF VARIANCE

YEAR

Page 23: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 23

ALL VARIABILITY IS OF INTERESTALL VARIABILITY IS OF INTEREST

The site component of variance is one of the majorThe site component of variance is one of the majordescriptors of the regional populationdescriptors of the regional population

The year component of variance often is small, tooThe year component of variance often is small, toosmall to estimate. It is a major enemy forsmall to estimate. It is a major enemy fordetecting trend over time.detecting trend over time.

If it has even a moderate size, “sample size” reverts to the number of years.

In this case, the number of visits and/or number of siteshas no practical effect.

Page 24: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 24

ALL VARIABILITY IS OF INTERESTALL VARIABILITY IS OF INTEREST( - CONTINUED)( - CONTINUED)

Residual variance characterizes the inherentResidual variance characterizes the inherentvariation in the response or indicator.variation in the response or indicator.

But some of its subcomponents may contain But some of its subcomponents may contain useful management informationuseful management information

CREW EFFECTS ===> training VISIT EFFECTS ===> need to reexamine definition of

index (time) window or evaluation protocol MEASUREMENT ERROR ===> work on

laboratory/measurement problems

Page 25: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 25

DESIGN TRADE-OFFS: TREND DESIGN TRADE-OFFS: TREND vs vs STATUSSTATUS

How do we detect trend in spite of all of thisHow do we detect trend in spite of all of thisvariation?variation?

Recall two old statistical “friends.”Recall two old statistical “friends.” Variance of a mean, and Blocking

Page 26: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 26

DESIGN TRADE-OFFS: TREND DESIGN TRADE-OFFS: TREND vs vs STATUSSTATUS( - CONTINUED)( - CONTINUED)

VARIANCE OF A MEAN:VARIANCE OF A MEAN:

Where m members of the associated population have been randomly selected and their response values averaged.

Here the “mean” is a regional average slope, so "2" refers to the variance of an estimated slope ---

var meanm

( ) 2

Page 27: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 27

DESIGN TRADE-OFFS: TREND DESIGN TRADE-OFFS: TREND vs vs STATUSSTATUS( - CONTINUED - II)( - CONTINUED - II)

ConsequentlyConsequently

BecomesBecomes

Note that the regional averaging of slopes has theNote that the regional averaging of slopes has thesame effect as continuing to monitor at one site same effect as continuing to monitor at one site

forfora much longer time period.a much longer time period.

var meanm

( ) 2

var regional mean slopem t ti

( )( )

1 2

2

Page 28: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 28

DESIGN TRADE-OFFS: TREND DESIGN TRADE-OFFS: TREND vs vs STATUSSTATUS( - CONTINUED - III)( - CONTINUED - III)

Now, Now, 22, in total, frequently is large., in total, frequently is large.

If we take one regional sample of sites at one time,If we take one regional sample of sites at one time,and another at a subsequent time, the siteand another at a subsequent time, the sitecomponent of variance is included in component of variance is included in 22..

Enter the concept of blocking, familiar fromEnter the concept of blocking, familiar fromexperimental design.experimental design.

Regard a site like a block Periodically revisit a site The site component of variance vanishes from the

variance of a slope.

Page 29: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 29

PANEL DESIGNSPANEL DESIGNSPANEL DESIGNSPANEL DESIGNS

Question: “ What kind of temporal design shouldQuestion: “ What kind of temporal design shouldyou use for National Parks?you use for National Parks?

A Panel is a Set of Sites which have the same A Panel is a Set of Sites which have the same Revisit ScheduleRevisit Schedule

Each panel ordinarily should have as good a spatial coverage as possible (GRTS)

You have many usable and defensible temporalYou have many usable and defensible temporaldesignsdesigns

Choose one which fits your needs and resources Evaluation tools are available, and demonstrated here

Page 30: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 30

A SINGLE PANELA SINGLE PANELA SINGLE PANELA SINGLE PANEL

Conventional for trend detectionConventional for trend detection Not very good for statusNot very good for status (Call this design 1)(Call this design 1)

NUM NUM OBSOBS YEARYEAR

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 2020 2121

1111 XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX XX

Page 31: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 31

AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)

NUMNUM

OBSOBSYEARSYEARS

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 ……

5 X X X X X X X X X X X X X X X X X X X …

Add sites to the above annual revisit plane, asAdd sites to the above annual revisit plane, as

Page 32: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 32

AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)AN “AUGMENTED” PANEL PLAN (Design 2)NUMNUM

OBSOBSYEARSYEARS

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 ……

5 X X X X X X X X X X X X X X X X X X X …

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

6 X

… …

Page 33: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 33

A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) NUMNUM

OBSOBSYEARSYEARS

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 ……

5 X X

5 X

5 X

5 X

Page 34: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 34

A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) NUMNUM

OBSOBSYEARSYEARS

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 ……

5 X X

5 X

5 X

5 X

4 X X X X X

1 X X X X X

1 X X X X X

1 X X X X …

Page 35: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 35

A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) A POSSIBLE NPS PANEL PLAN (Design 3) NUMNUM

OBSOBSYEARSYEARS

11 22 33 44 55 66 77 88 99 1010 1111 1212 1313 1414 1515 1616 1717 1818 1919 ……

5 X X

5 X

5 X

5 X

4 X X X X X

1 X X X X X

1 X X X X X

1 X X X X …

2 X X X X

1 X X X X

1 X X X X

1 X X …

2 X X

1 X X

1 X X

1 X X

2 X X

… …

Page 36: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 36

WHY LOOK AT POWER?WHY LOOK AT POWER?WHY LOOK AT POWER?WHY LOOK AT POWER?

Power provides a tool for comparing various designs Power provides a tool for comparing various designs Looking at it does not imply that we have to conduct Looking at it does not imply that we have to conduct

tests of hypothesestests of hypotheses The computations displayed here use The computations displayed here use

A components of variance statistical model To evaluate the underlying variances of estimated slopes And the temporal design being considered

These computations are much more complex, andsuitable to your problems, than any of the web-available tools

Use of those tools here would commit “sins of pseudoreplication”!

Page 37: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 37

0

0.2

0.4

0.6

0.8

1

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

Page 38: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 38

0

0.2

0.4

0.6

0.8

1

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

Page 39: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 39

0

0.2

0.4

0.6

0.8

1

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

Design 3: A NPS proposal, n varies from 3 to 12

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

Page 40: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 40

0

0.2

0.4

0.6

0.8

1

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

Design 3: A NPS proposal, n varies from 3 to 12

Design 2A: Augmented n = 3 + 2 or 3

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

POWER FOR DESIGNS 1 – 3, & 2A POWER FOR DESIGNS 1 – 3, & 2A WITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{large is good}{large is good}

Page 41: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 41

0

0.1

0.2

0.3

0.4

0.5

0.6

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

Page 42: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 42

0

0.1

0.2

0.3

0.4

0.5

0.6

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

Page 43: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 43

0

0.1

0.2

0.3

0.4

0.5

0.6

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

Design 3: A NPS proposal, n varies from 3 to 12

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

Page 44: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 44

0

0.1

0.2

0.3

0.4

0.5

0.6

0 5 10 15 20 25 30

Elasped Years

Po

wer

fo

r T

ren

d D

etec

tio

n

Design 1: One panel n = 11

Design 2: Augmented, n = 5 + 6

Design 3: A NPS proposal, n varies from 3 to 12

Design 2A: augmented n = 3 + 2 or 3

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

STANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2ASTANDARD ERROR OF STATUS FOR DESIGNS 1 – 3, & 2AWITH PARAMETER CONDITIONS BILLY GAVEWITH PARAMETER CONDITIONS BILLY GAVE

{small is good}{small is good}

Page 45: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 45

DESIGN 3 – A PROPOSED NPS DESIGN 3 – A PROPOSED NPS TEMPORAL DESIGN??TEMPORAL DESIGN??

DESIGN 3 – A PROPOSED NPS DESIGN 3 – A PROPOSED NPS TEMPORAL DESIGN??TEMPORAL DESIGN??

Defensible design, given restrictions ofDefensible design, given restrictions of Field resources = # sites visited per year Need to split field resources across two type of

aquatic systems: Streams Wetlands

Page 46: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 46

STATUS ESTIMATES STATUS ESTIMATES FROM DATA OVER YEARSFROM DATA OVER YEARS

STATUS ESTIMATES STATUS ESTIMATES FROM DATA OVER YEARSFROM DATA OVER YEARS

Idea: Idea: Estimate year effects, and Adjust all sites to the latest year Idea very similar to “adjusted treatment means”

in the analysis of covariance For example, if a line approximates the trend,For example, if a line approximates the trend,

The array of { Sitei + (yearnow – yearinitial)slope } Describes current status, accounting for documented

trend This approach extends to models other than lines.

Linkage of site revisits (=connectedness) is necessaryLinkage of site revisits (=connectedness) is necessaryto allow estimation of all differences in year effectsto allow estimation of all differences in year effects

Page 47: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 47

This research is funded by

U.S.EPA – Science To AchieveResults (STAR) ProgramCooperativeAgreement

# CR - 829095

The work reported here today was developed under the STAR Research Assistance Agreement CR-829095 awarded by the U.S. Environmental Protection Agency (EPA) to Colorado State University. This presentation has not been formally reviewed by EPA.  The views expressed here are solely those of presenter and STARMAP, the Program he represents. EPA does not endorse any products or commercial services mentioned in this presentation.

FUNDING ACKNOWLEDGEMENT

Page 48: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 48

RELATED INFORMATION ON THE WEBRELATED INFORMATION ON THE WEBRELATED INFORMATION ON THE WEBRELATED INFORMATION ON THE WEB

Web-available information from a graduate course in environmental Web-available information from a graduate course in environmental Sampling (ST571) I taught at OSUSampling (ST571) I taught at OSU

http://oregonstate.edu/instruct/st571/urquhart/index.html Environmental Sampling Anatomy Variable Probability Sampling Cost Effective Resource Allocation Sampling Macroinvertebrates Maps & Grids Spatial Sampling Support Regions Statistical Power - Concepts Power to Detect Trend in Ecological Resources Representative Sampling Statistical Aspects of Taxonomic Richness Sample Size to Estimate Taxonomic Richness Evaluating a Protocol for "Measuring" Physical Habitat

Also see: Also see: http://www.stat.colostate.edu/starmap/http://www.stat.colostate.edu/starmap/ Also see NPS I&M site, from Port Angeles meeting, 2003Also see NPS I&M site, from Port Angeles meeting, 2003

Page 49: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 49

VISUALIZING LINES AND VISUALIZING LINES AND YEAR EFFECTSYEAR EFFECTS

VISUALIZING LINES AND VISUALIZING LINES AND YEAR EFFECTSYEAR EFFECTS

N. Scott UrquhartN. Scott UrquhartSTARMAPSTARMAP

Colorado State UniversityColorado State UniversityFort Collins, Co 80523-1877Fort Collins, Co 80523-1877

Page 50: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 50

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

WHAT WE SEE – NO LINES & WHAT WE SEE – NO LINES & NO DECOMPOSITIONNO DECOMPOSITION

WHAT WE SEE – NO LINES & WHAT WE SEE – NO LINES & NO DECOMPOSITIONNO DECOMPOSITION

Page 51: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 51

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINEA LINEA LINEA LINE

Page 52: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 52

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINE WITH YEAR EFFECTSA LINE WITH YEAR EFFECTSA LINE WITH YEAR EFFECTSA LINE WITH YEAR EFFECTS

Page 53: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 53

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINE WITH YEAR EFFECTS & A LINE WITH YEAR EFFECTS & ANNUAL RESIDUALSANNUAL RESIDUALS

A LINE WITH YEAR EFFECTS & A LINE WITH YEAR EFFECTS & ANNUAL RESIDUALSANNUAL RESIDUALS

Page 54: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 54

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINE WITH ONLY ANNUAL A LINE WITH ONLY ANNUAL RESIDUALS SHOWNRESIDUALS SHOWN

A LINE WITH ONLY ANNUAL A LINE WITH ONLY ANNUAL RESIDUALS SHOWNRESIDUALS SHOWN

Page 55: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 55

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINE WITH ANNUAL RESIDUALSA LINE WITH ANNUAL RESIDUALS& END MARKERS& END MARKERS

A LINE WITH ANNUAL RESIDUALSA LINE WITH ANNUAL RESIDUALS& END MARKERS& END MARKERS

Page 56: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 56

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

A LINE WITH YEAR EFFECTS, A LINE WITH YEAR EFFECTS, JIGGERED RESIDUALS & END JIGGERED RESIDUALS & END

MARKERSMARKERS

A LINE WITH YEAR EFFECTS, A LINE WITH YEAR EFFECTS, JIGGERED RESIDUALS & END JIGGERED RESIDUALS & END

MARKERSMARKERS

Page 57: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 57

A REALITYA REALITYA REALITYA REALITY

With a single siteWith a single site The year effect And residual effect Can not be separated

But with several sitesBut with several sites These effects can be separated

Following figures show the patternsFollowing figures show the patterns

Page 58: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 58

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

TWO LINESTWO LINESTWO LINESTWO LINES

Page 59: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 59

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

TWO LINES WITH YEAR EFFECTSTWO LINES WITH YEAR EFFECTSTWO LINES WITH YEAR EFFECTSTWO LINES WITH YEAR EFFECTS

Page 60: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 60

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

TWO LINES WITH YEAR EFFECTS & TWO LINES WITH YEAR EFFECTS & JIGGERED RESIDUALSJIGGERED RESIDUALS

TWO LINES WITH YEAR EFFECTS & TWO LINES WITH YEAR EFFECTS & JIGGERED RESIDUALSJIGGERED RESIDUALS

Page 61: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 61

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

TWO LINES WITH YEAR EFFECTS & TWO LINES WITH YEAR EFFECTS & JIGGERED RESIDUALS – ONLY SOME YEARSJIGGERED RESIDUALS – ONLY SOME YEARS

TWO LINES WITH YEAR EFFECTS & TWO LINES WITH YEAR EFFECTS & JIGGERED RESIDUALS – ONLY SOME YEARSJIGGERED RESIDUALS – ONLY SOME YEARS

Page 62: NPS Conference 2006 # 1 WE PROBABLY COULD HAVE MORE FUN TALKING ABOUT THESE TRAFFIC STOPPERS.

NPS Conference 2006 # 62

0

2

4

6

8

10

12

0 5 10 15 20

YEARS

RE

SP

ON

SE

VA

LU

ES

WHAT WE SEE – NO LINES & WHAT WE SEE – NO LINES & NO DECOMPOSITIONNO DECOMPOSITION

WHAT WE SEE – NO LINES & WHAT WE SEE – NO LINES & NO DECOMPOSITIONNO DECOMPOSITION