240 10 PowerCIs
Transcript of 240 10 PowerCIs
-
8/19/2019 240 10 PowerCIs
1/51
Outside learning via UVic Geography & QQS Projects Society
Geog 453 field school: Indigenous
Knowledge, Science & Resource
Management
Application deadline: extended to Feb 29
Applicants beyond UVic welcomed
M a y 1 - 8, 2 01 6
Ko e y e R i v e r Q u e s t
io n s ?
d a r i mo n t @ u v ic.c
a
A p p l ic a t io n s o n
U v ic G eog w e b s
i t e
C hr i s D ar i mo nt – U V i c J e ss H o ust y – Q Q S
-
8/19/2019 240 10 PowerCIs
2/51
-
8/19/2019 240 10 PowerCIs
3/51
-
8/19/2019 240 10 PowerCIs
4/51
Very long lived (some spp>100 yrs)
Slow growing
Old age at maturity
Low r
Philopatric (don’t move)
Therefore very susceptibleto overfishing
-
8/19/2019 240 10 PowerCIs
5/51
Rockfish Conservation Areas
(RCAs) In Coastal British Columbia Waters
-
8/19/2019 240 10 PowerCIs
6/51
-
8/19/2019 240 10 PowerCIs
7/51
-
8/19/2019 240 10 PowerCIs
8/51
-
8/19/2019 240 10 PowerCIs
9/51
-
8/19/2019 240 10 PowerCIs
10/51
-
8/19/2019 240 10 PowerCIs
11/51
Most surveys of rockfish are by
remote video camera or diver observation
Visibility in temperate waters not often
conducive!
This would be an example of experimental
error - missing fish that are present butyou cannot see them!
-
8/19/2019 240 10 PowerCIs
12/51
SCUBA Transect
-
8/19/2019 240 10 PowerCIs
13/51
Baited Underwater Video
-
8/19/2019 240 10 PowerCIs
14/51
RCA ReferenceSite
30m SCUBA & Towed Camera TransectsBUWV stations
Record every
individual fish:
•
Species•
Size
•
Immediate Habitat
-
8/19/2019 240 10 PowerCIs
15/51
http://www.racerocks.ca/wp/administration-of-race-rocks/environmental-impacts-from-human-disturbances-to-life-at-race-rocks/illegal-fishing-in-the-rockfish-conservation-area-at-
race-rocks/
Poaching: The unknown variable
-
8/19/2019 240 10 PowerCIs
16/51
Darienne LancasterBan Lab - ES
-
8/19/2019 240 10 PowerCIs
17/51
RCA Efficacy
HO: Fish abundance inside and outside RCAs
is equivalent
Methodology
HO: SCUBA and BUWV yield similar estimates of
rockfish abundance
PoachingHO: RCA efficacy is independent of angler
non-compliance
Testing three hypotheses simultaneously
-
8/19/2019 240 10 PowerCIs
18/51
High RCA Compliance
Medium RCA Compliance
Low RCA Compliance
Multiple paired sites
across compliance gradient:
-
8/19/2019 240 10 PowerCIs
19/51
-
8/19/2019 240 10 PowerCIs
20/51
-
8/19/2019 240 10 PowerCIs
21/51
-
8/19/2019 240 10 PowerCIs
22/51
Dual Lights
Drop Line
Bait Arm(not shown)
Receptacle
Video Cable
Camera
-
8/19/2019 240 10 PowerCIs
23/51
RCA
152020
25
3040
Reference
202025
30
3550
Total 150 180Mean 25 30
Variance 80 130StanDev 8.9 11.4
Rockfish Abundance (total # fish, all spp.)
VarianceRCA = s2RCA = (20-25)2 + (40-25)2 + (15-25)2 !. + (25-25)2 / (n-1)
= (25 + 225 + 100 + 25 + 25 + 0) / 5 = 80 individuals2
Standard DeviationRCA = sRCA = "s2RCA = 8.9 individuals
What does this mean in English?
-
8/19/2019 240 10 PowerCIs
24/51
LOTS MORE SURVEYS!.
-
8/19/2019 240 10 PowerCIs
25/51
RCA
Abundances
25
If we assume our abundance data
to be normally distributed, we can make
some inferences!
We expect ~2.5% of RCAsto have very large abundances(mean + (2SD)) or
(25 + 2(8.9)) = 43 fish or more
We expect ~2.5% of RCAsto have very low abundances(>mean - (2SD)) or
(>25 - 2(8.9)) = 7 fish or less
Since abundances are normally distributed wecan expect 95% of abundances to fall within
the mean +/- 2 standard deviations
7 43
-
8/19/2019 240 10 PowerCIs
26/51
Reference
Abundances
30
If we assume our abundance data
to be normally distributed, we can make
some inferences!
We expect ~2.5% of non-RCAsto have very large abundances(mean + (2SD)) or
(30 + 2(11.4)) = 43 fish or more
We expect ~2.5% of non-RCAsto have very low abundances(>mean - (2SD)) or
(>25 - 2(11.4)) = 7 fish or less
We find the abundances arenormally distributed therefore we can
expect 95% of abundances to fall within
the mean +/- 2 standard deviations
7 53
-
8/19/2019 240 10 PowerCIs
27/51
RCAs Reference Sites
25 30
There are more fish on average in the reference sites, but is the difference
of the means great enough to declare the difference statistically significant?
-
8/19/2019 240 10 PowerCIs
28/51
A
B
We want to know if the means are different enough to conclude a statistical difference
signal A difference between group means= = = Student’s t test
noise B variance of groups
The signal has to reach a threshold greater than the noise!this threshold for adifference to be considered significant is the p-value
-
8/19/2019 240 10 PowerCIs
29/51
How do we determine when a difference
really is a difference?
Sir Ronald Fisher25 30
-
8/19/2019 240 10 PowerCIs
30/51
The “p-value”
A probability of 0.05 is just another way of sayingthe probability # 5%
Therefore if we adopt a p-value of 0.05 as the threshold
of significance, we are saying the difference we observewould occur less than 5% of the time if the populations
were really identical. We are willing to accept a 5%
chance of error.
!.or the probability that a difference as large as the one observed could haveoccurred by chance. The less likely this is, the lower the probability.
-
8/19/2019 240 10 PowerCIs
31/51
Rockfish Abundance
SCUBA (+/- SD) BUWV (+/- SD) P-value
205 (9) 265 (4) 0.04*
RCA (+/- SD) REF (+/- SD) P-value65 (15) 70 (5) 0.01**
Poaching
RCAred (+/- SD) RCAgreen (+/- SD) P-value
180 (35) 200 (45) 0.12
-
8/19/2019 240 10 PowerCIs
32/51
Misconception: The probability value is the probability thatthe null hypothesis is false.
The p value is the probability of an observed result as extreme ormore so would be observed if the null hypothesis is true. Thereforeto claim a “scientific difference” exists p
-
8/19/2019 240 10 PowerCIs
33/51
Type I errorThe error of rejecting a null hypothesis when there is no real
difference. In other words, it occurs when we observe a difference
when in truth there is none. "false positive": A false positive normally means that a test claims there to be
an effect when that is not the case.
For example, a pregnancy test with a positive result (pregnancy)
has produced a type I error if the woman is not pregnant.
Type II errorFailing to reject a null hypothesis when the alternative hypothesis
is the true state.
In other words, this is the error of failing to observe a differencewhen in truth there is one.
In the example of a pregnancy test, a type II error occurs if the
test reports negative when the woman is, in fact, pregnant."false negative":
-
8/19/2019 240 10 PowerCIs
34/51
Two salmon, same age, same food, same environment.
Treatment: One is a “normal” salmon the other has been
genetically modified to increase growth rate.
Power to detect difference increases with effect size
-
8/19/2019 240 10 PowerCIs
35/51
The power of a statistical test is the
probability that the test will [correctly]reject a false null hypothesis
In other words, if the differencebetween GM salmon and normal
salmon is real, the ability of our test to
detect that difference is its “power ”;The likelihood that Ho is correctly (in
this case) rejected.
-
8/19/2019 240 10 PowerCIs
36/51
Statistical power is a measure of the likelihood that a researcher will findstatistical significance in a sample if the effect exists in the full population.
-
8/19/2019 240 10 PowerCIs
37/51
-
8/19/2019 240 10 PowerCIs
38/51
All other things being equal
which of the following increase power?
Increasing variation
Increasing sample size
Increasing acceptable error
Increasing the magnitude of
difference between means
!
"
!
"
-
8/19/2019 240 10 PowerCIs
39/51
Group A ("A") of five
animals given onegene and each
animal’s growth
monitored
(46,42,44,45,43)
(g / day)
Group B ("B") is given a different gene
(52,80,22,30,36) (g / day)
A third set ("C") of five “normal” animals was used as controls;(i.e. no treatment) (20,23,24,19,24) (g / day).
The mean of the control group is 22 and the SD is 2.3Did treatment A have a significant effect? Did treatment B?
An example – test of transgenes on growth
-
8/19/2019 240 10 PowerCIs
40/51
95% Confidence Interval is the breadth of values needed to be sure the realparameter value (ex. population mean) is covered in 95 of 100 studies performed.
Is affected by i) sample size and ii) variation in the data
G r o w t h ( g / d
a y )
GM-A GM-B Control
-
8/19/2019 240 10 PowerCIs
41/51
The graph shows the mean for each data set (red dots).The dark lines represent the 95% confidence limits.
Although both experimental means (A and B) are twice as largeas the control mean, only the A diet produced significantly
different results. The probability that the real mean of B is thesame as the real mean of C is greater than 5%. Therefore we
cannot say B and C are significantly (aka “statistically” or
“scientifically”) different.
Confidence Interval:
An estimated range of values
with a of known probability
(here 95%) of covering the
true population mean if the
experiment were run 100
times. If CIs overlap, the
populations from which
samples were drawn
are not considered different.
-
8/19/2019 240 10 PowerCIs
42/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” different (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
43/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” difference (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”), there is no statistical difference
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
44/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” different (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
45/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” different (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
46/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” difference (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
47/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” different (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95CIs of mean rockfish abundance in Ref Sites relative to RCAs (0)
-
8/19/2019 240 10 PowerCIs
48/51
rockfish)
rockfish)
rockfish)
Are Reference sites different from RCAs? Use CIs to plot the magnitude of difference.If the CI for reference sites overlaps with “0” different (i.e. the 95% CI of the difference
between RCAs & Ref Site means includes “0”)
95%CIs of mean rockfish abundance in RCAs relative to Reference Sites (0)
-
8/19/2019 240 10 PowerCIs
49/51
Download the Mathematica CDF Player at http://www.wolfram.com/cdf/ (CDF: computable document format)
Search the CDF library for “confidence level sample size margin of error”you will see this screenshot, click it.
http://demonstrations.wolfram.com/ConfidenceIntervalsConfidenceLevelSampleSizeAndMarginOfError/
-
8/19/2019 240 10 PowerCIs
50/51
-
8/19/2019 240 10 PowerCIs
51/51
P-values are used to determine whether a null hypothesis of the study is to beaccepted or rejected, given a predetermined level of accepted error (usually 5%).
P-values enable the recognition of any statistically noteworthy findings and make explicit
the threshold for “scientific difference”.
Confidence intervals provide information about a range in which the truevalue lies with a certain degree of probability (usually 95%), as well as about the
direction and strength of the demonstrated effect. This enables conclusions to be drawnabout the statistical plausibility and biological relevance of the study findings.
BOTH measures must be reported AND UNDERSTOOD before a
conclusion can be drawn by a reader.