How to spot a quality screening measure Frances Page Glascoe .
-
Upload
sharlene-dorsey -
Category
Documents
-
view
219 -
download
2
Transcript of How to spot a quality screening measure Frances Page Glascoe .
![Page 1: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/1.jpg)
How to spot a quality screening measure
Frances Page Glascoe
www.pedstest.com
www.forepath.org
![Page 2: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/2.jpg)
![Page 3: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/3.jpg)
STANDARDIZATION
Children with disabilities ( 16% - 18% of total)
Naturalistic sample
Large, nationally representativeProportionate Demographics: minorities, parents’ level of education, broad geographic locations, Spanish speakers, etc.
![Page 4: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/4.jpg)
![Page 5: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/5.jpg)
![Page 6: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/6.jpg)
Inter-rater--at least 85%
Test-retest--at least 85%
Internal consistency > .80
RELIABILITY
![Page 7: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/7.jpg)
![Page 8: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/8.jpg)
How well does a screen actually measure what
the authors claim?
![Page 9: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/9.jpg)
Good
Poor
Good
Poor
SCREEN DX TEST
![Page 10: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/10.jpg)
?
?
DX TESTGood
Poor
SCREEN
![Page 11: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/11.jpg)
VALIDITYConcurrent: battery should sample same domains as screen Discriminant: information on how well various kinds of problems are detected
Predictive: optional but helpful for showing that items sample enduring aspects of development
![Page 12: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/12.jpg)
Criterion Measure/Gold Standard
SCREEN
![Page 13: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/13.jpg)
CRITERION-RELATED VALIDITY
=
ACCURACY
![Page 14: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/14.jpg)
![Page 15: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/15.jpg)
Screening sorts those who probably have
problems from those who probably don’t
![Page 16: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/16.jpg)
ACCURACYSPECIFICITY = % of children without problems correctly detected (e.g., by passing, above cutoffs scores)SENSITIVITY = % of children with problems correctly detected
70% to 80% is the standard
![Page 17: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/17.jpg)
![Page 18: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/18.jpg)
SPECIFICITY
![Page 19: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/19.jpg)
SENSITIVITY
![Page 20: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/20.jpg)
Accuracy of the Denver-II
Denver-II PASS 86
FAIL 27
69 8
Specificity = 69/86 = 80%
17 10
86 18
Developmental DX
NO YES
Sensitivity = 10/18 = 56%
![Page 21: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/21.jpg)
ACCURACY:ACROSS AGE RANGES
AGE SENSITIVITY SPECIFICITY
N % N %
0 - 18 mos 3/4 75 66/82 80
18 mos - 3 yrs 27/34 79 117/149 79
3 - 4 1/2 yrs 26/35 74 118/165 72
4 1/2 - 8 yrs 42/57 74 172/245 70
TOTAL 98/130 75 473/641 74
![Page 22: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/22.jpg)
Rigorously Peer-reviewed
![Page 23: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/23.jpg)
Because of the enormous expense involved in standardization, reliabilty and validity research and accuracy studies, tests are expensive to create, keep current, provide translations, and to ensure that users and researchers have support and guidance. For these reasons, tests costs money and it is why few measures can be photocopied. The money, however small, you spend when purchasing measures goes to their continued development.
![Page 24: How to spot a quality screening measure Frances Page Glascoe .](https://reader036.fdocuments.in/reader036/viewer/2022062423/56649f565503460f94c7a29f/html5/thumbnails/24.jpg)
Detection rates WITH Screening Tests
70% to 80% of children with developmental disabilities correctly identified
Squires et al, JDBP. 1996;17:420 - 427
80% to 90% of children with mental health problems correctly identified
Sturner, JDBP . 1991; 12: 51-64
Most over-referrals on standardized screens are children with below average development and psychosocial risk factors
Glascoe, APAM. 2001; 155:54-59. -