Chapter 5 Informal Assessment: Progress Monitoring.
-
Upload
allen-holmes -
Category
Documents
-
view
227 -
download
1
Transcript of Chapter 5 Informal Assessment: Progress Monitoring.
![Page 1: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/1.jpg)
Chapter 5
Informal Assessment: Progress Monitoring
![Page 2: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/2.jpg)
Introduction
• The Assessment Continuum• Reliability and Validity• Criterion-Referenced Assessment• Progress Monitoring• Computer-based Assessment of Reading• Special Considerations for Young, Adult, and English
Language Learners
![Page 3: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/3.jpg)
The Assessment Continuum
![Page 4: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/4.jpg)
Figure 5.1
![Page 5: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/5.jpg)
Reliability and Validity
![Page 6: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/6.jpg)
Types of Reliability and Validity
• Tables 5.1 and 5.2
![Page 7: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/7.jpg)
Reliability• Reliability = Consistency• Correlation: Positive, Negative, No Relationship• Correlation Coefficient Ranges from +1.00 to –1.00• Measures of Reliability: Pearson’s R, Kuder-Richardson,
Split-Half, Coefficient Alpha, Test-Retest, Equivalent Forms, Interrater
• Standard Error of Measure• Obtained Score = True Score+Error• Estimated True Score
![Page 8: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/8.jpg)
Types of Reliability
• Inter-Rater• % age agreement
• Intra-Rater• % age agreement
• Alternate Form• Pearson r
• Internal Consistency• Spearman Brown, Cronbach’s
alpha
• Test-Retest• Pearson r
• Consistency between 2 or more raters
• 1 rater’s consistency across assessments
• Consistency of scores over equivalent forms
• Consistency of scores on items within same test
• Consistency of scores from one testing to another
![Page 9: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/9.jpg)
Validity
• Validity = Accuracy• Types of Validity: Criterion-Related, Concurrent,
Predictive, Content, Construct
• Reliability versus Validity• Can a Test Be Valid without Being Reliable?
![Page 10: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/10.jpg)
Types of Validity
• Content• Expert review, test blueprint
(Figure 5.2)• Construct
• Correlations with similar measures
• Concurrent vs. Predictive• Treatment
• Prediction of student learning gains
• How well do items assess desired content?• How well do items assess a particular domain, skill, etc.?• Same time vs. future• Analysis of gain scores after instruction
![Page 11: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/11.jpg)
Criterion-Referenced Assessment
![Page 12: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/12.jpg)
Criterion-Referenced Assessment
• Assess mastery of specific objectives• Determine present levels of performance• Establish future educational objective• Determine IEP objectives• Monitor progress
![Page 13: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/13.jpg)
Brigance Inventories
• Brigance Diagnostic Inventory of Early Development-III• Brigance Diagnostic Comprehensive Inventory of Basic Skills-III
• Criterion-referenced but yields some standard scores• Gives grade placement information• Assesses a wide range of reading and other skills• Can be used to monitor progress, set IEP goals
![Page 14: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/14.jpg)
Linkages Between Brigance and Common Core State Standards
• Table 5.3
![Page 15: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/15.jpg)
Examples from Brigance CIBS-III
• Figures 5.3, 5.4, 5.5
![Page 16: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/16.jpg)
Figure 5.3
![Page 17: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/17.jpg)
Figure 5.4
![Page 18: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/18.jpg)
Figure 5.5
![Page 19: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/19.jpg)
Progress Monitoring
![Page 20: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/20.jpg)
Trends in Progress Monitoring
• National Center on Student Progress Monitoring• http://www.studentprogress.org/
• National Center on Response to Intervention• http://www.rti4success.org/
• National Center on Intensive Intervention• http://www.intensiveintervention.org/
• Hybrids• Computerized Assessment
![Page 21: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/21.jpg)
“Hybrid” Assessments• Assessments that combine aspects of both formal and
informal assessment• Standardization sample (Formal)• Curriculum-like tasks (Informal)• Ability to monitor progress (Informal)
• Dynamic Indicators of Basic Early Literacy Skills (DIBELS) & AIMSWeb progress monitoring system
• http://dibels.uoregon.edu• www.aimsweb.com
![Page 22: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/22.jpg)
AIMSweb
• Reading Fluency• Comprehension• Early Literacy Measures• Spanish Early Literacy• Early Numeracy• Math Computation• Spelling• Written Expression
![Page 23: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/23.jpg)
AIMSweb Reading
• Reading Fluency• Measures Oral Reading Fluency
• Reading Comprehension (MAZE)• Measures Reading Comprehension
![Page 24: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/24.jpg)
AIMSweb Early Literacy
Measures• Letter Naming• Letter Sound Fluency• Phoneme Segmentation• Nonsense Word Fluency
![Page 25: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/25.jpg)
AIMSweb Spanish Early Literacy
Measures• Letter Naming Fluency• Letter Sound Fluency• Syllable Sound Fluency• Syllable Reading Fluency• Syllable and Word Spelling• Oral Reading Fluency
![Page 26: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/26.jpg)
Example: DIBELS (Good & Kaminski, 2002)
• Brief, standardized, individually administered measures• Initial/First Sound Fluency - Oral Reading Fluency• Letter Naming Fluency - Oral Retelling Fluency• Phoneme Segment. Fluency - Word Use Fluency• Nonsense Word Fluency• Daze (DIBELS Next only)
• Assess development of pre-reading and early reading skills
• Includes DIBELS Data System
![Page 27: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/27.jpg)
What DIBELS Purports to Assess
Area of Reading• Phonics
• Phonemic Awareness
• Fluency
• Comprehension
• Vocabulary
DIBELS Assessment• Initial Sound/First Sound• Phoneme Segmentation
• Nonsense Word
• Letter Naming• Oral Reading
• Retell• Daze (DIBELS Next)
• Word Use
![Page 28: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/28.jpg)
Initial Sounds Fluency (First Sound Fluency in DIBELS Next)
• Grade administered: Kindergarten
• Measures: A student’s ability to recognize and produce the beginning sound(s) in an orally presented word
• Students performing below expectations will benefit from instruction in phonological awareness.
Overview of DIBELS Measures
![Page 29: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/29.jpg)
Overview of DIBELS Measures
Letter Naming Fluency
• Grades administered: Kindergarten through fall of first grade
• Measures: A student’s proficiency in naming upper and lower case letters
• Students identified at risk should be
instructed in phonological awareness and alphabetic principle
![Page 30: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/30.jpg)
Overview of DIBELS Measures
Phoneme Segmentation Fluency
• Grades Administered: Mid-kindergarten to end of first grade
• Measures: A student’s ability to
segment three- and four-phoneme words into their individual phonemes
• Students performing below expectations in this measure will benefit from instruction in phonological awareness activities
![Page 31: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/31.jpg)
Overview of DIBELS Measures
Nonsense Word Fluency
• Grades administered: Mid-kindergarten through first grade
• Measures: The student’s knowledge of
letter-sound correspondence and ability to blend letters into words
• Students performing below expectations will benefit from activities focusing on decoding
![Page 32: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/32.jpg)
Overview of DIBELS Measures
Oral Reading Fluency
• Grades administered: Mid-year first grade through third grade
• Measures: fluency in oral reading of connected text
• Students at risk will often have
difficulty in comprehension
There was a robin’s nest outside our kitchen
window. The nest was in a tall bush. The mother
robin sat in the nest all day long. One day when I was
watching, the mother bird flew away. I saw the eggs
she was sitting on. There were four blue eggs.
I watched and watched. The eggs moved. I
watched some more. The eggs started to crack.
Finally, the eggs hatched. I saw four baby birds. The
baby birds opened their beaks wide. I heard them
peeping. Soon the mother bird came back. Then the
mother robin put worms in their mouths.
Every day I watched the baby birds and their
mother. Pretty soon the babies were so fat there was
no room for the mother. Then one morning the nest
was gone from the bush.
![Page 33: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/33.jpg)
Overview of DIBELS Measures
Oral Retelling Fluency
• Grades administered: Mid-year first to third grade
• Measures: Comprehension of the passage read orally
• Children generally use about half the number of words in their retell that they read aloud in a 1-minute passage
![Page 34: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/34.jpg)
Overview of DIBELS Measures
Word Use Fluency
• Grades Administered: Kindergarten through third grade
• Measures: Vocabulary knowledge and expressive language
![Page 35: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/35.jpg)
Overview of DIBELS Measures
Daze
• Grades Administered: Third through sixth grade
• Measures: Comprehension
![Page 36: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/36.jpg)
Strengths and Weaknesses
• Strengths• Progress monitoring • Assesses all NRP areas• Relatively brief
• Weaknesses• Pressley, Hilden, & Shankland (2005)
• Predictive Power• Emphasis on speed vs. comprehension• Cost
• The Truth About DIBELS: What It Is, What It Does (Goodman, 2006)• “Barking at print?” (Samuels, 2007)
![Page 37: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/37.jpg)
Computer-Based Assessment of Reading
![Page 38: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/38.jpg)
Computerized Assessment
• Star Reading • http://www.renaissance.com/Products/Star-Assessments/STAR-Reading• Linked to Accelerated Reader
• Read 180• http://www.scholastic.com/read180/index.htm
• DORA and DOMA• http://www.letsgolearn.com/lglsite/products/
• Total Reader• www.totalreader.com/index.php?fuseaction=home.faq
![Page 39: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/39.jpg)
Lexiles• Computer-generated• Sophisticated but user-friendly system to track student
progress over time and to link students to appropriate level texts
• Ranges from 200 (beginning reading) to 1700+ (advanced readers)
• Students and books can be matched along the continuum of Lexile scores
• Common Core State Standard Lexile bands define expected levels (in Lexile scores) of reading for each grade level
![Page 40: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/40.jpg)
Special Considerations for Young, Adult, and English Language Learners
![Page 41: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/41.jpg)
Special Considerations in the Informal Assessment of Young Children
• May want to use portfolios to keep track of student progress• Eight essential literacy skills for Kindergarteners
• Letter/sound associations• Phonological awareness skills• Print concepts• Phonemic segmentation/representation• Word reading• Word writing• Text reading• Text writing
![Page 42: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/42.jpg)
Special Considerations in the Informal Assessment of Adults
• Text Box 5.1• Adults learning to read are typically sensitive, and in some cases,
ashamed.• Take time to establish rapport
• Assessment materials should be based on adult themes (e.g., work, family life).
• Assess various areas of reading, rather than assuming possession of basic word analysis skills.
• Assess oral reading rate; if 125 wept or less, further assessment is needed.
• Use stronger vocabulary acquired through life experiences as a building block of reading.
![Page 43: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/43.jpg)
Special Considerations in the Informal Assessment of English Language Learners
• Text Box 5.2• Four categories of ELLs
• Newly arrived students with limited formal schooling• Newly arrived students with adequate formal schooling• Students exposed to two languages simultaneously• Long-term English-language learners
• Assessments should match the literacy background and knowledge base of the student.
• Ensure assessments conform to the general assessment standards set by the Teachers of English to Speakers of Other Languages (TESOL; www.tesol.org/).
![Page 44: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/44.jpg)
Assessment at a Glance: Criterion Referenced and Progress
Monitoring
• Tables 5.5 and 5.6• Characteristics of Informal Assessment and Progress
Monitoring Measures• Psychometric Properties of Informal Assessment and Progress
Monitoring Measures
![Page 45: Chapter 5 Informal Assessment: Progress Monitoring.](https://reader036.fdocuments.in/reader036/viewer/2022062304/56649ef25503460f94c04925/html5/thumbnails/45.jpg)
Summary
• The Assessment Continuum• Reliability and Validity• Criterion-Referenced Assessment• Progress Monitoring• Computer-based Assessment of Reading• Special Considerations for Young, Adult, and English
Language Learners