Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up...

Post on 11-Jul-2020

2 views 0 download

Transcript of Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up...

Dynamic Learning Maps Alternate Assessment Consortium Neal Kingston Project Director Center for Educational Testing and Evaluation University of Kansas

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.

State Participants

Let’s start with lessons learned

• When an assessment system is embedded in an accountability system there will be consequences – Many teachers will narrowly teach to the test – Some teachers and administrators will act counter

to their professional responsibilities

Let’s start with lessons learned

• Teachers need more information about student learning – Timely – Actionable

How does DLM respond to these lessons?

• Common Core Essential Elements • Instructionally-embedded (and summative)

assessments • Instructionally-relevant tasks • Learning maps • Dynamic assessment • Professional development • Technology platform to tie it all together

Common Core Essential Elements Are:

• Links to grade level Common Core State Standards (CCSS)

• Statements of content and skills that provide a bridge for students with significant cognitive disabilities to achieve grade differentiated expectations

• Provide challenge and rigor appropriate for students with significant cognitive disabilities in consideration of the significance of their disabilities

Are not:

• Downward extension to pre-K

• General essence statements

• Statements of functional skills

Identify Essential Elements and Create ALDs: Why • Standardize meaning for users to

understand targets for learning • Provide consistency in expectations across

grades and achievement levels • Emphasize similarities in content learning

and skill achievement even though ways of performing may be highly diversified

• Ground the alternate assessments in clear expectations for learning and achievement

CCSS

Essential Elements

Instructional Achievement

Level Descriptors

Assessment Achievement

Level Descriptors

EXAMPLES

Examples Are

Essential Too

8

Geometric measurement: understand concepts of angle and measure angles. 4.MD.5. Recognize angles as geometric shapes that are formed wherever two rays share a common endpoint, and understand concepts of angle measurement: An angle is measured with reference to a circle with its center at the common endpoint of the rays, by considering the fraction of the circular arc between the points where the two rays intersect the circle. An angle that turns through 1/360 of a circle is called a “one-degree angle,” and can be used to measure angles. An angle that turns through n one-degree angles is said to have an angle measure of n degrees.

Geometric measurement: understand concepts of angle and measure angles. 4.MD.5. Recognize angles in geometric shapes

Grade 4 Mathematics 4MD5. Recognize angles in geometric shapes

Example 1. Label different types of angles in geometric shapes. Ex. Construct geometric shapes using styrofoam and toothpicks. Then determine whether angles are right, obtuse or acute Ex. Given a square, determine whether the angles are right, obtuse or acute.

10

4MD5. Recognize angles in geometric shapes

Level 2. Recognize angles in geometric shapes. Ex. Teacher draws a geometric shape, student will draw an arc to identify the angles. Ex. Give students pictures of different geometric shapes. Sing a song about shapes and ask students to hold up shapes with right angles (or acute angles...).

Grade 4 Mathematics

11

4MD5. Recognize angles in geometric shapes

Level 3 example. Identify an angle. Ex. Presented with drawings with angles and circles, point to the shape that doesn’t contain an angle. Ex. On the playground, identify as many angles as they can see or feel.

Grade 4 Mathematics

12

Recognize angles in geometric shapes

Level 4 example. Attend to angles in the environment. Ex. Use styrofoam and toothpicks to make angles. Ex. Bend a pipe cleaner and identify the bend as the vertex.

Grade 4 Mathematics

13

Instructionally-embedded (and summative) assessments

• Teachers need feedback on a timely and frequent basis – About student learning – About their teaching

• Students need feedback on a timely and frequent basis – Modeling increasing expectations

• Two important questions – Can results be aggregated for accountability purposes? – How do we do this without assessment diminishing the

time for instruction?

Instructionally Relevant Tasks

• Modeling good instructional practice – Set of activities related to a unit of study – Student interaction driven by cognitive goals – Structured scaffolding

Learning Maps &

Learning Progressions

Progressions

• Vertical progression

toward learning target

• Sequenced building

blocks

• Research-based

• Linked to high-quality

assessments

Presenter
Presentation Notes
Often characterized as a vertical progression within a domain, but differ in scope, breadth and grain size (Heritage, 2008). “…carefully sequenced set of building blocks that students must master on route to a more distant curricular aim” Popham (2007). “descriptions of successively more sophisticated ways of thinking about an idea that follow one another as students learn” (Wilson & Berenthal, 2005). Four Interrelated Guiding Principles (Hess, 2008) Developed (and refined) using available research and evidence Have clear binding threads that articulate the essential core concepts and processes of a discipline Articulate movement toward increased understanding Go hand-in-hand with well-designed and aligned assessments

Use numbers to decide which is bigger, smaller,

same size

Uses place value to distinguish and order

whole numbers

Uses decimal notation to two places

Uses the symbols =, < and > to order numbers and make comparisons

Uses percentages to make straightforward

comparisons

Masters, G. & Forster, M. (1997). Developmental Assessment. Victoria, AU: The Australian Council for Education Research Ltd.

What are ?

Network of connected learning targets (nodes)

Maps students’ “knowledge terrain”

Presenter
Presentation Notes
A learning map is a network of connected learning targets (some connections indicate preferred learning sequences) models of landscape learning progressions, which depict many-to-many relationships among concepts and skills (Tatsuoka, 2009) facilitates mapping students’ progress give a clearer view of a student’s knowledge terrain (think Google Earth) support instructionally relevant information for determining the best strategies to help students meet important learning targets

Create a model of quantity

Recognize wholeness

Identify one

Identify more than one

Use perceptual subitizing

Compare two quantities up to

ten using models

Explain set

Compare sets

Imitate Compare objects

Identify different

number of

Identify same number of

Recognize same Recognize

different

Equal quantity

Identify more

number of

Identify fewer

number of

Learning Progressions vs. Learning Maps

Centralizes notion of “superhighway”

Delineates multiple pathways

Presenter
Presentation Notes
Learning progressions are more linear, larger, and have grosser grain size. They represent the “superhighway” route, typical for most. “A description of skills, understanding and knowledge in the sequence in which they typically develop: a picture of what it means to ‘improve’ in an area of learning.” Masters & Forster (1997) Learning maps are landscape learning progressions that are not necessarily vertical. They have a finer grain size and will cover content learning that occurs birth to college. Unlike linear learning progressions, they delineate alternate pathways thus creating alternate learning progressions. (Tatsuoka, 2009)

Multiple Pathways ELA

Aware of same and different phonological

units as visual or tangible

Can identify syllables

Demonstrates receptive rhyming

Aware of same and different

phonological units as sounds

Demonstrates understanding letter sounds

Can demonstrate articulatory

movements for letter sounds

Presenter
Presentation Notes
Learning maps allow for multiple pathway – ex. Deaf/hard of hearing potential route (not only possible route)

Maps were intended to be an Internal System

1. Review of literature 2. Node development and

placement 3. Connection placement 4. Validation process

Multi-disciplinary Team Completes the Following:

Presenter
Presentation Notes
Determine prominent researchers in specific areas of mathematics and English language arts. Locate and synthesize empirical literature base with expert knowledge Edited works such as chapters from research handbooks, etc. Nodes developed from cognitive and concept shifts that are observable and testable Node placement and connections are hypothesized Critical nodes are exposed as pathways are developed Mapping typical and identifying sources that may shed light on multiple pathways that can be connected after the general map is established The map is ever-changing and evolving particularly with a perpetual review that is necessitated as more literature Expert review by practitioners and content specialists

1. Review of Literature

Identify seminal literature Synthesize literature

with expert knowledge

Presenter
Presentation Notes
Determine prominent researchers in specific areas of mathematics and English language arts. Locate and synthesize empirical literature base with expert knowledge Edited works such as chapters from research handbooks, etc.

Node (learning target)

Instruction

Curricular

Cognitive Develop-

ment

2. Node Development

What is the observable knowledge (skill, conceptual, procedural, factual)

we want students to exhibit ?

In Sum….

3. Connection Placement

Connection = predicted relationship between skills

Single direction Multiple connections Represents integrated

approach to skill development

Presenter
Presentation Notes
Node placement and connections are hypothesized Critical nodes are exposed as pathways are developed Mapping typical and identifying sources that may shed light on multiple pathways that can be connected after the general map is established

Mathematics Section

Learning Map (Math)

Learning Map (Math)

English Language Arts Section

English Language-Arts

Learning Map (ELA and Math)

*Note – these will eventually be connected into a single map

4. Validation

Reviews Internal Teacher Expert

Cognitive labs Pilot study Field tests

35

Dynamic Assessment

• Adaptive testing based on the learning map, not some general unidimensional concept of item difficulty – Navigating within neighborhoods – Navigating across neighborhoods

Professional Development

• On demand • Multiple approaches

– “Raw” PowerPoint version – Narrated movie version of PowerPoint presentation – Fully prepared Facilitator Training Packet – Self-guided version – Video examples of students with the most significant

disabilities engaging in instructional tasks – Video examples of students with a variety of

disabilities doing similar tasks – Sample lesson plans

Technology Platform

• KITE – will be available to all participating states to

deliver DLM on computers and tablets – Can be inexpensively licensed to deliver any other

assessments

THANK YOU!

For more information, please contact: dlm@ku.edu

or Go to: www.dynamiclearningmaps.org

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.