7:45-8:00/Enjoy juice, rolls and catching up with each other…

59
7:45-8:00/Enjoy juice, rolls and catching up with each other… 8:00-8:20/Introduction of Pat Lotspeich 1

description

7:45-8:00/Enjoy juice, rolls and catching up with each other… 8:00-8:20/Introduction of Pat Lotspeich. School Improvement Preparation for NeSA -R and NeSA -M January 9, 2012. Facilitator: Debbie Schraeder, ESU#3. Holiday Break… in Numbers!. - PowerPoint PPT Presentation

Transcript of 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Page 1: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

1

7:45-8:00/Enjoy juice, rolls and catching up with each other…

8:00-8:20/Introduction of Pat Lotspeich

Page 2: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Facilitator:Debbie Schraeder, ESU#3

School Improvement Preparation for NeSA-R and NeSA-M

January 9, 2012

Page 3: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

3

Share the highlights of your break that includes using numbers.

Be creative!Post as Anonymous on Wallwisher at http://www.wallwisher.com/wall/ElkhornNeSA

Try to guess who posted what…

Holiday Break… in Numbers!

Page 4: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

AgendaK-5: Facilitate Learning in Relation to:

• Standards Instructional Tool (SIT)- Math and Reading Glossaries

Grades 2-5: Facilitate Learning in Relation to:• Table of Specifications (TOS) • Performance Level Descriptors (PLDs)• Indicator Summary Reports • Reference Sheets• Practice Tests

Grades K-1: Facilitate Learning in Relation to:• Math Manipulative Ideas• SMARTBoard Activities• Guided Math

Page 5: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Resources/ Recognition

• Nebraska Department of EducationPages, links, PPTs

• ESU 10/ Understanding NeSAPodcast

•ESU 6/Standards Format Explanation

•Jim Brink and Bill Menousek, ESU3tv

Page 7: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

7

NUMBER SENSE CONCEPTS: Students will communicate number sense concepts using multiple representations to reason, solve problems, and make connections within mathematics and across disciplines.

GEOMETRIC CONCEPTS AND MEASUREMENT CONCEPTS: Students will communicate geometric concepts and measurement concepts using multiple representations to reason, solve problems and make connections within mathematics and across disciplines.

ALGEBRAIC CONCEPTS: Students will communicate algebraic concepts using multiple representations to reason, solve problems and make connections within mathematics and across disciplines.

DATA ANALYSIS/PROBABILITY CONCEPTS: Students will communicate data analysis/probability concepts using multiple representations to reason, solve problems and make connections within mathematics and across disciplines.

Nebraska Mathematics Standards

Page 8: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

8

K-12 Comprehensive Content Standard in each section reflects the broad learning standards for students related to mathematics.

NUMBER SENSE CONCEPTS: Students will communicate number sense concepts using multiple representations to reason, solve problems, and make connections within mathematics and across disciplines.

GEOMETRIC/MEASUREMENT CONCEPTS: Students will communicate geometric concepts and measurement concepts using multiple representations to reason, solve problems, and make connections within mathematics and across disciplines.

ALGEBRAIC CONCEPTS: Students will communicate algebraic concepts using multiple representations to reason, solve problems, and make connections within mathematics and across disciplines.

DATA ANALYSIS/PROBABILITY CONCEPTS: Students will communicate data analysis/probability concepts using multiple representations to reason, solve problems, and make connections within mathematics and across disciplines.

Page 9: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

9

Page 10: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

10

Tiers of Specificity

K-12 Comprehensive Content StandardsIdentify broad K-12 learning standards for studentsrelated to mathematics

Grade Level StandardsStatements that identify what studentsknow and be able to do by the end of each identified grade

Curricular Indicators Examples that further define what a student should learn at each specified grade level

Page 11: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

11

Standards Numbering System

Page 12: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

12

Determined by Local School Districts/ Classroom Teachers

Determined by State Board Guidance for Districts, Schools, and Teachers

Determined by State BoardRequired for all

Standards Curriculum Instruction

Page 13: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

13

Standards Instructional Tool(SIT)

Page 14: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

SIT/Glossary Scavenger Hunt

For your grade level:◦Think of vocabulary words with which

your students struggle.

◦Are they in the glossary? If so, does the definition match your understanding of the word?

◦What is interesting?

◦What do you have questions about?

Page 15: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

15

Manchester NeSA-R Data- this is OUR Data

Page 16: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

16

Manchester NeSA-M Data- this is OUR Data

Page 17: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Divide Group

Grades 2-5: Facilitate Learning in Relation to:• Table of Specifications (TOS) • Performance Level Descriptors (PLDs)• Indicator Summary Reports • Reference Sheets• Practice Tests

Grades K-1: Facilitate Learning in Relation to:• Guided Math• SMARTBoard Activities• Math Manipulative Ideas

Page 18: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

18

NeSA is . . . Administered during the spring of the

year.

Based on Tables of Specification and Performance Level Descriptors.

Built upon the best thinking of Nebraska educators, national experts, and a worthy partner – Data Recognition Corporation.

Page 19: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

19

Table of Specifications

Page 20: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

20

Webb’s Depth of Knowledge

• Level 1 Recall

• Level 2 Skill/Concept

• Level 3 Strategic Thinking

• Level 4 EXTENDED THINKING

Page 21: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

21

Depth of Knowledge

• Focuses on content standard in order to successfully complete an assessment/standard task.

• Descriptive, not a taxonomy

• Not the same as difficulty

Page 22: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

22

• Mechanism to ensure that the intent of the standard and the level of student demonstration required by that standard matches the assessment items (required under NCLB)

• Provides cognitive processing ceiling (highest level students can be assessed) for item development

Why Depth of Knowledge?

Page 23: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

23

• The Depth of Knowledge is NOT determined by the verb, but the context in which the verb is used and the depth of thinking required.

Page 24: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

24

Same verb—three DOK levels

• DOK 3- Describe a model that you might use to represent the relationships that exist within the rock cycle. (requires deep understanding of rock cycle and a determination of how best to represent it)

• DOK 2- Describe the difference between metamorphic and igneous rocks. (requires cognitive processing to determine the differences in the two rock types)

• DOK 1- Describe three characteristics of metamorphic rocks. (simple recall)

Page 25: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

25

Remember…

• Depth of Knowledge (DOK) is a scale of cognitive demand.

• DOK requires looking at the assessment item/standard-not student work-in order to determine the level. DOK is about the item/standard-not the student.

• The context of the assessment item/standard must be considered to determine the DOK-not just a look at what verb was chosen.

Page 26: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

26

Depth of KnowledgeGrade Level Practice

Page 27: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

27

Performance Level

Descriptors

What are . . .

Page 28: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

28

Goals for Instruction

Page 29: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

29

Accommodation Guides

What are . . .

Page 30: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

30

Where do we find the content components of NeSA?

www.education.ne.gov/Assessment

Tables of SpecificationPerformance Level

DescriptorsAccommodations GuidesWebb’s DOK documents

Page 31: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

31~NeSA Terminology~

PERFORMANCE LEVELS - three possible categories of student performance on NeSA

NeSA Performance Levels

Exceeds the Standards

Meets the Standards

Below the Standards

Page 32: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

32

Cut score processes:

Contrasting Group Method – 400+ teachers

Bookmark Method – 100+ teachers

State Board of Education Reviewed Examined results of both processesExamined NAEP and ACT results for NebraskaMade decisions within recommended range at

public meeting

How are performance levels determined?

Page 33: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

33

NeSA (CRT) vs. NRT ?--Differences--

Purposes: NeSA is intended to match and measure identified

standards and instruction.NRT is not intended to measure any state’s

standards. The intention is to compare students to each other.

Item Development:NeSA items with exact match to the standards –

NDE had to prove the match with an independent alignment study

NRT – No standards to match – matches inherent and previous knowledge, enriched homes, pre-skills.

Page 34: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

34

NeSA (CRT) vs. NRT ?

--Similarities—All the psychometric steps – standard setting

(Bookmark, Angoff, Contrasting Group)Reliabilities – KR 20-21 / Inter-rater ReliabilitiesDescriptive Statistics (Item P-values, Dif-analysis)

Administration:Both standardized – are generally administered

the same way.

Page 35: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

35

NeSA REPORTS

Individual Student Report

School Student Roster

School Indicator Summary

School Performance Level Summary

District Reading Indicator Summary

District Performance Level Summary

District Report of School Performance

Page 36: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

36

Questions for Consideration

What can we learn from this report?

Do we have other data to support these results?

What are the implications of this report?

Page 37: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

37

Use the Reports Interpretive Guide!

Page 38: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

38

Individual Student Report

Page 39: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

39

School Student Roster

Page 40: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

40

School Indicator Summary

Page 41: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

41

School Performance Level Summary

Page 42: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

42

District Reading Indicator Summary

Page 43: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

43

District Performance Level Summary

Page 44: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

44

District Report of School Performance

Page 45: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

How do we use NeSA data?

Page 46: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

46

o Curriculum alignment process:

Are the tested indicators in our

curriculum? -- Where?

When are they taught?

How are they instructed?

At what DOK (Depth of Knowledge) level?

By whom?

Use NeSA Data to inform . . .

Page 47: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

47

Test preparation processes.

Examine PLDs and Tables of Specification.

Do our students have opportunity to learn the

tested indicators?

How are they performing on the indicators on a

day-to-day basis?

Are we assessing them locally?

Use NeSA Data to inform . . .

Page 48: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

48

NeSA Crosswalk

Page 49: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

49

What Did We Learn?

Grades 2

Grades 3

Grades 4

Grades 5

Page 50: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

50

NCTM- SupportingNeSA Math

What’s on the test?  Find out! What math content is being assessed? How much of the test is comprised of computation, word problems, and open-response? Look at copies of released items to get an understanding of what is needed to be successful. Share them with your students so that they can get a sense of the time constraint.

Final Tip:

Page 51: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

51

Practice Tests

Have our students used practice tests?

Are our students familiar with the

testing tools? Reference sheets?

Are we familiar with appropriate

accommodations?

Use NeSA Data to inform . . .

Page 52: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

52

January 23 - February 10, 2012 - NeSA Writing Testing Window

March 26-May 4, 2012 - NeSA Mathematics, Reading and Science Testing Window

Dates to Keep in Mind

Page 53: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

53

What Did We Learn?Grades 2-5 in Relation to:

• Table of Specifications (TOS) • Performance Level Descriptors (PLDs)• Indicator Summary Reports • Reference Sheets• Practice Tests

Grades K-1 in Relation to:• Math Manipulative Ideas• SMARTBoard Activities• Guided Math

Page 54: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

54

NeSA results ARE an important data source!

When combined with other information, these data can

support curricular, instructional, and learning support decision

making.--It’s all about the

Continuous Improvement

Process!

Page 55: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Commit to data analysis as a continuous process, not an event. (Reeves, 2009)

Page 56: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

56

Data SourcesEXPLORE/PLAN/ACT AIMSweb

DIBELS Gates MacGinitie

Reading Theme Tests Chapter Tests

Measures of Academic Progress Developmental Reading Assessments (DRAs)

Curriculum-Based Measurement Teacher Observation

Running Reading Records Student Projects

Nebraska schools have many sources of data:

Each assessment tool has a purpose and a role in the big picture of Continuous Improvement!

Commit to data analysis as a continuous process, not an event. (Reeves, 2009)

Page 57: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

57

Commit to data analysis as a continuous process, not an event. (Reeves, 2009)

Page 59: 7:45-8:00/Enjoy juice, rolls and catching up with each other…

Thank you!

Debbie Schraeder, ESU #[email protected]

402-597-4865