2012 getting ready_for_2013_assessments_-rms

Tom Corbett, Governor ▪ Ronald J. Tomalis, Secretary of Education www.education.state.pa.us

Pennsylvania State Assessments 2013



Pennsylvania State

Assessments

2012 – 2013

Edited for

RMS- PTO

11/28/12





New This Year• Return of the Keystone Exams • No PSSA-M or Grade 11 PSSA• All students in Grade 11 who have not taken

the Keystone Exams must take them• All PA assessments are available on-line

– PSSA, Keystone Exams, CDT

• Field testing PACC-aligned items in grades 3 – 5 in Math, Reading and Writing





Important Dates

Keystone Exams Testing WindowWave 1: December 3 – December 14, 2012

Wave 2: January 9 – January 23, 2013

May 13 – May 24, 2013

July 29 – August 2, 2013





Important Dates

PSSA Math and ReadingApril 8 - April 19, 2013

PSSA Writing Field Test

February 4 – February 13, 2013

PSSA Science

April 22 - April 26, 2013





Important Dates

PSSA make-up for Writing

March 18 – March 22, 2013

PSSA make-up for Math, Reading and Science

April 29 – May 3, 2013ACCESS for ELLs Test Window Grades K-12

January 28 – March 8, 2013





Important Dates

PASA Math & Reading Grades 3 - 8, 11February 18– March 29, 2013

PASA Science Grades 4, 8, 11 May 6 – May 31, 2013

NAEP Math, Reading, Science, Writing and Economics. Grades 4, 8, 12 in selected

schools January 28 – March 8, 2013





Pennsylvania Alternate System of Assessment (PASA)

Math & Reading: Feb 18 – Mar 29, 2013 Science: May 6 – May 31 , 2013 Writing: No statewide test form; individually created

(by teacher), scored (by teacher), and stored (in IEP folder)

Who participates in the PASA? Grades 3-8 and 11 Students with a significant cognitive disability





Who Takes the PSSA?

Math/Reading – All students in grades 3-8

Writing – All students in grades 5 and 8

Science – All students in grades 4 and 8





PA Common Core Standards

The Pennsylvania Common Core Standards (PACC) and draft Assessment Anchors are available on SAS at:

http://www.pdesas.org/Standard/CommonCore





The Taxonomy of Assessment Anchor Content Standards

1. Content Area

2. Grade Level

3. Reporting Category

4. Assessment Anchor Content Standards1. (Assessment Anchors)

5. Assessment Anchor Descriptor

6. Eligible Content





Assessment Anchor Coding

S4.A.1.1.1

Science

Grade Level

ReportingCategory

Assessment Anchor

AssessmentAnchorDescriptor

Eligible Content





Keystone Exams Offered three times each year – winter, spring

and summer Offered in Algebra I, Biology and Literature Students can retake them until they score at the

proficient level The Project-Based Assessment part of the

Keystones is being piloted





Who Takes the Keystones? All students in Grade 11 who have not already taken a

Keystone Exam in Algebra I, Biology, and Literature All students who will complete a Biology course this

school year All students who will complete an Algebra I course

this year All students who will complete coursework that

covers the content of the Literature Exam this year





Keystones and Regulations

Students must take the Keystone Exams to meet graduation requirements under Chapter 4 Regulations

Students must take the Keystone Exams to meet AYP requirements under NCLB





Math 2013

Criterion Referenced Five Reporting Categories

- Numbers and Operations

- Measurement

- Geometry

- Algebra

- Data Analysis





Math 2013

Student score comes from:

- 60 multiple choice questions

- Three open-ended questions Students take:

- 72 multiple choice in grades 3 - 8 and 11

- Four open-ended questions All grades will alternate subject areas with Math coming first.





Math 2013

Scores come from the COMMON ONLY.

2013 Math Test Format Number of Multiple

Choice Items per Student

(1 point each)

Number of Open-Ended Items per

Student (4 points each)

GradeEstimated

Time of Test

Common Multiple Choice Items

Equating Block Items

Field Test

Items

Common Open-Ended Items

Equating Block Items

Field Test

Items

Total Number of Score Points

3-8 and 11

180 minutes

3 sessions

60 2 10 3 0 160+12=

72





Math 2013

Embedded Field Test Gr 3-5 FT items based on PACC Gr 6-8 FT items based on current Anchors

Open-Ended items scored on a 0-4 scale Item-specific scoring guidelines but no general rubric Formula sheets will be provided for grades 7 and 8. Formulas

needed in grades 5 and 6 are provided with the item- See Resource Materials on our web site for the formula

sheets and item samplers





Item Specifics

Multiple choice items based on Eligible Content* Open-ended items based on Anchor (Verbs come from Anchor,

Anchor Descriptor or Eligible Content; Content comes from Eligible Content.)

Reminder:

Have students read the OE items carefully and

answer exactly what is being asked.

*All items based on the PACC may cross Eligible Content and Anchors and Reporting Categories.





Item Specifics

Examples of how OE items might be phrased:

- Show or explain all your work.

- Show all your work. Explain why you did each

step.

- Explain why [something is true or false]

- Describe how [doing something affects

something else; to find something, etc.]





Math 2013

Rubric (for sample item only): Part A:

- ½ point for correct answer- 1 point for complete and correct work OR

½ point for correct but incomplete work. Part B:

- 1/2 point for correct answer- 1 point for correct and compete work OR

½ point for correct but incomplete work.- 1 point for correct and complete explanation.

½ point for correct but incomplete explanation.





Math 2013

Rubric Metric:

Total Points (within) Score (on) 4 4

3 – 3 ½ 3

2 – 2 ½ 2

½ - 1 ½ 1

0 0





Math 2013

Some notes about open-ended items:

- Guess and Check is a valid method but at least two incorrect guesses must be shown to receive full credit.

- Not all open-ended items require a “why.”

- At least half the score points must come from one Anchor. The rest can come from anywhere else in that Reporting Category.





Math 2013

Testing time is approximately 150-180 minutes for Math. Testing in Grades 3 - 8 and 11. Can have a “blemish” and still get a score of 4 “e.g. missing $” may or may not be a blemish depending on

the item and grade. “Guess and check” is a valid, acceptable strategy but to get

full credit at least two incorrect “guesses” must be shown.





Math 2013

Grade 4 and up: calculators ARE permitted on all but the beginning few items.

Rulers and protractors will be provided at grades where needed. Students must use the rulers and protractors provided for the PSSA. (For current items, protractors are provided within the item itself. For items measuring the PACC, a separate protractor may be provided.)

Rulers scaled in U.S. Customary and Metric as required by the Anchors.





Math 2013

Calculator Policy The PSSA is designed so that calculators are not necessary

for students to be successful. If students choose to use a calculator on the portions of the PSSA for which calculators are permitted then they must adhere to the guidelines listed below. It is incumbent upon the school test coordinator to ensure that all calculator policies are implemented and followed, including making sure calculators have no programs stored in their memory. Please note that if a student wants to restore the deleted programs he or she will have to back them up prior to the assessment.





Math 2013

The following are NOT allowed for the PSSA or Keystones:

Non-calculators such as cell phones, PDAs, laptops, minicomputers, pocket organizers, etc.

Beaming capabilities. (These must be disabled.) Wireless communication technologies. Calculators having

wireless communication technologies may be used if those technologies are disabled.

Calculators with QWERTY keyboards or other typewriter-like keyboards or keypads (e.g. Dvorak).





Math 2013The following are NOT allowed for the PSSA

or Keystones: Calculators with built in Computer Algebra Systems – CAS. Calculators that make noise, have paper tape, need to be

plugged in or talk unless these specific calculators are required as an accommodation. (Please refer to the Accommodations Manual.)

Sharing calculators by students during a test session. All programs/information stored in a calculator. These must be

deleted prior to using that calculator on any section of the PSSA. Typically these are graphing calculators but scientific calculators may also contain stored programs.





Math Test Blueprint

Reporting Category

Grade3

Grade4

Grade5

Grade6

Grade7

Grade8

Grade11

Numbers and Operations 40-50% 43-47% 41-45% 28-32% 20-24% 18-22% 12-15%

Measurement 12-15% 12-15% 12-15% 12-15% 12-15% 12-15% 12-15%

Geometry 12-15% 12-15% 12-15% 15-21% 15-21% 15-20% 12-18%

Algebraic Concepts 12-15% 12-15% 13-17% 15-20% 20-27% 25-30% 36-42%

Data Analysis and

Probability13-16% 12-15% 12-15% 15-20% 15-20% 15-20% 12-18%

Total Points72

Points72

Points72

Points72

Points72

Points72

Points72

Points





Math Performance Level Cut Scores

Performance Level

Grade3

Grade4

Grade5

Grade6

Grade7

Grade8

Advanced 1370 and up

1445 and up

1483 and up

1476 and up

1472 and up

1446 and up

Proficient 1180-1369

1246-1444

1312-1482

1298-1475

1298-1471

1284-1445

Basic 1044-1179

1156-1245

1158-1311

1174-1297

1183-1297

1171-1283

Below Basic 750-1043

700-1155

700-1157

700-1173

700-1182

700-1170





Keystone Algebra I• Two modules• Each Module has 30 points – 18 from multiple

choice and 12 from open-ended• Each open-ended is worth four points• Some open-ended will be machine scored• Students in the class of 2017 must score at the

proficient or advanced level to graduate





Keystone Algebra I• Modules are scored separately and can be

passed separately• Students must score proficient (or higher) on

the entire exam but not necessarily pass each module

• If a student retakes the exam the highest score on each module will count





Keystone Algebra I – What It Measures





Keystone Algebra I – Test Format





Keystone Algebra I – Point Distribution





Keystone Algebra I – Estimated Time





About the Eligible Content

The Eligible Content at each grade level shows the range of knowledge and skills drawn upon to design the PSSA for that grade level.

Examining the Eligible Content across grade levels shows the progression of expectations from one grade to the next.





About the Test Three Reading Sections on the PSSA Math and Reading sections alternate

- Math: Sections 1, 3, 5

- Reading: Sections 2, 4, 6 Alignment with PA Academic Standards: Assesses knowledge

and skills described in the Assessment Anchor Content Standards

Target Passage Types

- Eligible passage genres identified at each grade level





Question Types and Scoring Multiple-choice responses are bubbled in by the student and

scored by machine.- One point each

Open-ended (short answer) responses are written out by the student and scored by trained raters.

- Three points are possible for each- Item-specific scoring guide

Grade 3- Students write in test booklets

Grades 4 – 8 - Students write in answer booklets





Grades 6-8 Three sessions Sections 2, 4, & 6 (alternates w/Math) Approximately 50 –75 minutes each Target Passage Types (mix varies by grade)

- Story (all grades)- Poem (all grades)- Informational (all grades)- Autobiography/Biography (eligible at all grades)- Practical/How-to/Advertisement - Essay/Editorial (grades 5, 6, 7, 8)

58 Multiple-choice items (40 common items) Five Open-ended items (four common items) Students write answers in answer booklet





Approximate length

Number of Multiple-Choice Items

(1 point each)

Number of Open-Ended Items (3 points each)

50 - 75 minutes

each section

Common Equating Block

Field Test

CommonEquating

BlockField Test

40 8 8 4 0 1

Total 170 – 215 minutes

Student score (Common Only): 52 pointsTotal points on each test: 73**Field test items do not count for student score

Grades 6-8 Test Format





Reading Reporting Clusters

GradeComprehension

and Reading Skills (Category A)

Literature and Interpretation(Category B)

3 60-80% 20-40%

4 60-80% 20-40%

5 60-80% 20-40%

6 50-70% 30-50%

7 50-70% 30-50%

8 40-60% 40-60%





Genre Coverage

GradeFiction

(and Nonfiction) Narrative

Nonfiction

3 50-70% 30-50%

4 50-70% 30-50%

5 50-70% 30-50%

6 40-60% 40-60%

7 40-60% 40-60%

8 40-60% 40-60%

11 30-50% 50-70%





LevelGrade

3Grade

4Grade

5Grade

6Grade

7Grade

8Grade

11

Advanced 1442 and up

1469 and up

1497 and up

1456 and up

1470 and up

1473 and up

NA

Proficient 1235-1441

1255-1468

1275-1496

1278-1455

1279-1469

1280-1472

NA

Basic 1168-1234

1112-1254

1137-1274

1121-1277

1131-1278

1146-1279

NA

Below Basic

1000-1167

700-1111

700-1136

700-1120

700-1130

700-1145

NA

Reading Scale Score Ranges by Performance Level and Grade





Not the Same!

Performance Level Descriptors– Advanced– Proficient– Basic– Below Basic

Scores on Open-Ended Reading Questions– 3 points– 2 points– 1 point– 0 points

≠1) Scores on open-ended questions contribute to a student’s raw score.2) The student’s raw score is converted to a scale score.3) The student’s scale score is interpreted as a Performance Level.





Writing 2013

Grades 5, 8 Multiple-Choice Writing Prompts Mode-specific Scoring Guidelines for composition Conventions scored separately





Writing 2013 Alignment

- Standards (not the revised PACC)- End of elementary and middle

Holistic “hybrid” scoring- Holistic scoring for composition—more appropriate for

large-scale assessments- Separate scoring for conventions leaves emphasis on

composing- Multiple-choice adds validity & reliability





Who takes the test?

All students in grades 5 and 8 Exceptions:

- ELL students in first 12 months

- PASA students

* Take an alternate writing test based on IEP goals

* Scored test is stored in IEP folder





Grade 8

Multiple-Choice Section given first- Five passages (three core, two field test) with embedded

editing and revision errors- Four questions for each passage, total 20 questions

Writing prompts- Two core prompts- One field test prompt- Informational and Persuasive modes only





How Are Responses Scored? Each writing prompt will be scored using a 4 pt. conventions

rubric and a 4 pt. writing rubric with a variable mode emphasis. Writing prompt responses scored by hand (with 10 percent

read twice)- Focus, Content, Organization and Style

* Scored holistically* 1-4 pt. Mode-specific Scoring Guide

- Editing and Revising:* Scored separately * 1-4 pt. Conventions Scoring Guideline

Bubbled multiple choice responses scored by machine* 1 pt. each





Common Score Points

MultipleChoice

Writing Prompts

Totals

Conventions Mode

12 8 80 100

12 items each worth 1 point each

(12 X 1) = 12

2 items each worth a maximum of 4 points each

(2 X 4 = 8)

2 items each worth a maximum of 4 points each(The raw score is multiplied by 10)

(2 X 4) X 10 = 80

12+8+80=100

Field test items are not reflected in this chart. No scores are reported for field test items.





Non-scorable

Illegible Incoherent Insufficient Blank paper

Off-prompt: Still receives a Conventions score Off-mode: Loss of one point in Composition score





2013 Writing Test Format

SessionApprox. Minutes

Number of Test Items

Conventions Score Points

Composition Score Points

1 3020

Multiple Choice

12 (Common) 0

2 60 1 Writing Prompt

4 (if prompt is Common)

N/A (if prompt is Field Test)

















Writing Scaled Score Ranges by Grade and Performance level

Performance level Grade 5 Grade 8 Grade 11

Advanced1909

and up1748

and upNA

Proficient1236-1908

1236-1747

NA

Basic745-1235

914-1746

NA

Below Basic700-744

700-913

NA





Test DesignAligned with PACC StandardsGrade 3-5 will be operational 2014Grades 6-8 will field test in 2014Grades 3-8 will be operational 2015

All grades will be assessed on writing compositionAll grades eligible for three modesAll multiple choice are stand-alone itemsGrade 3 has short answer responses





Keystone Exams will be used for two purposes:

Proposed state requirement that the class of 2017 and beyond demonstrate proficiency for the purpose of graduation

Accountability as per No Child Left Behind (NCLB), i.e. Adequate Yearly Progress (AYP)





The Literature Keystone Exam will assess students’ mastery of the Literature Assessment Anchors as defined by the Eligible Content and will be aligned to the Concepts and Competencies.

Module 1 Module 2

Assessment Anchors Covered Fiction Literature Nonfiction Literature

Number of Eligible Content Covered 25 31





Types of questions and number of questions covered in the Literature Keystone Exam operational form.

*Multiple Choice Questions

Constructed Response Questions





Number of Operational Questions

2 17 3 2 17 3 4 34 6

Number of Field Test Questions

1 6 1 1 6 1 2 12 2

Total 3 23 4 3 23 4 6 46 8

Module 1 Module 2 Total

* Number of passages





Types of questions and number of points covered in the Literature Keystone Exam operational form.

Module 1 Module 2

Number of Operational Multiple Choice Questions

17 questions @ 1 point each = 17points

17 questions @ 1 point each = 17 points

Number of Operational Constructed- Response Questions

3 questions at 3 points each = 9 points

3 questions at 3 points each = 9 points

Total Number of Points 26 points 26 points

Percentage of Points for Entire Test 50% 50%

There will be a total of 52 points (Module 1 and Module 2 combined), with approximately 65 percent multiple-choice points and 35 percent constructed-response points.





Estimated time a typical student would need to complete Module 1 and Module 2 of the Literature Keystone Exam operational form.

Operational Questions

Field Test Questions

Total Questions

Number of Minutes 104 42 146





PSSA Science 2013

All students in grades 4 and 8

Exception:

- PASA students





PSSA Science 2013

Criterion Reference Four Reporting Categories - The Nature of Science - Biological Sciences - Physical Sciences - Earth and Space Sciences Embedded Field Test Open-Ended items scored on a 0-2 Item-specific scoring guidelines





PSSA Science 2013

District and School Reporting

A. The Nature of Science

1. Reasoning and Analysis

2. Processes, Procedures, and

Tools of Scientific Investigation

3. Systems, Models, and Patterns





PSSA Science 2013


B. Biological Sciences

1. Structure and Function of Organisms

2. Continuity of Life

3. Ecological Behavior and Systems





PSSA Science 2013


C. Physical Sciences

1. Structure, Properties and Interactions of Matter

2. Forms, Sources, Conversions, and Transfer of

Energy

3. Principles of Force and Motion





PSSA Science 2013


D. Earth and Space Sciences 1. Earth Features and Processes that

Change Earth and Its Resources

2. Weather, Climate, and Atmospheric

Processes

3. Composition and Structure of the

Universe





PSSA Science 2013

Science Test Composition

50% Nature of Science

(Inquiry)

50% Biological Science

Physical Science

Earth and Space Sciences

(Content)





PSSA Science 2013 Test Blueprint





PSSA Science Performance Level Cut Scores





PSSA Science 2013

Student score comes from: Grades 4 and 8

- 58 Multiple Choice items

- Five open-ended items (two points each)





PSSA Science 2013

Total number of items: Grade 4

- 68 Multiple Choice Items

- Seven open-ended Items Grade 8

- 70 Multiple Choice Items

- Seven open-ended Items





2013 PSSA Science Format

Total Number of Multiple Choice Items per Student

Total Number of Open-Ended Items per Student

Total Number of points

(Common Items Only)

GRADE

Approx.Length

Common Items

Common Scenario

Items

EquatingBlockItems

Field Test

Items

Common Items

(2 points each)

Equating BlockItems

Field Test

items

Number of Score Points per Student

4

110-115 Minutes

2 Sections

58 0 2 8 5 1 1 58+10=68

8

120-125 Minutes

2 Sections

54 4 2 10 5 1 1 58+10=68





Biology Keystone 2012-2013

The Biology Keystone Exam takes the place of the Grade 11 PSSA Science Assessment for 2012-2013

Two purposes:

- Proposed state requirement that the class of 2017 and beyond must demonstrate proficiency for the purpose of earning a PA high school diploma

- Accountability as per No Child Left Behind (NCLB) for Adequate Yearly Progress (AYP) calculations





Biology Keystone 2012-2013

The Biology Keystone Exam will measure the Biology Assessment Anchors as defined by the

Eligible Content and will be aligned to the Concepts and Competencies

Module 1 - Cells and Cell Processes

Module 2 - Continuity and Unity of Life





Classroom Diagnostic Tools

The Pennsylvania Department of Education has completed development of the Classroom Diagnostic Tools (CDTs) to support teachers and students in grades 6 through 12 in Mathematics, Reading/Literature and Science. These tools - available at no cost to districts - are fully integrated and aligned to the Standards Aligned System (SAS) and enable educators to identify a student’s academic strengths and areas of need as well as links to classroom resources.





Monitoring

In 2007 PDE began monitoring schools and districts regarding test security, administration, etc. This process will continue in 2012-13.

All visits will be unannounced.

PDE representatives are treated very well. THANK YOU!





Coming in 2014 Grades 3 – 5 Reading and Writing

transitioning to ELA Grades 3 – 5 Math and ELA based on PACC Separate booklets for Math and ELA Stand-alone field test for Writing in grades

6 – 8 No change for grades 6 – 8 except for field

test items based on PACC

2012 getting ready_for_2013_assessments_-rms

Education

Transcript of 2012 getting ready_for_2013_assessments_-rms