California Department of Education Standards and ...California Department of Education Standards...

California Department of Education

Standards and Assessment Division

California Standards Tests (CSTs)

Technical Report

Spring 2007 Administration

February 2008

Educational Testing Service (ETS)

Contract no. 5417

Table of Contents Chapter 1: Introduction.........................................................................................................................................................1

Background .............................................................................................................................................................................................. 1

Education Code 60602 Legislative Intent................................................................................................................................................. 1

California Standardized Tests (CSTs).................................................................................................................................................... 2

Significant Development in 2007............................................................................................................................................................. 3

Algebra I Testing in 2007......................................................................................................................................................................... 3

World History Testing in 2007................................................................................................................................................................. 3

Overview of the Technical Report .......................................................................................................................................................... 3

Appendix 1.A—2007 CST Item and Time Chart .................................................................................................................................. 5

Chapter 2: CST Development Procedures ...........................................................................................................................6

Test Assembly Procedures....................................................................................................................................................................... 6

Test Specifications.................................................................................................................................................................................... 6

Statistical Specifications........................................................................................................................................................................... 6

Content Specifications.............................................................................................................................................................................. 7

Item Development .................................................................................................................................................................................... 8

Item Review Process ................................................................................................................................................................................ 9

Internal Reviews....................................................................................................................................................................................... 9

Assessment Review Panels..................................................................................................................................................................... 10

SPAR Panel ............................................................................................................................................................................................ 11

Technical Characteristics of the Assembled Tests............................................................................................................................... 12

Item Development for 2007 ................................................................................................................................................................... 13

Reference ................................................................................................................................................................................................ 14

Appendix 2.A—Reporting Clusters...................................................................................................................................................... 15

English–Language Arts .......................................................................................................................................................................... 15

History–Social Science........................................................................................................................................................................... 17

Mathematics ........................................................................................................................................................................................... 18

Science ................................................................................................................................................................................................... 21

Appendix 2.B—Technical Characteristics Tables and Plots .............................................................................................................. 25

Appendix 2.C—Cluster Targets ........................................................................................................................................................... 33

Chapter 3: CST Equating Procedures................................................................................................................................66

Test Construction and Review .............................................................................................................................................................. 66

Post-Administration Operational Equating......................................................................................................................................... 66

Calibration.............................................................................................................................................................................................. 66

Scaling.................................................................................................................................................................................................... 67

Equating the Braille Versions of the CSTs .......................................................................................................................................... 69

Equating Samples .................................................................................................................................................................................. 70

Scaling the CSTs for Integrated Science .............................................................................................................................................. 71

References............................................................................................................................................................................................... 74

Appendix 3.A—New Form Conversion Tables.................................................................................................................................... 75

Chapter 4: Validity...............................................................................................................................................................96

Validity Evidence Based on Test Content ............................................................................................................................................ 96

CST Assessment Review Panel.............................................................................................................................................................. 96

CST Item Writers ................................................................................................................................................................................... 98

CST Development Procedures ............................................................................................................................................................... 98

Validity Evidence Based on Relations to Other Variables................................................................................................................ 102

CST for ELA versus CAT/6 Survey Reading/Language/Spelling........................................................................................................ 103

CST for Math versus CAT/6 Survey Math........................................................................................................................................... 103

CST for Science versus CAT/6 Survey Science ................................................................................................................................... 104

References............................................................................................................................................................................................. 105

Appendix 4.A—Test Correlations Tables .......................................................................................................................................... 106

Chapter 5: Score Reports .................................................................................................................................................. 108

Descriptions of Scores.......................................................................................................................................................................... 108

Raw Score ............................................................................................................................................................................................ 108

Scale Score ........................................................................................................................................................................................... 108

Proficiency Levels................................................................................................................................................................................ 108

Score Reporting.................................................................................................................................................................................... 108

Score Report Applications.................................................................................................................................................................... 109

Score Report Contents.......................................................................................................................................................................... 109

Score Distributions and Summary Statistics ..................................................................................................................................... 110

Reference .............................................................................................................................................................................................. 113

Appendix 5.A—Types of Score Reports Tables................................................................................................................................. 114

Appendix 5.B—Scale Score Distribution Tables ............................................................................................................................... 118

Chapter 6: Test Fairness.................................................................................................................................................... 122

STAR Program

Page ii

STAR Program

Demographic Distributions ................................................................................................................................................................. 122

Test Variations, Accommodations and Modifications ...................................................................................................................... 123

Category 1: Test Variations.................................................................................................................................................................. 124

Category 2: Accommodations .............................................................................................................................................................. 124

Category 3: Modifications.................................................................................................................................................................... 124

Accommodation Summaries ............................................................................................................................................................... 124

DIF Analyses ........................................................................................................................................................................................ 125

Test Security and Confidentiality ....................................................................................................................................................... 126

ETS’s Office of Testing Integrity (OTI)............................................................................................................................................... 126

Test Development ................................................................................................................................................................................ 127

Item Review ......................................................................................................................................................................................... 127

Item Bank............................................................................................................................................................................................. 127

Transfer of Forms and Items to CDE ................................................................................................................................................... 128

Test Administration.............................................................................................................................................................................. 128

Test Delivery........................................................................................................................................................................................ 128

Processing and Scoring ........................................................................................................................................................................ 129

Transfer of Scores via Secure Data Exchange...................................................................................................................................... 129

Statistical Analysis ............................................................................................................................................................................... 130

Reporting and Posting Results.............................................................................................................................................................. 130

Student Confidentiality......................................................................................................................................................................... 130

Test Results .......................................................................................................................................................................................... 130

References............................................................................................................................................................................................. 132

Appendix 6.A—Demographic Summary Tables ............................................................................................................................... 133

Appendix 6.B—2007 Test Variations, Accommodations, and Modifications.................................................................................. 171

Appendix 6.C—Accommodation Summary Tables .......................................................................................................................... 174

Appendix 6.D — DIF Tables ............................................................................................................................................................... 365

Chapter 7: Item Quality..................................................................................................................................................... 394

Item Analyses ....................................................................................................................................................................................... 396

IRT Analyses ........................................................................................................................................................................................ 398

Summaries of IRT b-values.................................................................................................................................................................. 398

IRT Model-Data Fit Analyses .............................................................................................................................................................. 398

Summary of Item-Level Analyses....................................................................................................................................................... 399

References............................................................................................................................................................................................. 401

Appendix 7.A—Item-by-Item p-value and Point-Biserial Tables .................................................................................................... 402

Appendix 7.B—IRT Tables ................................................................................................................................................................. 416

Chapter 8: Reliability......................................................................................................................................................... 438

Reliability.............................................................................................................................................................................................. 438

Inter-correlations, Reliabilities, and SEMs for Reporting Clusters................................................................................................. 440

Subgroup Reliabilities and SEMs1...................................................................................................................................................... 440

Conditional Standard Errors of Measurement ................................................................................................................................. 441

Decision Classification Analyses ......................................................................................................................................................... 442

References............................................................................................................................................................................................. 444

Appendix 8.A—Reliabilities and SEM Tables................................................................................................................................... 445

Appendix 8.B—Reliability of Classification Tables .......................................................................................................................... 510

Chapter 9: Constructed Response Items .......................................................................................................................... 525

Grade 4 and 7 Writing Test Composition .......................................................................................................................................... 525

Scoring Rubric ..................................................................................................................................................................................... 525

Development of Writing Tasks ........................................................................................................................................................... 526

Rater Characteristics........................................................................................................................................................................... 526

Scoring Supervisors and Directors ..................................................................................................................................................... 527

Accuracy and Bias Monitoring ........................................................................................................................................................... 527

Distributions and Means of Writing Scores—Overall and by Subgroup ........................................................................................ 528

Composite Reliability for Grades 4 and 7 .......................................................................................................................................... 528

Essay and Rater Agreement Summary .............................................................................................................................................. 529

References............................................................................................................................................................................................. 531

Appendix 9.A—Writing Scoring Rubrics .......................................................................................................................................... 532

Grade Four Scoring Rubric .................................................................................................................................................................. 532

Grade Seven Scoring Rubric ................................................................................................................................................................ 534

Appendix 9.B— Essay Results Tables ................................................................................................................................................ 537

Chapter 10: Historical Comparisons ................................................................................................................................ 542

Examinee Performance........................................................................................................................................................................ 542

Test Characteristics ............................................................................................................................................................................. 542

References............................................................................................................................................................................................. 544

Appendix 10.A—Historical Comparisons Tables.............................................................................................................................. 545

Appendix 10.B—Historical Comparisons Tables .............................................................................................................................. 551

Addendum 1—Two-Core ELA ......................................................................................................................................... 555

Page iii

STAR Program

Positional Shift and Test Difficulty Study.......................................................................................................................................... 555

Analyses Conducted............................................................................................................................................................................. 556

Estimating Sampling Variation: The Jackknife Procedure ................................................................................................................... 557

Resampling........................................................................................................................................................................................... 557

Screening of Districts for the Jackknife Procedure............................................................................................................................... 557

Criterion for Evaluating Differences in Scoring Tables ....................................................................................................................... 558

Results................................................................................................................................................................................................... 558

Conclusion ............................................................................................................................................................................................ 559

Reference .............................................................................................................................................................................................. 560

Appendix to Addendum 1.................................................................................................................................................................... 561

Assignment Procedure for the Two Cores............................................................................................................................................ 561

Addendum 2: Grade 3 Spiraling ....................................................................................................................................... 562

Addendum 3: Writing Prompt Directions........................................................................................................................ 563

Tables Table 2.1 Target Statistical Specifications for CSTs..................................................................................................................................... 7

Table 2.B.1 Summary of 2007 CST Projected Technical Characteristics ................................................................................................... 25

Table 2.B.2 Summary of 2007 CST Projected Statistical Attributes........................................................................................................... 26

Table 2.C.1 Target Cluster IRT b-values for English–Language Arts (Grades 2 thru 7) ............................................................................ 33

Table 2.C.2 Target Cluster IRT b-values for English–Language Arts (Grades 8 thru 11) .......................................................................... 33

Table 2.C.3 Target Cluster IRT b-values for History–Social Science (Grade 8, World History, Grade 11) ............................................... 34

Table 2.C.4 Target Cluster IRT b-values for Mathematics (Grades 2 thru 7) ............................................................................................. 34

Table 2.C.5 Target Cluster IRT b-values for Mathematics End-of-Course Tests........................................................................................ 35

Table 2.C.6 Target Cluster IRT b-values for Integrated Mathematics Tests ............................................................................................... 35

Table 2.C.7 Target Cluster IRT b-values for Science (Grades 5, 8 and 10) ................................................................................................ 36

Table 2.C.8 Target Cluster IRT b-values for Science End-of Course Tests ................................................................................................ 36

Table 3.1 Evaluation of Common Items between New and Reference Test Forms .................................................................................... 67

Table 3.2 Selection of Equating Samples.................................................................................................................................................... 70

Table 3.3 Summary Statistics for the Reference Form and 2007 Equating Samples................................................................................... 70

Table 3.4 Proficiency Level Cut Points for Science End-of-Course CSTs.................................................................................................. 72

Table 3.5 Computation of Proficiency Level Cut Points on Integrated Science 1....................................................................................... 72

Table 3.6 Scale Scores Defining the Various Proficiency Level Cut Points ............................................................................................... 73

Table 3.A.1 2007 New Conversions for English–Language Arts Grades 2 and 3....................................................................................... 75

Table 3.A.2 2007 New Conversions for English–Language Arts Grade 4 (with and without essay) .......................................................... 76


Table 3.A.4 2007 New Conversions for English–Language Arts Grade 7 (with and without essay) .......................................................... 78


Table 3.A.6 New Conversions for English–Language Arts Grades 10 and 11............................................................................................ 80

Table 3.A.7 New Conversions for History–Social Science Grade 8 and World History............................................................................. 81

Table 3.A.8 2007 New Conversion for History–Social Science Grade 11.................................................................................................. 82

Table 3.A.9 2007 New Conversions for Mathematics Grades 2 and 3........................................................................................................ 83

Table 3.A.10 2007 New Conversions for Mathematics Grades 4 and 5...................................................................................................... 84

Table 3.A.11 2007 New Conversions for Mathematics Grades 6 and 7...................................................................................................... 85

Table 3.A.12 2007 New Conversions for General Mathematics and Algebra I .......................................................................................... 86

Table 3.A.13 2007 New Conversions for Geometry and Algebra II ........................................................................................................... 87

Table 3.A.14 2007 New Conversions for Summative High School Mathematics and Integrated Mathematics 1....................................... 88

Table 3.A.15 2007 New Conversions for Integrated Mathematics 2 and Integrated Mathematics 3........................................................... 89

Table 3.A.16 2007 New Conversions for Grade 5 and Grade 8 Science..................................................................................................... 90

Table 3.A.17 2007 New Conversion for Grade 10 Life Science ................................................................................................................. 91

Table 3.A.18 New Conversions for Biology and Earth Science.................................................................................................................. 92

Table 3.A.19 2007 New Conversions for Chemistry and Physics............................................................................................................... 93

Table 3.A.20 2007 New Conversions for Integrated Science 1 and 2 ......................................................................................................... 94

Table 3.A.21 2007 New Conversions for Integrated Science 3 and 4 ......................................................................................................... 95

Table 4.1 CST ARP Member Qualifications, by subject and total .............................................................................................................. 97

Table 4.A.1 Correlations Between CSTs for English–Language Arts and CAT/6 Survey Tests .............................................................. 106

Table 4.A.2 Correlations Between Grade-specific CSTs for Mathematics and CAT/6 Survey Mathematics Tests.................................. 106

Table 4.A.3 Correlations Between End-of-Course CSTs for Mathematics and CAT/6 Survey Mathematics Tests.................................. 106

Table 4.A.4 Correlations Between End-of-Course CSTs for Science and CAT/6 Survey Science Tests.................................................. 107

Table 5.1 Mean and Standard Deviation of Raw and Scale Scores for CSTs............................................................................................ 111

Table 5.2 Percentage of Examinees in Proficiency Levels for CSTs ........................................................................................................ 112

Table 5.A.1 Score Reports Reflecting CST Results .................................................................................................................................. 114

Table 5.B.1 Distribution of CST Scale Scores for English–Language Arts .............................................................................................. 118

Table 5.B.2 Distribution of CST Scale Scores for History–Social Science............................................................................................... 118

Table 5.B.3 Distribution of CST Scale Scores for Mathematics Grade 2 through 7 ................................................................................. 119

Table 5.B.4 Distribution of Scale Scores for Mathematics End-of-Course CSTs ..................................................................................... 119

Table 5.B.5 Distribution of CST Scale Scores for Science ....................................................................................................................... 120

Page iv

STAR Program

Table 5.B.6 Distribution of CST Scale Scores for Grade-Specific Population.......................................................................................... 121

Table 6.1 Subgroup Definitions ................................................................................................................................................................ 122

Table 6.A.1 Demographic Summary for English–Language Arts Grade 2 ............................................................................................... 133








Table 6.A.9 Demographic Summary for English–Language Arts Grade 10 ............................................................................................. 141

Table 6.A.10 Demographic Summary for English–Language Arts Grade 11 ........................................................................................... 142

Table 6.A.11 Demographic Summary for History–Social Science Grade 8.............................................................................................. 143

Table 6.A.12 Demographic Summary for World History ......................................................................................................................... 144

Table 6.A. 13 Demographic Summary for History–Social Science Grade 11........................................................................................... 145

Table 6.A.14 Demographic Summary for Mathematics Grade 2 .............................................................................................................. 146






Table 6.A.20 Demographic Summary for General Mathematics .............................................................................................................. 152

Table 6.A.21 Demographic Summary for Algebra I ................................................................................................................................. 153

Table 6.A.22 Demographic Summary for Geometry ................................................................................................................................ 154

Table 6.A.23 Demographic Summary for Algebra II................................................................................................................................ 155

Table 6.A.24 Demographic Summary for Summative High School Mathematics .................................................................................... 156

Table 6.A.25 Demographic Summary for Integrated Mathematics 1........................................................................................................ 157



Table 6.A.28 Demographic Summary for Science Grade 5 ...................................................................................................................... 160

Table 6.A.29 Demographic Summary for Science Grade 8 ...................................................................................................................... 161

Table 6.A.30 Demographic Summary for Grade 10 Life Science............................................................................................................. 162

Table 6.A.31 Demographic Summary for Biology ................................................................................................................................... 163

Table 6.A.32 Demographic Summary for Chemistry................................................................................................................................ 164

Table 6.A.33 Demographic Summary for Earth Science .......................................................................................................................... 165

Table 6.A.34 Demographic Summary for Physics .................................................................................................................................... 166

Table 6.A.35 Demographic Summary for Integrated Science 1................................................................................................................ 167




Table 6.B.1 Matrix of Test Variations, Accommodations, and Modifications.......................................................................................... 171

Table 6.B.2 Matrix of Test Variations for English Learners ..................................................................................................................... 173

Table 6.C.1 Accommodation Summary for English–Language Arts Grade 2........................................................................................... 174








Table 6.C.9 Accommodation Summary for English–Language Arts Grade 10......................................................................................... 214

Table 6.C.10 Accommodation Summary for English–Language Arts Grade 11....................................................................................... 219

Table 6.C.11 Accommodation Summary for History–Social Science Grade 8 ......................................................................................... 224

Table 6.C.12 Accommodation Summary for World History..................................................................................................................... 229

Table 6.C.13 Accommodation Summary for History–Social Science Grade 11 ....................................................................................... 234

Table 6.C. 14 Accommodation Summary for Mathematics Grade 2......................................................................................................... 239

Table 6.C.15 Accommodation Summary for Mathematics Grade 3.......................................................................................................... 244





Table 6.C.20 Accommodation Summary for General Mathematics.......................................................................................................... 269

Table 6.C.21 Accommodation Summary for Algebra I............................................................................................................................. 274

Table 6.C.22 Accommodation Summary for Geometry............................................................................................................................ 280

Table 6.C.23 Accommodation Summary for Algebra II ........................................................................................................................... 285

Table 6.C.24 Accommodation Summary for Summative High School Mathematics ............................................................................... 290

Page v

STAR Program

Table 6.C.25 Accommodation Summary for Integrated Mathematics 1 ................................................................................................... 295



Table 6.C.28 Accommodation Summary for Grade 5 Science.................................................................................................................. 310

Table 6.C.29 Accommodation Summary for Grade 8 Science.................................................................................................................. 315

Table 6.C.30 Accommodation Summary for Grade 10 Life Science ........................................................................................................ 320

Table 6.C.31 Accommodation Summary for Biology............................................................................................................................... 325

Table 6.C.32 Accommodation Summary for Chemistry ........................................................................................................................... 330

Table 6.C.33 Accommodation Summary for Earth Science...................................................................................................................... 335

Table 6.C.34 Accommodation Summary for Physics ............................................................................................................................... 340

Table 6.C.35 Accommodation Summary for Integrated Science 1 ........................................................................................................... 345




Table 6.D.1 Operational Items Exhibiting Significant DIF....................................................................................................................... 365

Table 6.D.2 Field-test Items Exhibiting Significant DIF........................................................................................................................... 366

Table 6.D.3 DIF Classifications for English–Language Arts Grade 2 Operational Items ......................................................................... 368







Table 6.D.10 DIF Classifications for English–Language Arts Grade 9 Operational Items ....................................................................... 370

Table 6.D.11 DIF Classifications for English–Language Arts Grade 10 Operational Items ..................................................................... 371

Table 6.D.12 DIF Classifications for English–Language Arts Grade 11 Operational Items ..................................................................... 371

Table 6.D.13 DIF Classifications for History–Social Science Grade 8 Operational Items ....................................................................... 371

Table 6.D.14 DIF Classifications for World History Operational Items ................................................................................................... 372

Table 6.D.15 DIF Classifications for History–Social Science Grade 11 Operational Items ..................................................................... 372

Table 6.D.16 DIF Classifications for Mathematics Grade 2 Operational Items ........................................................................................ 372






Table 6.D.22 DIF Classifications for General Mathematics Operational Items ........................................................................................ 374

Table 6.D.23 DIF Classifications for Algebra I Operational Items ........................................................................................................... 375

Table 6.D.24 DIF Classifications for Geometry Operational Items .......................................................................................................... 375

Table 6.D.25 DIF Classifications for Algebra II Operational Items.......................................................................................................... 375

Table 6.D.26 DIF Classifications for Summative High School Mathematics Operational Items.............................................................. 376

Table 6.D.27 DIF Classifications for Integrated Mathematics 1 Operational Items.................................................................................. 376



Table 6.D.30 DIF Classifications for Science Grade 5 Operational Items ................................................................................................ 377

Table 6.D.31 DIF Classifications for Science Grade 8 Operational Items ................................................................................................ 377

Table 6.D.32 DIF Classifications for Grade 10 Life Science Operational Items....................................................................................... 378

Table 6.D.33 DIF Classifications for Biology Operational Items ............................................................................................................. 378

Table 6.D.34 DIF Classifications for Chemistry Operational Items.......................................................................................................... 378

Table 6.D.35 DIF Classifications for Earth Science Operational Items .................................................................................................... 379

Table 6.D.36 DIF Classifications for Physics Operational Items.............................................................................................................. 379

Table 6.D.37 DIF Classifications for Integrated Science 1 Operational Items.......................................................................................... 379




Table 6.D.41 DIF Classifications for English–Language Arts Grade 2 Field-test Items........................................................................... 381








Table 6.D.49 DIF Classifications for English–Language Arts Grade 10 Field-test Items......................................................................... 383

Table 6.D.50 DIF Classifications for English–Language Arts Grade 11 Field-test Items......................................................................... 384

Table 6.D.51 DIF Classifications for History–Social Science Grade 8 Field-test Items ........................................................................... 384

Table 6.D.52 DIF Classifications for World History Field-test Items....................................................................................................... 384

Page vi

STAR Program

Table 6.D.53 DIF Classifications for History–Social Science Grade 11 Field-test Items ......................................................................... 385

Table 6.D.54 DIF Classifications for Mathematics Grade 2 Field-test Items............................................................................................ 385






Table 6.D.60 DIF Classifications for General Mathematics Field-test Items............................................................................................ 387

Table 6.D.61 DIF Classifications for Algebra I Field-test Items............................................................................................................... 387

Table 6.D.62 DIF Classifications for Geometry Field-test Items .............................................................................................................. 388

Table 6.D.63 DIF Classifications for Algebra II Field-test Items ............................................................................................................. 388

Table 6.D.64 DIF Classifications for Summative High School Mathematics Field-test Items.................................................................. 388

Table 6.D.65 DIF Classifications for Integrated Mathematics 1 Field-test Items ..................................................................................... 389



Table 6.D.68 DIF Classifications for Science Grade 5 Field-test Items.................................................................................................... 390

Table 6.D.69 DIF Classifications for Science Grade 8 Field-test Items.................................................................................................... 390

Table 6.D.70 DIF Classifications for Grade 10 Life Science Field-test Items .......................................................................................... 390

Table 6.D.71 DIF Classifications for Biology Field-test Items ................................................................................................................. 391

Table 6.D.72 DIF Classifications for Chemistry Field-test Items ............................................................................................................. 391

Table 6.D.73 DIF Classifications for Earth Science Field-test Items........................................................................................................ 391

Table 6.D.74 DIF Classifications for Physics Field-test Items.................................................................................................................. 392

Table 6.D.75 DIF Classifications for Integrated Science 1 Field-test Items.............................................................................................. 392




Table 7.1 Summary of Items and Forms Presented in 2007 CSTs ............................................................................................................ 395

Table 7.2 Average and Median Proportion Correct and Point-Biserial ..................................................................................................... 397

Table 7.A.1 Item-by-item p-value and Point-Biserial for English–Language Arts ................................................................................... 402

Table 7.A.2 Item-by-item p-value and Point-Biserial for History–Social Science.................................................................................... 404

Table 7.A.3 Item-by-item p-value and Point-Biserial for Mathematics .................................................................................................... 406

Table 7.A.4 Item-by-item p-value and Point-Biserial for Mathematics [continued] ................................................................................. 408

Table 7.A.5 Item-by-item p-value and Point-Biserial for Science ............................................................................................................ 410

Table 7.A.6 Item-by-item p-value and Point-Biserial for Science [continued] ......................................................................................... 412

Table 7.A.7 Item-by-item p-value and Point-Biserial for Mathematics Grade Specific CSTs .................................................................. 414

Table 7.B.1 IRT b-values for English–Language Arts Grade 2 ................................................................................................................ 416








Table 7.B.9 IRT b-values for English–Language Arts Grade 10 .............................................................................................................. 418

Table 7.B.10 IRT b-values for English–Language Arts Grade 11............................................................................................................. 419

Table 7.B.11 IRT b-values for History–Social Science Grade 8 ............................................................................................................... 419

Table 7.B.12 IRT b-values for World History........................................................................................................................................... 419

Table 7.B.13 IRT b-values for History–Social Science Grade 11 ............................................................................................................. 420

Table 7.B.14 IRT b-values for Mathematics Grade 2 ............................................................................................................................... 420






Table 7.B.20 IRT b-values for General Mathematics................................................................................................................................ 422

Table 7.B.21 IRT b-values for Algebra I .................................................................................................................................................. 422

Table 7.B.22 IRT b-values for Geometry.................................................................................................................................................. 423

Table 7.B.23 IRT b-values for Algebra II ................................................................................................................................................. 423

Table 7.B.24 IRT b-values for Summative High School Mathematics ..................................................................................................... 423

Table 7.B.25 IRT b-values for Integrated Mathematics 1 ......................................................................................................................... 424



Table 7.B.28 IRT b-values for Science Grade 5........................................................................................................................................ 425

Table 7.B.29 IRT b-values for Science Grade 8........................................................................................................................................ 425

Table 7.B.30 IRT b-values for Life Science.............................................................................................................................................. 425

Table 7.B.31 IRT b-values for Biology..................................................................................................................................................... 426

Page vii

STAR Program

Table 7.B.32 IRT b-values for Chemistry ................................................................................................................................................. 426

Table 7.B.33 IRT b-values for Earth Science............................................................................................................................................ 426

Table 7.B.34 IRT b-values for Physics ..................................................................................................................................................... 427

Table 7.B.35 Distribution of IRT b-values for English–Language Arts.................................................................................................... 428

Table 7.B.36 Distribution of IRT b-values for History–Social Science .................................................................................................... 428

Table 7.B.37 Distribution of IRT b-values for Mathematics Grade 2 through 7....................................................................................... 429

Table 7.B.38 Distribution of IRT b-values for Mathematics End-of-Course CSTs................................................................................... 429

Table 7.B.39 Distribution of IRT b-values for Science............................................................................................................................. 430

Table 7.B.40 Distribution of IRT b-values for English–Language Arts (field-test items)......................................................................... 430

Table 7.B.41 Distribution of IRT b-values for History–Social Science (field-test items) ......................................................................... 431

Table 7.B.42 Distribution of IRT b-values for Mathematics Grade 2 through 7 (field-test items)............................................................ 431

Table 7.B.43 Distribution of IRT b-values for Mathematics End-of-Course CSTs (field-test items) ....................................................... 432

Table 7.B.44 Distribution of IRT b-values for Science (field-test items).................................................................................................. 432

Table 7.B.45 IRT Model Data Fit Distribution for English–Language Arts ............................................................................................. 433

Table 7.B.46 IRT Model Data Fit Distribution for History–Social Science Grade 8, World History, Grade 11....................................... 433

Table 7.B.47 IRT Model Data Fit Distribution for Mathematics Grade 2 through 7 ................................................................................ 434

Table 7.B.48 IRT Model Data Fit Distribution for Mathematics End-of-Course Tests............................................................................. 434

Table 7.B.49 IRT Model Data Fit Distribution for Science ...................................................................................................................... 435

Table 7.B.50 IRT Model Data Fit Distribution for English–Language Arts (field-test items) .................................................................. 435

Table 7.B.51 IRT Model Data Fit Distribution for History–Social Science Grade 8, World History, Grade 11 (field-test items)............ 436

Table 7.B.52 IRT Model Data Fit Distribution for Mathematics Grade 2 through 7 (field-test items) ..................................................... 436

Table 7.B.53 IRT Model Data Fit Distribution for Mathematics End-of-Course Tests (field-test items) ................................................. 437

Table 7.B.54 IRT Model Data Fit Distribution for Science (field-test items) ........................................................................................... 437

Table 8.1 Reliabilities and Standard Errors of Measurement for the CSTs............................................................................................... 439

Table 8.2 Scale Score Conditional Standard Error of Measurement at Cut Points.................................................................................... 441

Table 8.A.1 Subscore Reliabilities and Correlations for English–Language Arts..................................................................................... 445

Table 8.A.2 Subscore Reliabilities and Correlations for History–Social Science ..................................................................................... 447

Table 8.A.3 Subscore Reliabilities and Correlations for Mathematics...................................................................................................... 448

Table 8.A.4 Subscore Reliabilities and Correlations for Science .............................................................................................................. 452

Table 8.A.5 Subscore Reliabilities and Correlations for Grade Specific Tests ......................................................................................... 455

Table 8.A.6 Reliabilities and SEM for the CSTs by GENDER................................................................................................................. 457

Table 8.A.7 Reliabilities and SEM for the CSTs by NSLP....................................................................................................................... 458

Table 8.A.8 Reliabilities and SEM for the CSTs by SPECIAL SERVICES............................................................................................. 459

Table 8.A.9 Reliabilities and SEM for the CSTs by ENGLISH-LANGUAGE FLUENCY ..................................................................... 460

Table 8.A.10 Reliabilities and SEM for the CSTs by PRIMARY ETHNICITY....................................................................................... 462

Table 8.A.11 Subscore Reliabilities and SEM for English–Language Arts by GENDER/NSLP.............................................................. 465

Table 8.A.12 Subscore Reliabilities and SEM for History–Social Science by GENDER/NSLP .............................................................. 468

Table 8.A.13 Subscore Reliabilities and SEM for Mathematics by GENDER/NSLP............................................................................... 469

Table 8.A.14 Subscore Reliabilities and SEM for Science by GENDER/NSLP....................................................................................... 473

Table 8.A.15 Subscore Reliabilities and SEM for Grade Specific Tests by GENDER/NSLP .................................................................. 476

Table 8.A.16 Subscore Reliabilities and SEM for ELA by SPECIAL SERVICES/LANGUAGE FLUENCY ........................................ 478

Table 8.A.17 Subscore Reliabilities and SEM for History–Social Science by SPECIAL SERVICES/LANGUAGE FLUENCY........... 481

Table 8.A.18 Subscore Reliabilities and SEM for Mathematics by SPECIAL SERVICES/LANGUAGE FLUENCY............................ 482

Table 8.A.19 Subscore Reliabilities and SEM for Science by SPECIAL SERVICES/LANGUAGE FLUENCY.................................... 487

Table 8.A.20 Subscore Reliabilities and SEM for Grade Specific Tests by SPECIAL SERVICES/LANGUAGE FLUENCY............... 490

Table 8.A.21 Subscore Reliabilities and SEM for English–Language Arts by PRIMARY ETHNICITY ................................................ 492

Table 8.A.22 Subscore Reliabilities and SEM for History–Social Science by PRIMARY ETHNICITY................................................. 495

Table 8.A.23 Subscore Reliabilities and SEM for Mathematics by PRIMARY ETHNICITY ................................................................. 496

Table 8.A.24 Subscore Reliabilities and SEM for Science by PRIMARY ETHNICITY ......................................................................... 501

Table 8.A.25 Subscore Reliabilities and SEM for Grade Specific Tests by PRIMARY ETHNICITY..................................................... 504

Table 8.A.26 Overall Subgroup Reliabilities ............................................................................................................................................ 506

Table 8.A.27 Overall Subgroup Reliabilities (continued) ......................................................................................................................... 508

Table 8.B.1 Reliability of Classification for English–Language Arts Grade 2.......................................................................................... 510


Table 8.B.3 Reliability of Classification for English–Language Arts Grade 4 (Reading only)................................................................. 510

Table 8.B.4 Reliability of Classification for English–Language Arts Grade 4 (Reading & Writing) ....................................................... 511



Table 8.B.7 Reliability of Classification for English–Language Arts Grade 7 (Reading only)................................................................. 512

Table 8.B.8 Reliability of Classification for English–Language Arts Grade 7 (Reading & Writing) ....................................................... 512


Table 8.B.10 Reliability of Classification for English–Language Arts Grade 9........................................................................................ 513

Table 8.B.11 Reliability of Classification for English–Language Arts Grade 10...................................................................................... 513

Table 8.B.12 Reliability of Classification for English–Language Arts Grade 11...................................................................................... 513

Table 8.B.13 Reliability of Classification for History–Social Science Grade 8 ........................................................................................ 514

Table 8.B.14 Reliability of Classification for World History.................................................................................................................... 514

Page viii

STAR Program

Table 8.B.15 Reliability of Classification for History–Social Science Grade 11 ...................................................................................... 514

Table 8.B.16 Reliability of Classification for Mathematics Grade 2......................................................................................................... 515






Table 8.B.22 Reliability of Classification for General Mathematics......................................................................................................... 517

Table 8.B.23 Reliability of Classification for Algebra I............................................................................................................................ 517

Table 8.B.24 Reliability of Classification for Geometry........................................................................................................................... 517

Table 8.B.25 Reliability of Classification for Algebra II .......................................................................................................................... 518

Table 8.B.26 Reliability of Classification for Summative High School Mathematics .............................................................................. 518

Table 8.B.27 Reliability of Classification for Integrated Mathematics 1 .................................................................................................. 518



Table 8.B.30 Reliability of Classification for Science Grade 5................................................................................................................. 519

Table 8.B.31 Reliability of Classification for Science Grade 8................................................................................................................. 520

Table 8.B.32 Reliability of Classification for Grade 10 Life Science ....................................................................................................... 520

Table 8.B.33 Reliability of Classification for Biology.............................................................................................................................. 520

Table 8.B.34 Reliability of Classification for Chemistry .......................................................................................................................... 521

Table 8.B.35 Reliability of Classification for Earth Science..................................................................................................................... 521

Table 8.B.36 Reliability of Classification for Physics .............................................................................................................................. 521

Table 8.B.37 Reliability of Classification for Integrated Science 1 .......................................................................................................... 522




Table 8.B.41 Reliability of Classification for Algebra I – 8...................................................................................................................... 523

Table 8.B.42 Reliability of Classification for Geometry – 9..................................................................................................................... 523

Table 8.B.43 Reliability of Classification for Algebra II –10 ................................................................................................................... 524

Table 8.B.44 Reliability of Classification for High School Math – 11 ..................................................................................................... 524

Table 8.B.45 Reliability of Classification for World History – 10............................................................................................................ 524

Table 9.B.1 Distribution of Essay Scores for ELA Grade 4—Overall and by Subgroup .......................................................................... 537

Table 9.B.2 Distribution of Essay Scores for ELA Grade 7—Overall and by Subgroup .......................................................................... 537

Table 9.B.3 Mean Scores for ELA Grade 4 Essay—Overall and by Subgroup ...................................................................................

California Department of Education Standards and ...California Department of Education Standards...

Documents

Transcript of California Department of Education Standards and ...California Department of Education Standards...