ILEARN

Mathematics

Grades 3-5

ILEARN Mathematics

Topic Overview

• ILEARN Development

• Test Blueprints

• Item Specifications

• Accessibility & Calculator Policy

• Sample Items & Performance Tasks

Quality assessment is a deliberative and

collaborative process involving Indiana educators.

ILEARN Development

Guiding Principles

Guiding Principles

Student-centered Accessible Transparent

Indiana-aligned Evidence-based Technically sound

Collaborating with Stakeholders

We are building

ILEARN from the

ground up, and

educators are

involved in every

step!

INDIANA ACADEMIC

STANDARDS

Educators defined the knowledge and skills student should achieve at each grade level for

each content area.

BLUEPRINTS Educators define essential content from the standards and appropriate proportions of

the standards for the assessment.

ITEM

SPECIFICATIONSEducators determine how each standard should be measured (e.g., evidence

statements, item types, cognitive complexity, etc.)

ITEM ACCEPTANCE Educators review items from licensed banks to determine alignment with

Indiana Standards.

ITEM

DEVELOPMENTEducators develop new items to ensure the assessment of the breadth

and depth of Indiana Standards.

DATA REVIEW Educators review statistical data from field-test items to determine

if the items can be used operationally.

SCORING Educators score open-ended items for field test (calibrate the

scoring through range finding) and operational data.

STANDARD

SETTINGEducators determine cut scores for each proficiency

category.

Implementing Improvements

Computer Adaptive

• Math and ELA

• Unique student experience that always meets the blueprint

• Adapts on difficulty, not across grade levels unless content aligns at multiple grade levels

Additional Student Supports and

Accommodations

• Translations

• Glossaries

• Embedded Dictionary/Thesaurus

• Spell Check

• Rich Text Tools

• Accessible Calculator

• Intuitive Graphing Interfaces

• American Sign Language

Improved Testing Times

• Single testing window at the end of the year

• Decreased test length (average 2 hours shorter total at each grade level)

• Untimed sessions

Improved Reporting Structures

• Individual student results in 12 days*

• Final results by July 1*

• More detailed student reports for computer adaptive tests

• Revised cut scores and proficiency levels (by educator committee)

Technology Setup and Requirements**

• Small IT and bandwidth footprint

• No local caching

• Secure Browser is the only required software

• Includes diagnostic tools

• “Sessionless” testing; no test tickets or seal codes

• Testing managed from examiner/teacher device

*These times will begin in 2020 due to setting cut scores in Summer 2019. Final reporting will be available Aug 15 for 2019.

**Full system requirements will be available in the Indiana Portal. Session management policy and procedures will be available by Oct 1, 2018.

Blueprints

ILEARN Blueprints

ILEARN Blueprints

• Aligns expectations regarding mastery of standardsWhat knowledge and skills do we need to measure?

• Identifies the degree of emphasis for curricular componentsWhat knowledge and skills are most essential for future success?

https://www.doe.in.gov/assessment/ilearn-educators

ILEARN Blueprints

• Use the Indiana Academic Standardsas a basis for lesson planning.

• Use the blueprint to prioritize instructional content.

ILEARN Blueprints Grade 3 MathematicsReporting Category Standard

Standard Item Range Standard % of Test

Min Max Min Max

Algebraic Thinking

and Data Analysis

(19–23%)

3.AT.1 1 3 2 6

3.AT.2 0 2 0 4

3.AT.3 0 2 0 4

3.AT.4 0 2 0 4

3.AT.5 0 2 0 4

3.AT.6 0 2 0 4

3.DA.1 0 2 0 4

3.DA.2 0 2 0 4

Computation

(23–27%)

3.C.1 1 3 2 6

3.C.2 1 3 2 6

3.C.3 1 3 2 6

3.C.4 0 2 0 4

3.C.5 0 2 0 4

3.C.6 0 2 0 4

ILEARN Blueprints Grade 3 Mathematics

Geometry and

Measurement

(19–23%)

3.G.1 0 1 0 2

9–11

3.G.2 1 2 2 4

3.G.3 1 2 2 4

3.G.4 1 2 2 4

3.M.1 0 2 0 4

3.M.2 1 2 2 4

3.M.3 1 2 2 4

3.M.4 1 2 2 4

3.M.5 1 2 2 4

3.M.6 0 2 0 4

3.M.7 0 2 0 4

Number Sense

(23–27%)

3.NS.1 1 3 2 6

11–13

3.NS.2 0 2 0 4

3.NS.3 1 3 2 6

3.NS.4 0 2 0 4

3.NS.5 0 2 0 4

3.NS.6 0 2 0 4

3.NS.7 1 3 2 6

3.NS.8 0 2 0 4

3.NS.9 0 2 0 4

ILEARN Blueprints Grade 3 Mathematics

Standard

Standard Item

RangeStandard % of Test

Reporting

Category Item

RangeMin Max Min Max

Process

Standards

(8–13%)

PS.1 0 2 0 4

4–6

PS.2 0 2 0 4

PS.3 0 2 0 4

PS.4 0 2 0 4

PS.5 0 2 0 4

PS.6 0 2 0 4

PS.7 0 2 0 4

PS.8 0 2 0 4

Total Operational Items: 48

Item Specifications

ILEARN Item Specs

ILEARN Item Specifications

• Formalizes how items are constructed for each standardEvidence statements, content limits, relevant vocabulary, item type

• Sample itemProvides an example to help item writers come up with ideas and help educators prepare appropriate lesson materials and classroom assessments.

• Identifies accessibility features for item writersHow will each item be rendered or adapted to reach the largest number of students possible without violating the construct?

https://www.doe.in.gov/assessment/ilearn-educators

ILEARN Item Spec MA.4.AT.2

Content Standard

MA.4.AT.2: Recognize and apply the relationships between addition and

multiplication, between subtraction and division, and the inverse relationship

between multiplication and division to solve real-world and other mathematical

problems.

Content Limits

Items include whole numbers less than 1000 for adding and subtracting.

Items include whole numbers for multiplication and division.

Items that use division should not include remainders.

Recommended

Response

Mechanisms

(Item Types)

Equation Response

Embedded Text Entry

Multiple Choice

Multi-Select

Short Answer

ILEARN Item Spec MA.4.AT.2

Construct-

Relevant

Vocabulary

Inverse relationship

Sum

Product

Quotient

Difference

Dividend

Divisor

Addend

Factor

DOK 2

ILEARN Item Spec MA.4.AT.2Model Task

Context Context optional

Allowable

Stimulus

Material

N/A

Evidence Statements

Students explain how (a multiplication expression) can be simplified using addition.

Students select/complete the (addition expression) that is equivalent to (multiplication expression).

Students create an equation to model a story problem.

Sample Item

Which expression is equivalent to 8 x 4?

A. 8 + 8 + 8 + 8

B. 8 + 8 + 4 + 4

C. 8 x 8 x 8 x 8

D. 12 + 12 + 12 + 12

Accessibility

ILEARN Accessibility

Accessibility Framework

Universals Features

Universal features are available to all students as they access instructional or assessment content.

Designated Features

Designated features are those tools that are available for use by any student for whom the need has been indicated by an educator (or team of educators) who are familiar with the student’s characteristics and needs.

Accommodations

An accommodation is a change in the standardized testing materials or procedures that enables students with a disability or with limited English proficiency to participate in an assessment in a way that measures abilities.

• Answer Eliminator

• Calculator for calculator allowed

items (Mathematics Grades 6-8)

• Dictionary (Writing) New

• English Glossary for pre-

selected construct-irrelevant

terms (all content areas) New

• Notepad New

• Highlighter

• Line Reader

• Mark for Review

• Mathematics Tools (e.g. ruler)

• Thesaurus (Writing) New

• Tutorial New

• Writing Tools (e.g. rich text,

spell check)

• Zoom

Embedded/Online

• English Dictionary (Writing) New

• Headphones or noise buffers to

block out distractions

• Low-tech assistive writing

instrument

• Preferential seating

• Scratch/blank paper, including

lined or graph paper

• Small group

• Thesaurus (Writing) New

Non-Embedded

• Color Contrast

• *Translation Glossaries (for pre-

selected construct-irrelevant term

for Mathematics, Science and

Grade 5 Social Studies New

• Masking

• Mouse pointer (size and color)

New

• Print size (zoom in and out) New

• *Translation-Spanish (Stacked)

for Mathematics, Science and

Grade 5 Social Studies New

Embedded/Online

• America Sign Language (ASL)

videos for listening items New

• Braille transcript for audio

items New

• Closed caption for

Listening/audio items New

• Refreshable Braille New

• Permissive mode to use

assistive technology devices

(e.g. Speech to text) New

• Print on Demand New

• Streamline format New

• Text to speech (except for

reading comprehension)

Embedded/Online

• Assistive technology to

magnify/enlarge

• Color Overlay

• Sound amplification system

• Special furniture or equipment for

viewing test

• Special lighting conditions

• Time of day for testing altered

Non-Embedded

Universal Features: Available to ALL students

Designated Features: Available to ANY student with a need determined

by educators Accommodations: Available to students with an IEP, 504 Plan or Nonpublic Service Plan

*Intended for English Learners (EL)

ILEARN Accessibility Framework

Accommodations: Available to students with an ILP (English Learners)

Text to speech (except for

reading comprehension)

• Extra time

• Read aloud to self

• Test individually

• Approved bilingual word-to-word

dictionary

• Alternative indication of response

• Braille Booklet

• Computer or other Assistive Technology (AT)

device

• Extra time

• Adaptive calculator for calculator allowed items

(Mathematics Grades 6-8) New

• Hundreds Chart (Mathematics Grades 3-8)New

• Interpreter for sign language

• Large Print Booklet

• Multiplication Table (Grades 6-8) New

• Paper Booklet

• Paper Booklet (Spanish Translation) New

• Read aloud to self

• Read aloud script for paper booklet

• Scribe

• Test individually

Embedded/OnlineNon-Embedded

Non-Embedded

Calculator PolicyILEARN

Mathematics

Assessment

General Education StudentsStudents with IEPs, Section 504 Plans,

and/or Service Plans

Grades 3-5 No calculator allowed.

No calculator allowed.

(May have a hundreds chart if listed as an

accommodation.)

Grade 6

Online Desmos Four

Function calculator during

calculator segments only.

Online Desmos Four Function calculator during

calculator segments only.

(May use a hundreds chart, multiplication table, or

handheld calculator if listed as an accommodation for

calculator segments only.)

Grades 7-8

Online Desmos Scientific

calculator during calculator

segments only.

Online Desmos Scientific calculator during calculator

segments only.

(May use a hundreds chart, multiplication table, or

handheld calculator if listed as an accommodation for

calculator segments only.)

ILEARN Item Spec MA.4.AT.2

Accessibility and Accommodation Considerations

Allowable Tools Calculator – None

Literary Considerations N/A for this standard

Visual Impairment

ConsiderationsN/A for this standard

Auditory Considerations N/A for this standard

Linguistic ComplexityRating to be completed after all final edits applied and approved

by IDOE.

Performance Tasks

ILEARN Math PTs

Released Items Repository (RIR)

• The RIR has a sample of at least ten discrete items per grade.

• Includes the relevant embedded tools and assistive technology

• Grades 3 & 5 will have a sample Performance Task

Educator Involvement: Handscoring

• IDOE will involve educators to the extent possible. • Approximately 3-4 educators from each corporation

• Full-time commitment to a 3-week scoring window each spring (following ILEARN administration).

• All participation is remote (e.g., training, qualification, scoring).

• Educators will be compensated at state rate.

• PGPs will be available to all educators.

More details coming soon!

Thank you for participating in these very important steps to prepare for ILEARN!

Questions or concerns? Please contact:

Justin Mocas

Math Assessment Content Specialist

jmocas@doe.in.gov

317-234-5595