Tests of Adult Basic EducationTests of Adult Basic Education

Workshop ObjectivesWorkshop Objectives

• Practical knowledge needed for implementation, including planning, scheduling tests, registration and the preparation of students

• Introduction to scoring and reporting TABE results• Discussion of how to accommodate students with

disabilities• Discussion of basic test management• Discussion of other organization and implementation

needs

Why TABE?Why TABE?

• It provides a complete picture of adult student performance

– Provides both norm-referenced and competency-based/ criterion-referenced information

– Helps educators and other users evaluate clients’ abilities in basic skills (reading, language, mathematics)

• Provides data for initial placement in an Educational Functioning Level (EFL) and subsequent promotion to a higher EFL

• Approved for NRS Reporting

Tests of Adult Basic EducationTests of Adult Basic Education

• Most widely used adult test in the United States (ABE)

• Proven “Validity” and “Reliability”• Norms based on adult reference groups• Content reflects adult learning• Built on 45 years of experience• Grounded in Basic Skills/Higher Order

Thinking Skills – Cognitive Complexity– Bloom, Rankin-Hughes, Norm Webb

History of CTB/McGraw-Hill’sTests of Adult Basic Education (TABE)

History of CTB/McGraw-Hill’sTests of Adult Basic Education (TABE)

TABE 1 & 2 1967

TABE 3 & 4 1974-1975

TABE 5 & 6 1983

TABE 7 & 8 1994

TABE 9 & 10 2003-2004 TABE Online 2006

TABE Adaptive2012

TASC 2014

TABE Content ValidityTABE Content Validity

• Higher Order Thinking Skills – Cognitive Complexity

• National Adult Literacy Survey (NALS)• Standards and Guidelines

– NCTM, IRA, NCTE

• Culturally Diverse Content• Maximum Bias Elimination

– Ethnicity– Age– Gender

Content ValidityContent Validity

Content measures three types of literacy needed for the High School Equivalency and today’s jobs:– Prose literacy —reading and understanding written text – Document literacy —understanding content of

common documents (diagrams, maps, charts, tables, forms, and consumer labels )

– Numeracy —merging knowledge of numerical and word content (the ability to understand complex documents such as tax forms or advertisements that require both text and math skills

2003 NALS Comparative Report to the Nation on Adult Literacy Performance

Versions of TABE

Two Alternate Forms – 9 &10

Two versions for each form

Complete Battery (3 hours, 37 minutes)Complete norm- and criterion-referenced

informationDetailed diagnostic information

Survey (2 hours, 8 minutes)Shorter testing timeEasy screening and placement

TABE Test BookletsTABE Test Booklets

• Level L Form 9 or 10 (consumable)

• Complete Battery Form 9 or 10 (reusable)– Levels E, M, D, or A

• Survey Form 9 or 10 (reusable)– Levels E, M, D, or A

• Large Print Test Books • Braille (9 only)• Audio (9 only)

TABE 9 and 10: A Flexible, Modular Structure

TABE 9 and 10: A Flexible, Modular Structure

*Core Tests:• Reading• Language• Mathematics

– Mathematics Computation

– Applied Mathematics

Plus Tests (Optional):– Language

Mechanics– Vocabulary– Spelling

Advanced Tests (Optional):

• Social Studies and Science• Algebra/Geometry• Writing ( 2 prompts)Instructional Support• Getting to Know TABE• Building Skills With TABEScoring Options• Hand-scoring• TABE-PC or TestMate TABE• TABE Online*approved for federal reporting

Literacy LevelLiteracy Level

Content Area Items Time

Pre-Reading 18 :13

Reading 32 :32

Math Computation 16 :15

Applied Math 34 :45

TABE Administration and Support Materials

TABE Administration and Support Materials

• Test Directions• Norms Book• Technical Report• Individual Diagnostic Profiles• Building Skills with TABE• Getting to Know TABE

TABE 9 & 10 Flexible Options: TABE Online

TABE 9 & 10 Flexible Options: TABE Online

• Web based version of TABE 9&10• Rapid Registration of student in the system• Test scored immediately and automatically• Auto Locator for placing students in test

level• Completely secure test administration and

data storage• Timer and book marking features• Reports allow for aggregation of data• Improved accommodation functionality –

font color/size

TABE 9 & 10 Flexible Options: TABE PC

TABE 9 & 10 Flexible Options: TABE PC

• Entire test or any part completed on computer• Test scored immediately and automatically• Auto Locator for placing students in test level• Option for randomizing distractors/ correct

answer to improve test security• Timer and book marking features• Option for integrating data with TestMate

TABE testing and upload• Same reporting formats as TestMate TABE

Understanding and Using TABE Appropriately

Understanding and Using TABE Appropriately

Frequency of TABE assessments?Frequency of TABE assessments?

• Time prior to post-testing● 50- 60 hours of instruction

(40 min) recommended for ABE students

● 30-59 hours of instruction recommended for ASE students

●same level, different form● 120 hours of instruction

recommended ● same level, same form

TABE Levels by Content DifficultyTABE Levels by Content Difficulty

L 0 - 1.9

E 2.0 - 3.9

M 4.0 - 5.9

D 6.0 - 8.9

A 9.0 - 12.9

• Most questions on tests are written at the content difficulty indicated

• Small amount of questions above and below content range for vertical scaling

Using Best Practices to Administer TABE 9 and 10

Using Best Practices to Administer TABE 9 and 10

Pre-test/Post-test EvaluationPre-test/Post-test Evaluation

Best Practices in Administering TABEBest Practices in Administering TABE

• Inform student about the test experience.– Purpose of testing and use of results– When and where the test will be given– What subject matter will be tested– Types of test questions– Timing and test length– Practice questions

• Create and maintain appropriate testing environment.– Trained administrators and proctors– Appropriate spacing/seating of students

Variables That Can Affect Test ResultsVariables That Can Affect Test Results

Student • Fatigue• Motivation level• Physical

discomfort• Test anxiety

Environmental • Light levels• Temperature• Noise level• Ventilation• Other distractions

Best Practices in Administering TABE Best Practices in Administering TABE

• Use “Locator” to determine appropriate test level.– May not be used instead of test level– Is not an absolute prediction of ability– Has limited number of items– Avoid administering a level “too easy” or “too difficult”

• Use determined test level in a “standardized” manner.– Use proper timing– Read script verbatim– Follow test directions explicitly– Ensure comparable testing situation for all examinees

How to Help ExamineesHow to Help Examinees

Do explain: • Won’t know all the answers• Time frame• No preparation needed• Current skills• Breaks• No trick questions

Do not say: • Easy test• Extra time is allowed

Hand Scoring

• Must have the following to complete:– Scoreze Answer Sheet or CompuScan Answer

Sheet– Stencil overlay or Answer Key to score– Norms Book– Diagnostic Profile Sheet

Using TABE with Special Needs StudentsUsing TABE with Special Needs Students

Adult Students with DisabilitiesAdult Students with Disabilities

• Must self-identify• Must provide approved documentation• Must request accommodation

Modifications / Accommodations of Testing Procedures

Modifications / Accommodations of Testing Procedures

• Flexible scheduling• Flexible setting• Flexible responding• Flexible presentation• Flexible timing

TABE AccommodationsTABE Accommodations

• Making Test Accessible for Adult Students with Special Needs– TABE 9 & 10 -Large Print-(available in Complete

and Survey editions) – TABE 9-Braille-(available in Complete and Survey

Editions).– TABE 9-Audio Taped Edition-(available in

Complete and Survey Editions). – Use of TABE Online or TABE PC.

Maintaining Security and Integrity of TABE 9 and 10

Maintaining Security and Integrity of TABE 9 and 10

Security IssuesSecurity Issues

• Handling Testing Materials– Tracking with TABE Administrators, Students– Keeping Materials in Locked Storage

• No cell phones or electronic devices• Number tests and answer sheets• Plan for contingencies• Active monitoring

– 1 proctor for every 15 students being tested– Direct observation for entire test period

Interpreting and Using TABE ResultsInterpreting and Using TABE Results

Score Range vs. Content Range Score Range vs. Content Range

Skill Level

Grade Equivalent

Range L 0.0–4.9+ E 0.0–6.9+ M 0.0–9.9+ D 0.7*–12.9+ A 1.1*–12.9+

Skill Level

Grade Range

L 0–1.9 E 2.0–3.9 M 4.0–5.9 D 6.0–8.9 A 9.0–12.9

Content RangeGrade Equivalent

How to interpret scoresHow to interpret scores

– The “raw score” (number correct) cannot be compared from Form to Form

• Forms are “alternate” • but not 100% equal item by item

– Number Correct (NC) is starting point for determining meaningful scores• For manual scoring, use norms book

to interpret NC• TestMate TABE, TABE PC & TABE

Online generate instant test reports

Interpretation of Grade Equivalent Scores

Interpretation of Grade Equivalent Scores

• A GE of 7.6 in mathematics does NOT mean the student is capable of doing 7th grade math– it depends on the level of the test being given

• The GE score may not always keep pace with academic growth.– Is a 5.5 GE on M level the same as 5.5 on the D

level?– Can a student’s GE stay the same, but still

demonstrate academic growth?

TABE 9 & 10 Score TypesTABE 9 & 10 Score Types

• Norm-referenced Scores– National Percentile (NP)– Stanine (1-9)– Scale Score (0-999)– GE (0 – 12.9)

• Standard Error of Measurement (SEM)– All tests have error, but how much?

• Criterion-referenced Scores– Number correct– Percent mastery

Scale Scores…0 to 999Scale Scores…0 to 999

• Scale scores are used as

– a basis for deriving the other TABE 9&10 norm-referenced scores that can be used to describe test performance

• The scale score takes into consideration– the difficulty of the form:

• it takes more items correct in “M” than it does in “D” to get the same scale score

• Scale score is the only way to assess educational gain

– All items are on a “vertical” scale

– Being on an equal-interval scale means that the distance between the two scale scores has the same meaning at different points on the scale

Standard Error of Measurement (SEM)

Standard Error of Measurement (SEM)

• Every test has error; important to use SEM for correct interpretation of test scores– Estimate of amount of error to be expected in a

particular score from a particular test

• SEM is:– Attached to each scale score and takes a student’s

“true score” into account– Much larger near the floor or ceiling of the range of

performance for a given test

• Range of performance may be calculated by adding and subtracting the SEM to/from the scale score

38

Linking Data to Instruction

Linking Data to Instruction

Linking Data to Instruction Linking Data to Instruction

• Building Skills with TABE

• Achieving TABE Success

• Contemporary

• Steck-Vaughn

• Number Power and Number Sense

Turning the Focus to InstructionTurning the Focus to Instruction

• Diagnostic Reports - Why Create Them?– Gives an instant view of TABE skills on which to focus prior to

post-testing

– Gives teachers the opportunity to look at their entire class or select individuals performance on TABE Pre-test

– Helps teachers plan instruction – Small group and/or entire class activities based on common skill

weaknesses– Target specific weak skills utilizing the Study Guides books and – Form daily lesson plans

– Provides a reference for pulling extra materials for supplemental practice

– Shapes daily, direct instruction between teacher and student

Julie Anne Kornahrens, Director, Dorchester County Adult EducationApril 12, 2011

Item Analysis Data

1. Individual Diagnostic Profile

2.TestMate for TABE software or TABE PC

3.TABE Online Group Item Analysis Report

4.TABE Teachers Guides Instructional Binders

Turning the Focus to Instruction:

43

44

45

Turning the Focus to Instruction

Correlations from Publishers Content Where to find them? In the front of some of the Instructional

materials Links each question to targeted skill lessons

in that publisher’s materials Used for an Individual Students

Julie Anne Kornahrens, Director, Dorchester County Adult EducationApril 12, 2011

Creating & Using a TABE Study Plan (Prescriptive)• WHY Create Them?

– Provides relevant information to the student about areas of skill strength & weakness

– Ties relevance to TABE skills & skills needed for other academic areas (e.g., HSAP, HSE, etc.)

– Gives an immediate assignment– Focuses on appropriate TABE – Skill practice along

with the use of HSE materials– Gives instant success– Promotes student confidence

Turning the Focus to Instruction

49

Assessment ResultsAssessment Results

• Results of both pre- and post-tests are important to the:– Learner: They should know the reason they are placed

at a certain level, in certain materials, etc. They can also see how much progress they make.

– Teacher: Results should be used to guide instruction and curriculum development.

– Program: Critical for program improvement and accountability for achieving targeted outcomes.

Results should DRIVE the Instructional

Program & TRANSLATE into

POSITIVE Program Performance

• TABE Adaptive released in 2012– No Locator – No E,M,D,A – No 9/10– Reading, Math (Applied & Computation) and Language tests only– Adaptive engine will select test questions base on the student response on the

previous question– Testing time is shortened but diagnostics data similar to the Complete Battery

• Next version of TABE - Development scope work to begin– New Forms (rolled out over time from a collection of unscored test items from

TABE Adaptive and TABE Formative tests)– Higher level content above the current Level A– Aligned to TASC, OVAE/NRS standards and Common Core Standards

• TABE CLAS-E Online - TBA– Computer based testing for Adult ESL students

– Reading, Listening, Writing and Speaking

2014 Plans and Beyond2014 Plans and Beyond

TABE Paper and PencilTABE Paper and Pencil

• Currently TABE 9/10– NRS approved through 2017

• New Version needs NRS and State approval• Content for TABE 11 & 12

– Common Core– OVAE Adult Ed Standards– High School Equiv

• Levels and Forms – TBD

TestMate TABE TestMate TABE

• Scans TABE 9/10 answer sheets

• Updated reports

• Updated to support new scanners

• Updated to support new version of Windows

• Researching an enterprise version that would scan to a web database (TABE Online) for easier aggregation and data sharing

TABE PCTABE PC

• Currently TABE 9/10– NRS approved through 2017

• New USB option replaces Floppy Disk– Support for Windows 7 (above)

• Plans for 2014 and beyond– New interface– Adaptive– Linking to centralized database (TABE Off-

Line)

TABE OnlineTABE Online

• Currently TABE 9/10– NRS approved through 2017

• New Prescriptive Reports

• New Interface

• New Functionality – Selecting multiple students

• New Content– Testlets - FREE– Common Core aligned

Sample CBT ItemSample CBT Item

Best Practices for Administering TABEBest Practices for

Administering TABE• Follow test publisher’s

recommended testing procedures– Be concerned about

test security– Follow NRS and

state guidelines regarding the timing and frequency of testing

– Use the TABE to drive instruction

Questions? - Thank you !Questions? - Thank you !

Mike JohnsonNational Adult Assessment Manager(630) 789-4586 mike.johnson@ctb.com