Assessment

Developing an Assessment

Assessment Planning Process Analyze the environment

Agency, clients, TR program, staff & resources Define parameters

Function, content, implementation strategy Select or develop assessment Establish assessment protocols Train staff & interns on protocols

• Peterson & Stumbo, 2000

Assessment Implementation Process Review assessment protocol Prepare for assessment Administer assessment to client Analyze or score assessment results Interpret results for placement into

programs Document results of assessment Reassess client as necessary/monitor

progress• Peterson & Stumbo, 2000

Selection of Assessment Procedure Determine the purpose Specify the exact content to be

covered Identify other selection criteria Search assessment resources Compare possible procedures to

selection criteria Select assessment

Reality “In actual practice, more therapeutic

recreation specialists rely on agency-specific assessments than on nationally available tests.”

• Peterson & Stumbo, 2000, p. 221 Why?

Content of commercial assessments rarely matches content of programs or agencies

Rationale for Teaching Development to Undergraduate Students

“Many individuals feel that assessment development and validation is a complex enough process that it should not be advocated as a task for the typical TRS. Individuals with bachelor’s degrees may not have the conceptual and statistical expertise for development and validation. Another view states that TRSs are more likely to develop their own assessments (good or bad) than buy commercial assessments so instruction in correct methodology is important.” (Stumbo, 2002, p. 163)

Developing an Assessment Select the assessment content

• Comes from content of program• Based on current literature, needs of

clients, and TR models or theories Develop list of programs designed for a

specific group Define client goals

Developing an Assessment Determine the assessment purpose

Placement into programs Basic screening, identifying problems,

narrow problems, reassess problems Understand client group

Disabilities, education, backgrounds, etc.

Developing an Assessment Determine type of assessment

Interviews, observations, self-administered surveys, record reviews

How many clients assessed? How much staff time is available for

assessment? What are the skills of staff? What will yield the best information to

place in programs?

Developing an Assessment Select the client outcomes to be

assessed Outline the assessment content Make a two-way chart

Make sure assessment is representative of content of program

See p. 170

Developing an Assessment Select the type of items to use

Closed-ended or open-ended Yes/no, true/false, matching, multiple

choice, rating, & ranking = closed Fill-in-the-blank, short answer, &

extended answer = open Match the items to specific client

outcomes

Developing an Assessment Make the final selection of items

See Stumbo, 2002, p. 181-182 Norm group Validity & reliability

Developing an Assessment Make manual/protocol

Directions for administration, scoring, interpretation, and reporting

Reliability & validity See Stumbo, 2002, p. 182-183

Pilot test & make revisions