Direct Behavior Ratingsand

Daily Behavior Cards

Amy Jablonski, A.T. Allen Elementary School

Assistant Principal for Instruction

Leah Mills,A.T. Allen Elementary School

Second Grade Teacher

Direct Behavior Rating and Daily Behavior Cards

Objectives• What is a Direct Behavior Rating?• Why use Direct Behavior Ratings?• How can Direct Behavior Ratings be used

with PBIS and RtI?• Explore the effectiveness of whole school

Daily Behavior Card.• School site example of Daily Behavior Cards

Direct Behavior RatingsDefinition: Assessment tool that combines characteristics of

systematic direct observation and behavior rating scales. – SDO- method of behavioral assessment that requires a trained

observer to identify and operationally define a behavior of interest, use a system of observation in a specific time and place, and then score and summarize the data in a consistent manner (Salvia & Ysseldyke, 2004; Riley-Tillman, Kalaber, Chafouleas, 2006)

• Rate 1 target behavior (ex: degree to which a student is engaged in activity)

• Use a scale to rate the degree to which that behavior was displayed during specified time

• Target for short amount of time

Direct Behavior Ratings: Background

CURRENT/TRADITIONAL• Most behavioral data has

been collected from office referrals– Not able to capture all

behaviors– Not sensitive to individual

student needs– Compiled after long a set

period of time (month, semester, year)

• Formative data has been used to progress monitor academics (curriculum based measurements)

DBRs• Rating target on a behavior

scale for one behavior (ex: off task behavior during class)

• DBRs are designed to be used formatively and for specific amount of time

ExampleStandard

DBR

Direct Behavior Ratings: Overall Purpose

• Used to assess the effectiveness of an intervention

• Document student progress

• Communication within the school

• Home-school consistency and communication

Direct Behavior Ratings: Characteristics

• DBRs are designed to be used formatively (repeated) and for specific amount of time (3 weeks) and rates a specific behavior– Specified behavior– Data is shared with team members– Card serves as progress monitoring tool for

effectiveness of intervention

• Flexibility to design actual rating and procedures based on student need

(Chafouleas, Riley-Tillman & McDougal, 2002)

DBRs Must Have…• Behavior must be operationally defined• Observations conducted using standard

procedures• Used at predetermined specific time, place,

and frequency• Data must be scored and summarized in

consistent matter

When put together equals a ‘systematic’ DBR

When to use…When should you use DBRs?• Guiding questions:

– Why do you need the data?– Which tools are the best match to assess the

behavior of interest?– What decisions will be made using the data?– What resources are available to collect the data?

• When multiple data are needed on the same student(s) and/or behavior(s)

When to use…• Limited resources• Low-priority situations• Educators are willing to use • Answering the following questions

– “Is a class-wide intervention effective for changing a particular student’s problematic behavior?”

– ‘Does a child continue to display a behavior when this intervention is put in place?”

• Frequent data is needed

Guiding Questions for Creating a DBR

What is the target behavior and goal?Focus on specific behavior

What is the focus of the rating?Individual, small-group, or class-wide

What is the period of rating?Specific school period, daily or other

What is the setting of observation?Classroom or other location

Guiding Questions for Creating a DBR

How often will data be collected?Multiple times a day, daily, weekly

What is the scale for rating that will be used?Checklist, Likert-type scale, continuous line

Who will be conducting the rating?Classroom teacher, aide, or other educational professional

Will ratings be tied to consequences?Consequences must be consistently delivered by person responsible

Points to consider when creating DBRs…

Designing the Card: What and Who

• Define the target behavior and who is the focus of the rating– Increase positive behaviors– Decrease negative behaviors– Individual student/small group

Designing the Card: Scale• Decide what scale will be used

– Maturity of the individual being rated– Smiley faces– Likert-type scale

• Recommended to use 1-10 vs 1-5

• Continuous line• Check list

Direct Behavior Ratings• Example of rating scales

– 1-10 (1 being no behavior observed)– Faces (happy, neutral, sad)– Continuous line– Check mark

• Must be ‘rater friendly’ and easy to implement across all settings

Options for DBR Scales

Designing the Card: When, Where, and How Often

• Frequency of collection– Specific period of time – Entire day– Record immediately

• Frequency of summary– Daily – Weekly

• Location– Where behavior is noticed

Designing the Card: Who Will Conduct Rating

• Classroom teacher or adult with student most of the day– Word of caution: Profiling the attributes of a

student

• Increased efficiency

• Willingness to rate

• Same rater avoids inconsistenciesChafouleas, Christ, et al., 2007; Chafouleaus, Riley-Tillman, et al., 2007

Designing the Card: Who Will Conduct Rating

• Caution: DBR data is the rater’s perception of student behavior

H. Walker has found:

“Teachers universally endorse a similar profile of attributes, yet differ significantly in their tolerance levels for deviant behavior.”

Designing the Card: Who Will Conduct Rating

• Student Self-Monitoring– Intervention for teaching behavior– Effective for a variety students

• Success– Teaching to accuracy– Initially compare– Positively reinforce

Designing the Card: Will there be consequences?• Will consequence be involved with DBR

– Individual basis– Positive reinforcements

• Communication between school and home– Consequences at home as result of ratings

on DBR– Same language/same expectation

After Implementation• Fidelity

– Does rater compete the DBR as specified?– Completed at right time of day?

• Periodically check in with rater– Integrity checklist

• If fidelity is an issue– Discussion with feedback – Modify plan

• Review acceptability of DBR with rater

Matching Data• Does the DBR data correspond with other sources?• Situation: Teacher’s perception of student’s behavior

and the student’s behavior do not correspond.Hypothesis

1. The student (or teacher) behaves differently when school psychologist is present2. Teachers is measuring something different than target data3. Teacher does not perceive a positive effect that the intervention has

• Solution: dialogued and discussion

Summarizing Data• Summarize relevant to the scale being

used

• Averages per week

• High or low ratings

• Bar chart

• Line graph

Frequency of Behavior

0

2

4

6

8

10

12

14

16

18

8-9am 9-10am

10-11am

11-12pm

12-1pm

1-2pm

Time

Nu

mb

er

of

Mark

s t

his

Year

# of Marks

Marks on Cards by BehaviorFailure to meet the expected behavior

0

10

20

30

40

50

60

70

Not Following Directions Not Using Self-Control Not Behaving inConnect

Behavior

Fre

qu

en

cy o

f B

eh

avio

r (t

his

ye

ar)

Strengths of DBRs

High Flexibility• Preschool through high school

• Wide range of behaviors

• Individual or large group

• Effective to monitor ‘hard to notice’ behaviors – Outbursts and obvious behaviors easily

noticed in short observation

High Feasibility, Acceptable, Familiar

• Teachers are accepting of DBR as tool and intervention

• School psychologists accept DBR as intervention monitoring tool

• Familiar language for teachers

• Becomes part of daily routine

Progress Monitoring• Constructed in a way to be connected to

behavioral expectations• Administered quickly• Available in multiple forms• Inexpensive• Completed directly following specific rating time• Set goals and progress monitor • Increase communication between home and

school

Reduced Risk of Reactivity• Reactivity effect: teacher and students will

behave in atypical ways• Research findings

– Increase the rate of prompt or positive feedback to the target student

(Hey, Nelson, & Hay, 1977, 1980)

• Behavior can be documented entire day• One observer interrupts classroom space

Weaknesses of DBRs

Rater Influence• Influence of raters not fully understood• May be less accurate estimate of student’s

actual behavior during rating period• History with student• Sattler (2002) Research:

– Low reliability– Scale issues– Time delay between observation and recording

Limited Response Format• Less sensitivity to change compared to

systematic direct observation• Same score given to student not displaying

the behavior and student displaying behavior at a low frequency

Is this really new?• No….Other names for DBRs include:

– Home-School Note– Behavior Report Card– Daily Progress Report– Good Behavior Note– Check-In Check-Out Card– Performance-based behavioral recording

Whole-School Based Assessment Approach

School-Based Behavioral Assessment

• Tier I (primary level) – assessment efforts are preventive and proactive

indicators of performance

• Tier II (secondary level) – assessment efforts focused on select group of

students deemed for at risk– progress monitoring

• Tier III (tertiary level) – assessment focused on individual student– progress monitoring

Behavioral Assessment: Whole School Approach

• Use whole-school data to determine what, how, where, and when behaviors are occurring

• Proactive approach to determining potential problem areas and student concerns

• Assists with Special Education – Behavior goals– Progress monitoring

Behavioral Assessment: Whole School Approach

• Productive and effective school environment– Clear expectations– Common language– Immediate conversations– Communication within the school

School Site Example:

Whole School Approach and DBRs

A.T. Allen Elementary School

• Cabarrus County• K-5 Elementary School• Full Title I school• Demographics

– 54% free and reduced lunch– 27% Hispanic population– EC population- resource, speech, self-

contained classroom (previous years)

Behavior Cards• Created over 15 years ago• Track student behavior• Communication in school and with home• Movement to ‘Positive Discipline’• Based on administration and staff

expectations (SIT team)

Early Version of Behavior Card

Sent home weekly

Students were to earn a point each hour of the day.

Different card at each grade level

Behavior Cards• Adjusted over time

• Same card for entire school

• Creation of daily cards as an option– Carbon copy

Behavior Cards toResponsibility Cards

• Need for change– Change in staff– ‘Buy in’ not present– Inconsistent use of card in school

• Implementation of Positive Behavior Intervention & Support

Responsibility Cards

Responsibility Cards• Matched expectations with PBIS expectations:

– Be Safe, Be Responsible, Be Respectful

• Added location column– Assist with communication– Data collection to choose intervention

• Ex: bathroom vs. classroom• Focus on area of need: more targeted

• Sent home daily for all students vs. weekly• Communication• Teacher ‘remembering’ incident

Classroom Application

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Daily Behavior Cards• Increases in-school communication

– Student accountability in common areas and all classes

• Parent communication– Track behavior for each hour– Specific behavior noted

• Data driven decisions– Individual student plans made– Time of day– Location– Determine effectiveness of intervention

Parent Perspective

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Daily Behavior Cards and DBRs Together

• Use data on card to target behavior

• Choose Daily Behavior Rating scale– Match student needs– Ease of teacher use

• Implement intervention

• Keep data on that one target behavior using DBR

Daily Behavior Cards and Daily Behavior Ratings Together

• Progress monitor on behavior• Graph data

– Use data to make decision:• Discontinue intervention• Change intervention• Move to next Tier/Level

• Continue to use Daily Behavior Card throughout day

Key Points• Clear definition of behavior

• Training/information for staff members involved– Same language– Same policy for rating

• Choices for re-teaching opportunities

Writing IEP Objectives

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Student Example• Found target behavior

• Created DBR

• Implemented intervention

• Collected data

• Progress monitored

• Used data to make decision

• Continued progress monitoring

Example• Target behavior: tantruming

• Clear definitions of mild, moderate, severe

• Tracking in all areas of the school

• Training on ratings given to needed staff members

Beginning Data Collection

0

2

4

6

8

10

12

14

16

18

20

Non-Compliance

Left area Tantruming Crawling/hiding VerbalDisruptive

Hanging ontoobject

PhysicalAggressive

Target Behaviors

Nu

mb

er o

f In

cid

ents

Graph DBR

Mild: Grunting, stomping on floor, swaying in class that results in being off-task and/or disrupting classMedium: Refusal, screaming/yelling, crawling under desk and tablesSevere: Threats to safety: kicking, hitting, throwing objects, runnning, darting, physical aggression

No InterventionIntervention 1Intervention 1 Continued

Frequency of Tantrums

25

8

4

8

44 43

0

5

10

15

20

25

30

Type of Tantrum

Nu

mb

er

of

Incid

en

ts

Mild Meduim Severe

What do the students say?

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Staff Insight

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Administrative Support

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Questions/Comments….

Resources

www.interventioncentral.org - This website offers an extensive resource on using behavior ratings in the Classroom Behavior Report Card Manual.

Chafouleas, S.M., Riley-Tillman, T.C., & Sugai, G. (in press). Behavior Assessment and Monitoring in Schools. New York: Guilford Press.

Crone, D. A., Horner, R. H., & Hawken, L. S. (2004). Responding to problem behavior in schools: The behavior education program. New York: Guilford Press.

Jenson, W.R., Rhode, G., & Reavis, H.K. (1994). The Tough Kid Tool Box. Longmont, CO: Sopris West.

Kelley, M.L. (1990). School Home Notes: Promoting Children’s Classroom Success. New York: Guilford Press.

Shapiro, E.S., & Cole, C.L. (1994). Behavior change in the classroom: Self management interventions. New York: Guilford Press.

For More Information• Amy Jablonski, A.T. Allen Elementary School ajablons@cabarrus.k12.nc.us• Leah Mills, A.T. Allen Elementary School lmills@cabarrus.k12.nc.us

• Charouleas, S., Riley-Tillman, T. C., & Sugai, G. (2007). School-Based Behavioral Assessment: Informing intervention and instruction.

RILEYTILLMANT@ecu.edu