A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

131
AN INTRODUCTION TO A MULTI- TIERED SYSTEM OF SUPPORTS CLARK DORMAN DON KINCAID

Transcript of A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Page 1: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

AN INTRODUCTION TO A MULTI-TIERED SYSTEM OF SUPPORTS

CLARK DORMANDON KINCAID

Page 2: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Multi-Tiered System of Supports:MTSS

Don Kincaid, FLPBS Clark Dorman, FL PS/RtI

Page 3: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

PROBLEM SOLVING/RESPONSE TO INTERVENTION

OVERVIEW

Page 4: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Response to Instruction/Intervention (RtI):

The Foundation

4

RtI is the practice of

(1)providing high-quality instruction/intervention matched to student needs and

(2)using learning rate over time and level of performance to

(3)make important educational decisions to guide instruction

Page 5: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Avoiding Myths…

5

RtI IS:• A process designed to maximize student

performance• A method to deliver effective interventions

earlier and efficiently• Focused on outcomes• About student progress

RtI IS NOT:• A way to delay services to students• A way to avoid special education placement• A hoop to jump through to ensure special

education placement

Page 6: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

PS/RtI is

Begley

Mr.Koch

HarrisSullivan

McMahon

Asner

O’Neill

Every Ed !

Page 7: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

We Need A New Logic

• Begin with the idea that the purpose of the system is student achievement

• Acknowledge that student needs exist on a continuum rather than in typological groupings

• Organize resources to make educational resources available in direct proportion to student need

David Tilly 2004

Page 8: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

TIER I: Core, Universal

8

GOAL: 100% of students achieve at high levels

Tier I: Implementing well researched programs and practices demonstrated to produce good outcomes for the majority of students.Tier I: Effective if at least 80% are meeting benchmarks with access to Core/Universal Instruction.Tier I: Begins with clear goals:1.What exactly do we expect all students to learn ?2.How will we know if and when they’ve learned it?3.How you we respond when some students don’t learn?4.How will we respond when some students have already learned?

Questions 1 and 2 help us ensure a guaranteed and

viable core curriculum

Page 9: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

TIER II: Supplemental, Targeted

9

Tier II For approx. 20% of students

Core +

Supplemental

…to achieve benchmarksTier II Effective if at least 70-80% of students improve performance (i.e., gap is closing towards benchmark and/or progress monitoring standards).1.Where are the students performing now?2.Where do we want them to be?3.How long do we have to get them there?4.How much do they have to grow per year/monthly to get there?5.What resources will move them at that rate?

Page 10: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

TIER III: Intensive, Individualized

10

Tier III For Approx 5% of Students

Core

+Supplemental

+Intensive Individual Instruction

…to achieve benchmarks

1.Where is the student performing now?2.Where do we want him to be?3.How long do we have to get him there?4.What supports has he received?5.What resources will move him at that rate?

Tier III Effective if there is progress (i.e., gap closing) towards benchmark and/or progress monitoring goals.

Page 11: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

in order to meet benchmarks.

=

These students

Three Tiered Model of Student Supports

The goal of the tiers is student success, not labeling.

get these tiersof support

+

Page 12: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tiers of Service Delivery

Page 13: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

13

ACADEMIC and BEHAVIOR SYSTEMS

Tier 3: Intensive, Individualized Interventions & Supports.

The most intense (increased time, narrowed focus, reduced group size) instruction and intervention based upon individual student need provided in addition to and aligned with Tier 1 & 2 academic

and behavior instruction and supports.

Tier 2: Targeted, Supplemental Interventions & Supports.

More targeted instruction/intervention and supplemental support in addition to and aligned with the core academic and behavior curriculum.

Tier 1: Core, Universal Instruction & Supports.

General academic and behavior instruction and support provided to all students in all settings.

Revised 12/7/09

MTSS & the Problem-Solving Process

Page 14: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.
Page 15: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

The Problem-Solving Process

15Timeline

Page 16: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 1 - What’s the Problem?

In order to identify a problem, you’ve got to start with three pieces of data-

• Benchmark level of performance• Student level of performance• Peer level of performance

16

Page 17: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Expectation

Problem ID

17

Weeks

Student

WPM

Page 18: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Problem ID

18

Expectation

Weeks

Student

Peers

WPM

Page 19: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Peers

Expectation

Problem ID

19

Weeks

WPM

Student

Page 20: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Student

Expectation

Peers

Problem ID

20

Weeks

WPM

Page 21: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Is this an individual student problem or a larger systemic problem?

adapted from:

Heartland AEA 11, Improving Children’s Educational Results

Step 1 - What’s the Problem?

Page 22: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 2 - Problem Analysis: Why is it occurring?

22

Goal: The development of hypotheses about probable causes for why the student is not demonstrating the replacement behavior

Assessments are then conducted to gather information to determine which are most / least likely

Hypothesis/Prediction statement pair:

The problem is occurring because ________________.

If ____________ would occur, the problem would be reduced.

Page 23: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Assessment: How Do We Confirm Hypotheses?

DOMAINS RReview

IInterview

OObserve

TTest

IInstruction

CCurriculum

EEnvironment

LLearner

Step 2 - Problem Analysis: Why is it occurring?

Page 24: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• Effective teaching strategies consider both what to teach and how to teach it.

• Making good decisions will increase student progress.

• It is critical that the instruction be matched to the problem. Howell & Nolet, 2000

Step 3 – Intervention Design: What are we going to do?

Page 25: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Match intervention type & intensity to student(s), setting, problem

Interventions must focus on teaching replacement behavior or skill

Select evidence-based interventions that match context of school/classroom culture

Provide support for implementationTraining/coaching as neededEvaluation of implementation integrity

25

Step 3 – Intervention Design: What are we going to do?

Page 26: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 4: Evaluating Effectiveness of Instruction/Intervention

26

Positive ResponseGap is closingCan extrapolate point at which target student

will “come in range” of peers – even if this long range

Questionable ResponseRate at which gap is widening slows

considerably, but gap is still widening Gap stops widening but closure does not occur

Poor ResponseGap continues to widen with no change in rate

Decision Rules: What is a “Sufficient” Response to Intervention?

Page 27: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Expected Performance

Observed Performance

Winter Spring

Positive Response to Instruction /Intervention

Page 28: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Positive Response to Instruction /Intervention

Performance

Time

Expected Trajectory

Observed Trajectory

28

Page 29: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Expected Performance

Observed Performance

Winter Spring

Questionable Response to Instruction /Intervention

Page 30: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Time

Expected Trajectory

Observed Trajectory

30

Questionable Response to Instruction /Intervention

Page 31: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Expected Performance

Observed Performance

Winter Spring

Poor Response to Instruction /Intervention

Page 32: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Time

Expected Trajectory

Observed Trajectory

32

Poor Response to Instruction /Intervention

Page 33: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Responses & Intervention Decisions

• PositiveOptions:

• Continue intervention with current goal

• Continue intervention with goal increased

• Fade intervention to determine if student(s) have acquired functional independence.

33

Page 34: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• Questionable– Was intervention implemented as

intended?• If no - employ strategies to increase

implementation integrity

• If yes - increase intensity of current intervention for a short period of time and assess impact. – If rate improves, continue.

– If rate does not improve, return to problem solving.

34

Responses & Intervention Decisions

Page 35: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• Poor– Was intervention implemented as intended?

• If no - employ strategies in increase implementation integrity

• If yes -– Is intervention aligned with the verified

hypothesis? (Intervention Design)

– Are there other hypotheses to consider? (Problem Analysis)

– Was the problem identified correctly? (Problem Identification)

35

Responses & Intervention Decisions

Page 36: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Traditional vs. Response to Intervention

Intervention

JL

JL

Intervention

Consider ESETraditional

JL

JL J

Response to Intervention

Consider ESE if

necessary

GeneralEducatio

n

MonitorProgress

MonitorProgress

Problem

Solving

Problem

Solving

Problem

Solving

Problem

Solving

Page 37: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Problem Solving at Tier One

• Is it important to you to know the effectiveness of the core package of services delivered to your students?

• If yes: What information/data do you have to determine this?

• What additional information/data would help you to determine this?

• How can you obtain those data?

• If you had all the information necessary, how would you decide if the core was effective?

Problem Identification

Page 38: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• Do you have enough information/data to generate hypotheses?

• What additional information/data might you need?

• State a Hypothesis/Prediction statement pair.

• What information do you need to validate/invalidate that hypothesis?

• Assume the hypothesis is validated. What will you do next?

Problem Analysis

Problem Solving at Tier One

Page 39: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• What needs to happen to:

• Implement the intervention?

• Support the intervention?

• Assess fidelity?

• Measure effectiveness?

Intervention Design

Problem Solving at Tier One

Page 40: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

• What information/data will you need to determine effectiveness of your instructional change?

• Do you have that information?

• If not, how will you get it?

• What decision rule will you use to declare effectiveness/non-effectiveness?

Response to Instruction/Intervention

Problem Solving at Tier One

Page 41: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

An Essential Shift in Thinking

The central question is not: “What about the students is

causing the performance discrepancy?”

but“What about the interaction of the

curriculum, instruction, learners and learning environment should be altered so that the students

will learn?”

This shift alters everything else.Ken Howell

Page 42: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

POSITIVE BEHAVIOR SUPPORTRESPONSE TO INTERVENTION

FOR BEHAVIOR

OVERVIEW

Page 43: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Objectives

• Participants will be able to:• List 5 similarities between PBS and RtI• Name the essential components of PBS/RtI:B• Identify the core curriculum for Tier 1 School-Wide

PBS/RtI:B • List 3 challenges to PBS Tier 1 implementation

Page 44: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Florida’s PBS Project

Mission:• Increasing the capacity of Florida’s school districts to

address problem behavior using Positive Behavior Support within a Response to Intervention framework

What does the PBS project provide:• Training and technical assistance to districts across

the state in the development and implementation of positive behavior supports at Tiers 1, 2, and 3.

Page 45: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Positive Behavior Supports

• Aims to build effective environments in which positive behavior is more effective than problem behavior

• Is a collaborative, assessment-based approach to developing effective interventions for problem behavior

• Emphasizes the use of preventative, teaching, and reinforcement-based strategies to achieve meaningful and durable behavior and lifestyle outcomes

Page 46: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

School-widePositive Behavior Support

• PBS is the use of evidence-based strategies and systems to: • Decrease:

• problem behavior across settings and students • office discipline referrals • disciplinary exclusions (ISS, OSS)

• Increase:• instructional time and academic performance • school safety• teacher capacity to address problem behaviors • positive school cultures

Page 47: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

PBS: RtIB

• Aligned with Response to Intervention

• Can be adapted to fit your particular school

• Can coexist with most other school-wide programs (Reading First, Character Education, etc.)

• Is consistent with research-based principles of behavior

Page 48: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

PBS and RtI:B

•Core Principles of PBS

• Multi-tiered levels of support• Team process• Builds effective environments• Evidence-based interventions• Effective problem-solving• Data-based decision-making• Progress monitoring • Fidelity of implementation

•RtI:B Critical Components

• Multi-tiered levels of support• Evidence-based instruction and• interventions• Effective problem-solving • Data-based decision making• Progress monitoring • Fidelity of implementation

Page 49: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Braiding Supports

Bohanon, Goodman, & McIntosh. “Integrating Academic & Behavior Supports Within an RtI Framework, Part 1: General Overview” http://www.rtinetwork.org/learn/behavior/integrating-behavior-and-academic-supports-general-overview

A Response to Intervention (RtI) Model is a framework for the

integration of school-wide academic and behavior supports for each tier

of intervention

Page 50: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tiered Model of School Supports & the Problem-Solving Process

ACADEMIC and BEHAVIOR SYSTEMS

Tier 3: Intensive, Individualized Interventions & Supports

The most intense instruction and intervention based on individual student need provided in

addition to and aligned with Tier 1 & 2 academic and behavior instruction and supports.

Tier 2: Targeted, Supplemental Interventions & Supports

More targeted instruction/intervention and supplemental support in addition to and aligned with the core academic and behavior curriculum.

Tier 1: Core, Universal Instruction & Supports

General academic and behavior instruction and support provided to all students in all settings.

FL RtI State Transformation Team, Dec. 2009

Page 51: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Positive Behavior Support

• Takes 3-5 years for comprehensive systems change • District and Administrator support essential• Effective, stable PBS Team

• Philosophical change and Faculty Buy-In • Ownership and active participation by staff• Input and feedback

• Utilizes data-based decision-making

Page 52: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Factors Contributing to the Success of PBS

• District-level planning and support• School-based Administrator support• Faculty and staff buy-in and commitment• Fidelity of implementation• Availability of resources• Contextual fit with school culture and school improvement

plan• Adaptability of the school’s environment

Page 53: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Critical Elements of School-wide PBS

• PBS Team and administrative support• Expectations & Rules – Core Curriculum of Tier 1 PBS• Reward/Recognition program• Teaching expectations, rules and consequences• Effective discipline process, procedures and consequences• Faculty commitment • Implementation fidelity• Classroom PBS systems• Data entry, analysis and effective problem-solving (RtI) • Evaluation and progress monitoring

Page 54: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tier 1: School-Wide Core Curriculum

• School-Wide Expectations and Rules• Essential part of the school’s culture and language• Apply to all staff, students and settings across campus• Are taught like the academic core curriculum• Are reinforced/rewarded when exhibited as academic

accomplishments are rewarded

• Core Curriculum Goals:• Prevent problem behavior• Promote appropriate behavior• Increase instructional time• Enhance school safety • Build a positive school culture

Page 55: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tier 2: Interventions and Supports

• Goals:• Provide remediation• Prevent problem behaviors from getting worse• Identify and support students ‘at risk’ for not

reaching the behavioral expectations

Page 56: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tier 2: Interventions and Supports

• Key Features:• Build on school-wide expectations• Interventions:

• Similar across students• Function-based• Readily available• Easily implemented by all staff • Provide data for progress monitoring

Page 57: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tier 2 Interventions

• Examples:• Check-In Check-Out• Skills Groups

• Social Skills• Anger Management• Problem-Solving• Conflict Resolution

• Mentoring

Page 58: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Tier 3: Individualized Interventions and Support

• Goals:• Provide intensive, individualized supports • Accommodate the needs of students with significant behavioral

difficulties in the least restrictive environment

• Key Features: • FBA/BIP• Interventions:

• Function-based • Individualized • Daily data collection

Page 59: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

PBS/RtI:B Challenges

• Philosophical change regarding behavior• Shift in how staff respond to student behaviors• Acquisition of new skills by students and staff• Need for good data collection and evaluation

systems• Implementation fidelity• No established benchmarks or decision rules

for behavior

Page 60: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Additional Resources

• Florida’s Positive Behavior Support Project• http://[email protected]

• Association of Positive Behavior Support• www.apbs.org

• OSEP Technical Assistance Center on PBIS• www.pbis.org

Page 61: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

USING SCHOOL DATA FOR

PROBLEM-SOLVING

Page 62: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Questions

• Why are data essential for problem-solving at the school level?

• How do we identify the critical data needed for solving academic and behavior concerns?

• How can the 4 step problem-solving model guide the use of academic and behavioral data in a systematic and common way across a district? (i.e., guiding questions).

Page 63: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

WHY ARE DATA ESSENTIAL FOR PROBLEM-SOLVING?

Page 64: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

…for planning?

“Research has found that up-front planning helped make data collection and use more efficient in many case study schools by clarifying what data were needed, aiding with integration of multiple data sources, and ensuring that data collection processes were on track (Keeney, 1998; Lachat, 2001).”

-Kerr, et al., (2006). Strategies to promote data use for instructional improvement: Actions, outcomes, and lessons learned from three urban

districts. American Journal of Education, 112, 496-520.

Page 65: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

…for legal reasons?

• Some data we are required to collect (e.g., NCLB, 2002):– But why? – What questions does this “required data”

potentially help answer?– Can this data be used in our problem-solving

efforts?

• Schools are required to use “evidence”, collect and analyze data, and use those data to make decisions for education improvement. (Coburn & Talbert, 2006; Halverson et al., 2005; Honig & Coburn, 2008; Mills, 2011; Young, 2006)

Page 66: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

…to identify solutions to problems!!!

• Not all data we are asked to collect will be useful for solving local problems.

• Compliance vs. problem-solving• Main question: What data should we

collect for problem-solving. • Tied to what questions are being asked

– Types of data: Screeners, diagnostic measures, progress monitoring measures, outcome or summative measures.

– Each has a function and potential to answer particular types of questions.

Page 67: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Decision-making – Need Data

• Assumptions: – The appropriate data are needed for school

level problem-solving– No matter how useful the data may be, they

are NOT useful if they are not used.

• Data Chaos! • To teach others about data we need to

separate– Management (infrastructure-data system)– Use (analysis and decision-making)

Page 68: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

HOW DO WE KNOW WHAT CRITICAL DATA

ARE NEEDED?

Page 69: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Consensus on Data?Coburn & Talbert, 2002

• What does “data-based problem-solving” mean to you?

• Do you know what to collect?• Do you know why it is being collected?• Do you know what the data are used for?• Do you know what to do after you have the

data? After you analyze it?

• How aligned is your assessment system with answering key questions and how valuable are your district’s data to solve what problems?

Page 70: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are your data useful? For what?

Data source(s) should:• provide sufficient information to

select appropriate services and supports.

• allow you to group students with similar needs

• match the nature of the problem, the target responses/knowledge identified for change, and key problem-solving questions.

Page 71: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Data Management: Let’s Redefine “Data System”

• Prepare to Collect• Collect the data• Organize the data• Summarize the data• Share the data• Support the team to use the data• Analyze the data• …Make a decision!

Page 72: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

WHAT QUESTIONS SHOULD WE BE ASKING

TO SOLVE PROBLEMS?

Page 73: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Problem Solving Process

Define the ProblemWhat Do We Want Students to KNOW and Be Able to

DO?

Problem AnalysisWhy Can’t They DO It?

Implement PlanWhat Are WE Going To DO About

It?

EvaluateDid It WORK?

(Response to Intervention –RtI)

Page 74: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Florida’s Guiding Questions

Step 1 – Problem ID• What do we expect out students to know, understand, and do as a result of

instruction?• Do our students meet or exceed these expected levels? (How sufficient is

the core?)• Are there groups for whom core is not sufficient?  Step 2 – Problem Analysis• If the core is NOT sufficient for either a “domain” or group of students,

what barriers have or could preclude students from reaching expected levels? 

 Step 3 – Plan Development and Implementation• What strategies or interventions will be used?• What resources are needed to support implementation of the plan?• How will sufficiency and effectiveness of core be monitored overtime?• How will fidelity be monitored over time?• How will “good”, “questionable,” and “poor” responses to intervention be

defined?  Step 4 – Plan Evaluation of Effectiveness• Have planned improvements to core been effective?

Page 75: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 1: Problem Identification –Tier 1

• What do we expect our students to know, understand, and do as a result of instruction?

• Do our students meet or exceed these expected levels? (How sufficient is the core?)

• Are there groups for whom core is not sufficient?

Page 76: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Expectations for Behavior

• 80% have 1 or fewer ODRs• Are the # of ODRs, ISS and OSS per

100 students higher than the national or district average?

• Are the # of ODRs, ISS and OSS per 100 students decreasing?

• Is attendance steady?

Page 77: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Expectations for Literacy & Math

• Sunshine State Standards (SSS)• Grade-level expectations (GLE)• Objectives and Goals of GLEs

• The standards are the curriculum.• Tier 1 data: AYP (state test-NCLB); State

reading test (FCRR/FAIR)• State assessments based on SSS.• Additional, district specific?

Page 78: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Annual Yearly Progress (AYP)

Page 79: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 1: Problem Identification –Tier 1

• What do we expect our students to know, understand, and do as a result of instruction?

• Do our students meet or exceed these expected levels? (How sufficient is the core?)

• Are there groups for whom core is not sufficient?

Page 80: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Do 80% of students exhibit appropriate behavior?

Page 81: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Do 80% of students exhibit appropriate behavior?

Page 82: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

During the current year, does the school have students with 2 or more ODRs by October 1?

Page 83: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students higher than the national or district average?

• National Average for MS is .05 per 100 students

Page 84: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students decreasing?

Page 85: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students decreasing?

Page 86: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Is attendance steady?

Page 87: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Sources of Data

Page 88: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Utilizing Common Assessment Data to Understand Student Needs

Page 89: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Class Recommended Level of Instruction Report

This report provides a summary of the students’ overall progress. It can be used to get an overall sense of instructional levels in the class and to calculate the Effectiveness of Core Instruction (ECI) index and the three Effectiveness of Intervention (EI) indices.

Page 90: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

How sufficient is the core?

Page 91: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

How sufficient is the core?

Page 92: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Academic Sufficiency

Average Scores 6 7 8

Statewide 57% 62% 68%

District 55% 58% 59%

Sunshine Middle 36% 43% 52%

Page 93: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 1: Problem Identification –Tier 1

• What do we expect our students to know, understand, and do as a result of instruction?

• Do our students meet or exceed these expected levels? (How sufficient is the core?)

• Are there groups for whom core is not sufficient?

Page 94: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups of students for whom the Tier 1 Core is not sufficient?

Page 95: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups of students for whom the Tier 1 Core is not sufficient?

Page 96: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups of students for whom the Tier 1 Core is not sufficient?

Page 97: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups for whom core is not sufficient?

Page 98: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups for whom core is not sufficient?

Page 99: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.
Page 100: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 2 – Problem AnalysisTier 1

• If the core is NOT sufficient for either a “domain” or group of students, what barriers have or could preclude students from reaching expected levels? – Why are some students not successful

(Initial Hypotheses)?

 

Page 101: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

What potential barriers have precluded us from achieving expected performance levels?

Lack of…• Common Assessments• Common Planning• Ongoing Progress Monitoring• Curriculum Mapping Aligned with

NGSSS and Common Assessments

• Resource Availability• Administrative Support• Professional Development

Page 102: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Instruction Curriculum Environment Learner

Alignment with Standards and Across Grade/School Levels, Relevancy to Students’ Personal Goals,Content, Pacing, Progression of Learning, Differentiation

Cognitive Complexity of Questions and Tasks, Gradual Release of Responsibility, Appropriate Scaffolding, Connection to Students’ Personal Goals, Interests and Life Experiences

Reward/Consequence System,Visual Cues,Climate/Culture, Quality of Student/Adult Relationships, Quality of Peer Relationships, High Expectations for ALL Students, Collaboration and Voice

Reinforcement Preferences, Perceptions of Competence and Control, Perceived Relevancy of Instruction/Education, Integration and Affiliation with School, Academic/Social-Emotional Skill Development

Page 103: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Hypothesis= Instructional

Page 104: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 2: Problem Analysis –Tier 1

1. Instruction • Are best practices in instruction being delivered to those

students? • Is instruction being delivered in sufficient amounts or as often as

necessary? 2. Curriculum• Are lesson plans in alignment with the appropriate core

standards/expectations?• Are the curricular materials being used with fidelity or as

designed?• Does staff have the knowledge and skills to utilize the curricular

materials in alignment with grade-level/school-wide standards or expectations?

3. Environment• Do all staff and students know the school-wide behavioral

expectations? • Are they being used consistently across all settings? (e.g., school

climate)?• Are the school-wide behavioral expectations in alignment with the

school/district missions?• Are best practices in classroom management being utilized and in

alignment with the school-wide behavioral expectations?4. Learner• Are students accessing the available instruction? (e.g.,

attendance)• Are students “actively engaged” in classroom instruction?• Do students perceive having a positive relationship with their

school/teachers?

Page 105: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 3: Plan Devel. and Implementation–Tier 1

• What strategies or interventions will be used?

• What resources are needed to support implementation of the plan?

• How will sufficiency and effectiveness of core be monitored overtime?

• How will fidelity be monitored over time?

• How will “good”, “questionable,” and “poor” responses to intervention be defined?

Page 106: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Key Considerations

• Utilize existing tools and resources whenever possible.

• Align strategies and interventions specifically to identified barriers which preclude student success within core instruction.

• Select research-based strategies and interventions to address identified barriers.

• Communicate the “compelling why” of interventions with teachers, parents, and students.

Page 107: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Intervention Linked to Underlying Barrier

• Mentoring programs• Goal Setting & career

planning support• Frequent progress reports• Targeted rewards• Mandatory study hall• Mandatory homework help• Study skills classes

• Targeted, differentiated instruction

• Additional instructional time

• Pre-teach essential skills, content, and vocabulary

• Review/Reteach prerequisite skills to address the learning gap

• Prevention (requires vertical articulation with middle/elementary school and early identification of at-risk students)

CAUTION: Failed Learners often become disengaged over

time and may require both categories of intervention

support

Disengaged Learners Failed Learners

Page 108: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Critical

Element

Step 1:What is the problem/issue/task to be

addressed?

Step 2:Why is it occurring?

Step 3:What are we going to

do about it?

To-Do List Persons Responsible

Follow-Up or Completion Date

Step 4: How will we know when we’ve

been successful?

     

  

  

1.      

2.    3.    

4.       

5.    

6.     

 

     

1.    

 2.    

3.    

4.    

 5.    

6.     

 

     

1.    

 2.    

3.    

4.    

 5.    

6.     

 

     

1.    

 2.    

3.    

4.    

 5.    

6.    

Tier 1/Universal PBS: Specific RtI:B Action Plan

Critical Elements: PBS Team; Faculty Commitment; Discipline Procedures; Data Entry & Analysis; Expectations & Rules; Reward/Recognition Program; Lesson Plans; Implementation Plan; Classroom Systems; Evaluation

Page 109: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Sources of Data

Page 110: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Selecting Research-Based Strategies and Interventions for Academics and Behavior

Page 111: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Selecting Research-Based Strategies and Interventions

Page 112: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Technology Resources

Page 113: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Planning for Step 4

• How will fidelity of interventions be monitored over time?

• How will sufficiency and effectiveness of strategies and interventions be monitored over time?– How will the data be displayed?

• How will “good”, “questionable,” and “poor” responses to intervention be defined?

Page 114: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

How will fidelity be monitored over time?

• Fidelity of implementation is the delivery of instruction in the way in which it was designed to be delivered.

• Fidelity must also address the integrity with which screening and progress-monitoring procedures are completed and an explicit decision-making model is followed.

• Fidelity also applies to the problem solving process…bad problem solving can lead to bad decisions to implement otherwise good interventions.

Page 115: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Fidelity?

Page 116: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Fidelity Tier 1-3

Page 117: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Step 4: Plan Evaluation–Tier 1

• Have planned improvements to core been effective?

Page 118: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students higher than the national or district average?

• National Average for MS is .05 per 100 students

Intervention in August produced immediate and sustained change.

Page 119: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students decreasing?

Over 50% reduction in two years.

Page 120: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are the # of ODRs, ISS and OSS per 100 students decreasing?

Implementation produced immediate and sustained change.

Page 121: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Are there groups of students for whom the Tier 1 Core is not sufficient?

Do these bar graphs level out indicating no disproportionality?

Page 122: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Fidelity?

Does the school see improvements next year in these area?

Page 123: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

How will “good”, “questionable,” and “poor” responses to intervention be defined?

Decision Rules:

• Positive Response

– Gap is closing– Can extrapolate point at which target student(s) will

“come in range” of target--even if this is long range

• Questionable Response

– Rate at which gap is widening slows considerably, but gap is still widening

– Gap stops widening but closure does not occur

• Poor Response

– Gap continues to widen with no change in rate.

Page 124: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Positive Outcomes in Tier 1

• Positive• Continue intervention with current goal

• Continue intervention with goal increased

• Fade intervention to determine if student(s) have acquired functional independence.

Page 125: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Positive Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Gap is closing, Can extrapolate point at which target student(s) will “come in range” of target--even if this is long range

Page 126: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Questionable Outcomes Tier 1

• Questionable– Was our DBPS process sound?

– Was intervention implemented as intended?• If no - employ strategies to increase

implementation integrity

• If yes -

– Increase intensity of current intervention for a short period of time and assess impact. If rate improves, continue. If rate does not improve, return to problem solving.

Page 127: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Questionable Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Rate at which gap is widening slows considerably, but gap is still widening

Gap stops widening but closure does not occur

Page 128: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Poor Outcomes Tier 1

• Poor– Was our DBPS process sound?

– Was intervention implemented as intended?• If no - employ strategies in increase implementation

integrity

• If yes -

– Is intervention aligned with the verified hypothesis? (Intervention Design)

– Are there other hypotheses to consider? (Problem Analysis)

– Was the problem identified correctly? (Problem Identification)

Page 129: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Performance

Fall

Poor Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Gap continues to widen with no change in rate.

Page 130: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Questions?

• Do you have questions?

Page 131: A N I NTRODUCTION TO A M ULTI -T IERED S YSTEM OF S UPPORTS C LARK D ORMAN D ON K INCAID.

Contact Information

• Don Kincaid– [email protected]

• Clark Dorman– [email protected]