Post on 19-Dec-2015
Getting Ready for Phase II of the SSIP
Anne Lucas, ECTA/WRRC/DaSyVirginia Reynolds, NCSI
Taletha Derrington, DaSy/NCSIGrace Kelley, SERRC
Christina Kasprzak, ECTA/DaSyMegan Vinh, ECTA
December 1, 2014
2
Webinar Outcomes
• Understanding key requirements of Phase II• Understanding how Implementation Science
principles might be used in developing an improvement plan
• Understanding what constitutes a good improvement plan (or strategic plan)
• Introducing the concept of evaluation
OVERVIEW OF PHASE II
3
Year 1 - FFY 2013Delivered by Apr 2015
Year 2 - FFY 2014Delivered by Feb 2016
Years 3-6 FFY 2015-18Feb 2017- Feb 2020
Phase IAnalysis
Phase IIDevelopment
Phase IIIEvaluation and Implementation
• Data Analysis;• Description of
Infrastructure to Support Improvement and Build Capacity;
• State-identified Measureable Result;
• Selection of Coherent Improvement Strategies
• Theory of Action
• Multi-year plan addressing:
• Infrastructure Development;
• Support EIS Program/LEA in Implementing Evidence-Based Practices;
• Evaluation Plan
• Reporting on Progress including:
• Results of Ongoing Evaluation
• Extent of Progress
• Revisions to the SPP
Proposed SSIP Activities by Phase
4
5
Phase II - Improvement Plan: Infrastructure Development
Infrastructure development includes:• Improvements to infrastructure to better
support EIS programs/LEAs to scale up evidence-based practices to improve SiMR– Who will implement infrastructure changes– Resources needed– Expected outcomes – Timelines
6
Phase II - Improvement Plan: Infrastructure Development
Infrastructure development includes (cont’d):• Identify steps to further align/leverage current
improvement plans/initiatives• How to involve other LA/SEA offices and other
agencies
7
Support for implementing evidence-based practices includes:• Activities supporting implementation of
strategies including: – Communication strategies and stakeholder
involvement– How identified barriers will be addressed– Who will be in charge of implementing– How activities will be implemented with fidelity
Phase II - Improvement Plan: Evidence-based Practices
8
Phase II - Improvement Plan: Evidence-based Practices
• Activities include (cont’d):– Resources that will be used– How expected outcomes of strategies will be
measured– Timelines
• How multiple offices/other state agencies will be involved to support LEAs/EIS programs in scaling up and sustaining evidence-based practices implemented with fidelity
9
Phase II - Improvement Plan: Evaluation
• The plan to evaluate implementation includes:– Short-term and long-term objectives to measure
implementation and impact on results– Long-term objectives for children exiting Part C
• Plan must be aligned with:– Theory of Action– Other components of SSIP
10
Phase II - Improvement Plan: Evaluation
• Plan must include:– How stakeholders will be involved– Methods to collect and analyze data on activities
and outcomes – How State will use evaluation results to:
• Examine effectiveness of implementation plan• Measure progress toward achieving intended outcomes• Make modifications to plan• How results of evaluation will be disseminated
11
IMPLEMENTATION SCIENCE
Some Ideas to Consider
The SSIP cannot thrive in a vacuum - EIS/special education state agencies will not be successful if the
SSIP is disconnected from the agency’s focus and work.
12
Some Ideas to Consider
The SSIP should be aligned to and integrated with other initiatives in the state.
– Supports leveraging of resources - greater influence
– Prevents duplication of efforts– Builds momentum and capacity– Improves results
13
14
http://sisep.fpg.unc.edu/ https://unc-fpg-cdi.adobeconnect.com/_a992899727/ai-lesson-quickstart/
Implementation Science Active Implementation Frameworks
WHO
Teams
HOW
Drivers
HOW
Cycles
WHAT
UsableInterventions
WHEN
Stages
15
Performance Assessment(Fidelity)
Coaching
Training
Technical
Systems Intervention
Facilitative Administration
Decision Support Data System
Com
pete
ncy
Driv
ers
Com
pete
ncy
Driv
ers
Organization D
rivers
Organization D
rivers
Consider Implementation Science:Implementation Drivers
© Fixsen & Blase, 2008Leadership
Selection
Adaptive
16
The HexagonAn EBP Exploration Tool
NEED
FIT
RESOURCES
EVIDENCE
CAPACITY
READINESS
Fit with current Initiatives• Local program, state priorities• Organizational structures
Community values
Need in local programs, state• Academic & socially significant Issues• Parent & community perceptions of need• Data indicating need
Resources and supports for:• Curricula & Classroom• Technology supports (IT dept.)• Staffing• Training• Data Systems• Coaching & Supervision• Administration & system
Evidence•Outcomes – Is it worth it?•Fidelity data•Cost – effectiveness data•Number of studies•Population similarities•Diverse cultural groups•Efficacy or Effectiveness
Capacity to Implement• Staff meet minimum qualifications• Able to sustain Imp Drivers
• Financially • Structurally
• Buy-in process operationalized• Practitioners • Families
Readiness for Replication• Qualified purveyor• Expert or TA available• Mature sites to observe• Several replications• How well is it operationalized?• Are Imp Drivers operationalized?
The “Hexagon” can be used as a planning tool to evaluate evidence-based programs and practices during the Exploration Stage of Implementation.
Download available at:www.scalingup.org/tools-and-resources
EBP:
5 Point Rating Scale:High = 5; Medium = 3; Low = 1.Midpoints can be used and scored as a 2 or 4.
High Med Low
Need
Fit
Resource Availability
Evidence
Readiness for Replication
Capacity to Implement
Total Score
© National Implementation Research Network 2009-2012 Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland
Resources1. Active Implementation Hub: http://implementation.fpg.unc.edu/2. ECTA Implementation Processes: http://ectacenter.org/implementprocess/implementprocess.asp3. Hexagon tool: www.scalingup.org/tools-and-resources4. National Implementation Resesarch Network: http://nirn.fpg.unc.edu/5. Implementation Drivers: Assessing Best Practice http://implementation.fpg.unc.edu/sites/implementation.fpg.unc.edu/files/resources/NIRN-Education-ImplementationDriversAssessingBestPractices.pdf 17
Consider Implementation Science:Implementation Drivers
DEVELOPING A GOOD SSIP PLAN
Planning is something you do so when you do something it is not all messed upChristopher Robin to Winnie the Pooh
18
19
What Results will Your Plan Achieve?
Good outcomes for children with disabilities and their families
Result:
Implementation of effective practices
Governance
Finance
Personnel /
Workforce
Data Systems
Accountability &
Quality Improvem
ent
Quality Standards
Broad Data Analysis• Analysis of data to identify areas lower performance and results for children/families;
• Qualitative and Quantitative data
Broad Infrastructure Assessment• Analysis: current initiatives; current strengths and
challenges of system components• Qualitative and Quantitative data
Primary Concern(s)/Focus(es)
Data Analysis• In-depth Analysis Related to Focus Area• Data about Local Contributing Factors
Infrastructure Assessment• In-depth Analysis Related to Focus Area• Data about Local Contributing Factors
Specific Focus for Improvement including Measurable Child and/or Family Result
Theory of Action
Getting Started/Preparation
What is Strategic Planning ?
• Planning is an organizational management activity that is used to: Set priorities Focus energy and resources Ensure that employees and other stakeholders are
working toward common goals Establish agreement around intended
outcomes/results
21
22
What is a strategic plan?
• a document used to communicate with the organization the organizations goals, the actions needed to achieve those goals and all of the other critical elements developed during the planning exercise
23
SSIP Plan Focus
• Uses the data and infrastructure analyses, improvement strategies and theory of action
• Details how the State will support and build the capacity of EIS programs / providers to implement practices that lead to the SIMR
• Articulates how you will evaluate progress of implementation and the outcomes and impact of your work.
Why an SSIP Plan?
• Your SSIP plan will define how you will achieve measureable results for infants and toddlers by strengthening your infrastructure, and implementing evidenced based practices.
24
Why an SSIP Plan?
Your plan will define how you will implement SSIP, including:
Activities, steps and resources necessary to achieve the improvement strategies.
The timelines for beginning and completing the improvement strategies
Strategies Activities with timelines 25
Theory of ActionWhat are the issues:
• State System Level
• Local System Level
• Direct Supports
• Practices/Services
• Children and Families
What are our activities:
• State System Level
• Local System Level
• Direct Supports
• Practices/Services
• Children and Families
What are our desired outcomes:
• State System Level
• Local System Level
• Direct Supports
• Practices/Services
• Children and Families
Back
if then
Theory of Action 26
Begin with the End in Mind
What are the desired results or outcomes for children and/or families ?
How do we achieve the SiMR
27
What activities will be implemented to ensure state system supports local systems and implementation of desired practices?
State Supports
What activities will be
implemented to ensure local
systems support
practitioners?
Local supports
What activities will be
implemented to ensure
effective training, TA,
coaching and other
supports related to desired
practices ?
Professional Development
What activities will be
implemented to ensure
practitioners have relevant
knowledge and skills to implement
aligned practices?
Core Competencies
What are the desired results or outcomes for children
and/or families ?
Achieve the SIMR
What Activities Support the Strategies and Implement the Theory of Action?
28
29
Considerations for Strategies and Activities
Build capacity at all levels of the system Build on the strengths of the infrastructure and
address the weaknesses Align with key initiatives and current improvement
plans Connect and reflect the root causes impacting the
SiMR Identify communication strategies (to facilitate
buy in) and stakeholder involvement
The HexagonAn EBP Exploration Tool
NEED
FIT
RESOURCES
EVIDENCE
CAPACITY
READINESS
Fit with current Initiatives• Local program, state priorities• Organizational structures
Community values
Need in local programs, state• Academic & socially significant Issues• Parent & community perceptions of need• Data indicating need
Resources and supports for:• Curricula & Classroom• Technology supports (IT dept.)• Staffing• Training• Data Systems• Coaching & Supervision• Administration & system
Evidence• Outcomes – Is it worth it?• Fidelity data• Cost – effectiveness data• Number of studies• Population similarities• Diverse cultural groups• Efficacy or Effectiveness
Capacity to Implement• Staff meet minimum qualifications• Able to sustain Imp Drivers
• Financially • Structurally
• Buy-in process operationalized• Practitioners • Families
Readiness for Replication• Qualified purveyor• Expert or TA available• Mature sites to observe• Several replications• How well is it operationalized?• Are Imp Drivers operationalized?
The “Hexagon” can be used as a planning tool to evaluate evidence-based programs and practices during the Exploration Stage of Implementation.
Download available at:www.scalingup.org/tools-and-resources
EBP:
5 Point Rating Scale:High = 5; Medium = 3; Low = 1.Midpoints can be used and scored as a 2 or 4.
High Med Low
Need
Fit
Resource Availability
Evidence
Readiness for Replication
Capacity to Implement
Total Score
© National Implementation Research Network 2009-2012 Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland
Develop Activities:
• Improvement Activities are the specific actions that implement the strategy and lead to the SIMR
• Activities are SMART:–Specific–Measurable–Attainable–Realistic–Timed
31
32
What the plan might look like Vision Mission Program/Initiative Goals SSIP Plan State Identified Measureable Result Theory of Action
Targets (five years) Improvement Strategies
Activities (short and long term) Timelines (five years)
Evaluation
Set Targets
• Targets - specific numbers you intend to meet in order to achieve the goals over the time period of the SSIP
• They can be incremental increases or maintain progress
33
Short and Long Term
The short and long term activities are defined steps that help achieve the goal (SIMR):• Short Term – incremental steps with shorter
timeframes that move an organization toward their goals usually accomplished in 1-3 years
• Long Term - Performance measures to be achieved over a period of five years or more
34
Resources For Strategic Planning • http://
ctb.ku.edu/en/table-of-contents/structure/strategic-planning/create-objectives/main
• http://www.hfrp.org/publications-resources/browse-our-publications/strategic-planning-process-steps-in-developing-strategic-plans
• http://balancedscorecard.org/Resources/Strategic-Planning-Basics
35
36
And on to Evaluation
• You've got to be very careful if you don't know where you're going, because you might not get there.”
Yogi Berra, Former Yankees catcher
EVALUATION
Evaluating the Implementation• Built into the plan from the beginning• Based on your theory of action• Based on data that informed the plan
development • Formative data and summative data• Evidence to show progress
38
Good outcomes for children with disabilities and their families
Result:
Implementation of effective practices
Governance
Finance
Personnel / Workforce
Data System
Accountability & Quality Improvement
Quality Standards
39
Evaluation at All Levels
Thank you!• Anne Lucas, anne.lucas@unc.edu• Grace Kelley, gkelley3@cox.net• Taletha Derrington, taletha.derrington@sri.com• Christina Kasprzak, christina.kasprzak@unc.edu• Virginia Reynolds, vreynol@wested.org
40