CEC’s Evidence Based Practice Effort

Rachelle BrunoNorthern Kentucky University

Professional Standards and Practice Committee

Standing Committee Knowledge and Skill Subcommittee Evidence Based Practice Workteam

CEC Member Involvement CEC Staff

Richard Mainzer, Associate Executive Director, Professional Services

Discussions with RA - 2005, 2006 Discussions with IDC - 2006 Discussions with Division Boards - 2004,

2005, 2006 Presentations at TED Open Forum - CEC Convention 2006

Member Involvement (con’t). Selected Conference Call Participants-

David Bateman, Ellen Brantlinger, Bryan Cook, Diane Browder, Lynn Ahlgrim-Delzell, Marilyn Friend, Russell Gersten; Diane Haager, Janie Hodge, Janette Klingner, Tim Landrum,Robin McWilliam, Sam Odom, Diane Paul, Hugh Reid, Kathlene Shank, Gary Siperstein, Melody Tankersley

Pilot Team Members Bryan Cook; Diane Browder/Lynn Algrim-Delzell;

David Test; Tim Landrum; Robin McWilliam; Sam Odom; Janette Klingner

CEC Special EducationEvidence-Base Practice

Professional Wisdom

Evidence-Based Practices

Family Values

Current Timeline & ActivitiesJan 2006 Board asks PSPC to engage

in further discussion of EBPSpring 2006 PSPC engages CEC in

discussion - convention, conference calls

Oct 2006 PSPC requests PilotJanuary 2007 Board approves PilotJanuary 2008 Report to Board

Tasks of the Pilot Project Determine decision criteria and coding

rubrics Determine review guidelines Develop guidelines for practice reports Review extant studies Evaluate process

What is a practice? Specific strategy or intervention

designed for use by special educators intended to support the education of individuals with exceptional learning needs

Could include programs that are a combination of interventions

Pilot Criteria/Classification

Based largely on the work by the CEC Division for Research task force’s articles in the winter 2005 issue of EC

Examines:Number, type, and quality of studiesDirection and significance of the

effects

How does this fit with the What Works Clearinghouse?

Coordinating efforts in this area as much as possible.

Describing the Evidence Base

Positive Evidence-Base

Negative Evidence-Base

Insufficient Evidence-Base Mixed Effects

Evidence Base

No Discernible Effects Evidence Base

Potentially Positive Evidence Base

Potential Study Rubric Dimensions

Design Dependent and Independent Variables Design Quality Implementation Quality Effects

Proposed ProcessEvidence-Based

Practice Study Process

PSPC collaborates with CEC Units toarrange for Practice Studies

Unit(s) conduct Practice Studies &submit the studies to TR Panel

Technical Review (TR) Panel reviewseach study & recommendation

PSPC provides oversite, accepts TRPanel recommendation, informs the

CEC Board, & arranges for publication

TR Panel agrees with the reviewand recommendation?

TR Panel providesopportunity forreconsideration

TR Panel submits study &recommendation to PSPC

CEC disseminates the evidence-basedpractice to the field

Yes

NoPSPC collaborates with CEC units

and members to identify priorities forPractice Studies

Proposed Evidence-Based Practice Study Reports

A clear and complete description of the practice with its essential components,

A description of each research study that the team included in the synthesis study,

A scored rubric for each included study along with a completed rubric across the studies to determine the category of the practice.

A brief description of the results of each included study, including the direction, magnitude, and statistical significance of the empirical effect estimate. This could be characterized as a statistically significant positive, substantively important positive, indeterminate, or negative effect.

The study team’s recommendation along with the basis of the recommendation.

Technical Review Panels

Supporting the PSPC, a new CEC Scientific Advisory Sub-committee (SASC) in collaboration with CEC affiliates will establish a pool of expert reviewers from which the SASC can select TR panels to conduct the reviews of the EBP Studies. Each TR panel will analyze an EBP Study to ensure the criteria were appropriately applied to the body of literature and the recommendation(s) are appropriate.

TR panels selected from the pool based on their backgrounds Division input

Who will do the Studies? Workteams sponsored by CEC

Divisions and research teams Small number of expert colleagues (3 to 5) Who can harvest relevant studies And efficiently synthesize the results

What Studies will come first?

CEC together with its affiliate Divisions will identify practice areas for study and schedules as time and resources permit.

DisseminationThe Bridge

Between Knowledge and Effective Practice

Utilize existing methods that CEC with its affiliates have for dissemination in ways that ensure professionals have the information to select and implement practices with fidelity.

CEC must also ensure that practices are disseminated to those who influence the context in which professional practice occurs.

CEC Special EducationEvidence-Base Practice

Professional Wisdom

Evidence-Based Practices

Family Values

Information

Richard MainzerAssociate Executive Director

Professional ServicesRichardm@cec.sped.org

703-264-9408

Rachelle BrunoPilot Workteam Chair

bruno@nku.edu859-572-5167