Download - Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Transcript
Page 1: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Evidence-Based Practice: Yes, but with Cautions & Recommendations

Steve Graham

Vanderbilt University

Page 2: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

• I will use Writing, my area of expertise to illustrate the 5 points that I plan to make.

Page 3: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

POINT 1

• The use of Evidence-Based practices is more trustworthy than the use of practices based on professional (expert) judgment or teacher experience

Page 4: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

2 Sources for Effective Practice

• Professional Writers – many draw on their experience to give advice on either how to teach writing or facilitate writing development

• This advice ranges from useful to simplistic to ridiculous

Page 5: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Don’t use words too big for the subject.

C.S. Lewis

When you catch an adjective kill it.

Mark Twain

Page 6: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

• Have something to say.

• Say it.

• Stop when you have said it.

• Give it an accurate title.

Page 7: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Rules for Writing a Paragraph

Set type for as long as you can hold your breath without getting blue in the face

Then put in a comma

When you yawn put in a semicolon, and when you sneeze, that’s time for a paragraph.

Page 8: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Sources for Effective Practice

• Experienced Writing Teachers

This can involve the insights they have acquired from teaching or insights acquired from others who study them

Page 9: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

LIMITATIONS

Difficult to separate “wheat from shaft”

Often no direct evidence on effectiveness (validity -- testimonials)

Evidence is often selective(generalizability -- possible bias)

Evidence often based on 1 or a few teachers(reliability – can’t predict its effectiveness)

Page 10: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Sources for Effective Practice

• Scientific Studies -- Should be more trustworthy than insight and experience

Collect evidence

Present findings for all participants

Replicability

Strength of Impact

Page 11: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Point 2

• Make the best of the available evidence. The data-base is currently very thin for some areas.

Page 12: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

I illustrate this with writing instruction for students with LD – This is based on a recent chapter by myself, Natalie Olinghouse, and Karen Harris

Page 13: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

FINDINGS – 4 or more studies

• 1. Teach students with LD strategies for planning, revising, and editing their compositions (strong positive impact).

• 2. Use direct instruction to teach grammar skills to students with LD (moderate positive impact).

Page 14: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

FINDINGS – 2 to 4 studies

3. Have students with LD work cooperatively with other struggling writers to plan, draft, revise, and edit their compositions (strong positive impact).

4. Explicitly teach students with LD strategies for producing written summaries of reading material (strong positive impact).

Page 15: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

FINDINGS – 2 to 4 studies

5. Make the process writing approach more effective for students with LD by explicitly teaching them strategies for carrying out the processes of planning, revising, and editing (strong positive impact).

6. Set clear and specific goals for what students with LD are to accomplish in their writing (moderate to strong positive impact).

Page 16: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

This is IT!!!

We can only make 6 recommendations on writing instruction for students with LD that have some scientific backing

Page 17: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

POINT 3 – The What Works Clearinghouse Syndrome

In other words – only certain types of studies will be included in determining what is or is not evidence-based

They have adopted a best evidence synthesis approach

Page 18: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

As a result, they are often referred to as:

THE WHAT DOESN’T WORK CLEARINGHOUSE

Page 19: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

RECOMMENDATION

• We need to take a careful look at our definitions of evidence-based practice

• Are they too stringent are they too lax?

• More pointedly, we need to systematically study the process and criteria used to identify evidence-based practices.

Page 20: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

POINT 4

• Until our data base is more sufficiently developed, we will need to supplement our evidence-based recommendations with recommendations taken from areas other than experimental and single-subject design research

Page 21: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

We will need to continue to draw on the practices of effective teachers.

For example, we located 5 qualitative studies that looked at the writing instructional practices of effective teachers and schools. We identified those practices employed by a majority of teachers as promising

Page 22: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Some Examples

• Dedicate time to writing, including writing across the curriculum.

• Involve students in various forms of writing over time.

• Have students plan, draft, revise, edit, and share their work.

• Keep students engaged and on-task by involving them in thoughtful activities (such as planning a composition) versus activities that require little thoughtfulness (such as completing a workbook page that can be finished quickly).

Page 23: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Some More Examples

• Model, explain, and provide guided assistance when teaching.

• Provide just enough support so that students can make progress or carry out writing tasks and processes, but encourage students to act in a self-regulated fashion, doing as much as they can on their own.

• Be enthusiastic about writing and create a positive environment, where students are constantly encouraged to try hard, believe that what they are learning will permit them to write well, and attribute success to effort and what they learned.

• Set high expectations for students, encouraging them to surpass their previous efforts or accomplishments.

Page 24: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

POINT 5

Be Cautious About What Is Promised, as there is no guarantee that evidence-based practices travel easily or as expected

Page 25: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

RTI Is A Case In Point

Based in part on the premise that the implementation of effective practices (evidence-based) in the regular classroom will reduce the number of students who are misidentified as LD (in other words, eliminate educational casualties)

Page 26: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

While this may be the case, this is a huge burden for Evidence-Based practices, as we have some schools where the writing of three quarter or more of the students is not strong enough to meet classroom demands.

In addition, much can go wrong in the implementation of any educational approach

Page 27: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

Case in Point 2

The National Reading Panel Recommendations

MAY BE A CASE OF OVER-SELL THAT WILL COME BACK AND LITERALY BITE US IN THE BUTT.

Page 28: Evidence-Based Practice: Yes, but with Cautions & Recommendations Steve Graham Vanderbilt University.

WE MUST BE REASONABLE AND CAUTIOUS IN HOW WE SELL EVIDENCE-BASED PRACTICES TO THE EDUCATIONAL COMMUNITY