130907 ~ o'connor ~ evidence for what evidence-based scientist-practitioner model

11
CONCERNS AND CONFIDENCES An open forum on evidence as a basis for the practice of psychology at work NZ Psychological Society Annual Conference, 2013

description

Concerns and confidences: an open forum on evidence as a basis for the practice of psychology at work This practice forum is open to all, but content prepared by those given five minutes to speak will be restricted to work psychology examples. Listen and respond to views on the satisfactory standard of evidence used in our practice with clients. A number of panel members will outline their confidences and concerns with evidence. That different kinds of evidence exist for different purposes often gets forgotten in the faithful espousing of the evidence-based scientist-practitioner model. But what should we cautious about? And what is the evidence good for? How does this relate to views on validity? When might “good enough” not be? We will think carefully about answering the question of ‘Evidence of what, exactly?’

Transcript of 130907 ~ o'connor ~ evidence for what evidence-based scientist-practitioner model

  • 1. CONCERNS AND CONFIDENCESAn open forum on evidence as a basis for thepractice of psychology at workNZ Psychological Society Annual Conference, 2013

2. EVIDENCE FOR WHAT? Please refrain from throwing fruit or theoretical gibberish Bouquets, curly questions and practical dilemmas welcome Frank O'Connor NZ Psychological Society, 2013 3. LETS GET SOME MORE EVIDENCE Recent research shows that the vast majority ofemployees simply aren't engaged- in other words,they aren't bringing their best and full selves towork. What can practitioners do about this? Readmy latest article on the Harvard Business ReviewBlog Network, and share your own ideas in thecomments section.Evidence Based Psychology 16 July [email protected] evidence seems easy 4. EVIDENCEThis evidence stuffWhat would it look like?Lets take an individual as our unit of analysisAnd accept a constraint: That our work is meant to (help me, the individual) change what Ido in an organisational settingA few versions of evidence come to mind2011 Moa Resources - OConnor p 4 5. EVIDENCE THAT I FEEL GOODI feel good about having tried to do somethingabout the thing I want to changeSubjective, yes, but apparently realCompelling enough to get me to go back for moreMy personal reaction is evidence of some kind, andit changes my behaviour furtherBut is this the kind of evidence expected?2011 Moa Resources - OConnor p 5 6. EVIDENCE THAT I HAVE LEARNEDSOMETHINGThere is evidence that I have learned somethingI certainly feel I haveAnd I talk about it to othersFriends say I look a bit more relaxed or awake or ....This is evidence of a sortBut is it what was being sought?2011 Moa Resources - OConnor p 6 7. EVIDENCE MY BEHAVIOUR HAS CHANGEDI think my behaviour has changed - I worry less!And my friend says Im doing things at work betterI don't know how much of this to attribute to what Ihave learned I just know it did and my friend agreesYet my other friend disagrees2011 Moa Resources - OConnor p 7 8. EVIDENCE CANNOT BE SUBJECTIVEWhat do you mean?The things I have learned and am doing more orless consciously are making a difference how many arguments I win sales I make speeding fines I collect So I think this stuff has made an impact on my lifeMy other friend rejects this because he says all myimprovements are my perceptions I guess we must keep looking for evidence2011 Moa Resources - OConnor p 8 9. ITS TOO EARLY TO KNOWWe can only conclude its too early to know, as wehave not proved otherwiseCircular arguments come from not asking the rightquestion:Evidence of what?Evidence for what?Are they going in the same direction?2011 Moa Resources - OConnor p 9 10. KEY QUESTIONS ABOUT EVIDENCE-BASEDPSYCHOLOGY Not all evidence is alike which evidence is better? When we look at peer-reviewed research before recommendingan intervention, are we using evidence-based psychology? Does evidence-based psychology look at all the research thatthere is about a situation or intervention? When researchers look at whether an intervention works, dothey look at many more situations than you will ever address? If evidence can't tell you which intervention is best for yoursituation, how do you weigh up the benefits and harms?2011 Moa Resources - OConnor p 10 11. HOW WILL THIS INTERVENTION HELP?How strong is the evidence? Has it been studied in similar situations? Is a study published in a reputable journal? Is just one person telling the story?Who is telling me about this intervention? Why do they want to tell me how good it is? Consultants say good things about their interventions and productsWhat are the costs of the intervention? Look for inconvenience, not just expenseIs it likely that this intervention will do harm? Are some people more likely to get harmful effects than others? Less adaptable people sometimes have more side effects What are the alternatives to this form of intervention?2013 ~ NZPsS Evidence Forum ~ OConnor 7 Sep p 11