Post on 28-May-2015
description
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 1
Barry Duncan, Psy.D. heartandsoulofchange.com561.239.3640 barrylduncan@comcast.net
Supervision for a Change (in both
clients and therapists)
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 2
Winter Getaway!Training of Trainers
• Training of Trainers Conference: February 2-6, 2015 (27 CEUs) This intensive training experience gives you all you need to train others and implement PCOMS. And it provides the first step in becoming a PCOMS Certified Trainer.
PCOMS ImplementationGeneral Comments
PCOMS ImplementationGeneral Comments
Change is Hard!Staff need structure and support to make it happen.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 3
Top Ten Reasons Therapists Don’t Want to Do PCOMS
1. The results will be used against me.
2. I already know this information—whether clients are benefiting and I have a good alliance.
3. It will Interfere with the relationship—just more paperwork.
4. It’s naïve to think that we can always follow client direction or privilege the client’s view.
5. This won’t work with my client population.
6. A 4-item measure is too simple to be valid.
7. People will lie on these measures or try to please
8. You can’t reduce people to a number.
9. Clients won’t do it; insensitive when they are in crisis.
10. This doesn’t fit my therapy model; it’s for brief therapy only.
Top Ten Therapist Motivations for PCOMS
1. I want to improve my effectiveness.
2. I like how client feedback can help me expand my skills.
3. I like the idea of consumer participation.
4. I like the structure and focus it provides.
5. I want to do evidence based practices.
6. I like this evidence based approach better than specific treatments for specific diagnoses or learning more models.
7. I like the research support (the 4 RCTs) for PCOMS & the importance of the client & the alliance to outcome.
8. I want to develop as a therapist & this helps me know if I am.
9. I want to be accountable for my services.
10. I like the idea of client privilege/empowerment/social justice.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 4
Openly Address Concerns Build Trust: Transparency Rules
Openly Address Concerns Build Trust: Transparency Rules
•Required, but will not be used in any punitive way
•The purpose is to partner with consumers to raise the quality of services, and to prove the value of our services in a way that makes clinical sense
What’s Up3 of the 4 Secrets
What’s Up3 of the 4 Secrets
1) In It for the Long Haul—organizational commitment at all levels; “We Want to Implement”
2) Love Your Data—collection and use of data right out of the gate; Nothing Organic!
3) Inspire the Front-Line Clinician—connecting PCOMS to therapist’s desire to do good work & improve over their careers… research on 11K therapists
1) In It for the Long Haul—organizational commitment at all levels; “We Want to Implement”
2) Love Your Data—collection and use of data right out of the gate; Nothing Organic!
3) Inspire the Front-Line Clinician—connecting PCOMS to therapist’s desire to do good work & improve over their careers… research on 11K therapists
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 5
HSCP Readiness ChecklistIn It for the Long Haul
HSCP Readiness ChecklistIn It for the Long Haul
1. Board of Directors approval of & support for PCOMS.
2. Consensus among senior managers that consumer partnership, accountability, & PCOMS are central features of service delivery.
3. A business/financial plan that incorporates PCOMS.
1. Board of Directors approval of & support for PCOMS.
2. Consensus among senior managers that consumer partnership, accountability, & PCOMS are central features of service delivery.
3. A business/financial plan that incorporates PCOMS.
4. Regular communication w/funders about PCOMS data
5. A HR training & dev. plan that supports ongoing PCOMS ed., including a core group of internal PCOMS trainers, & seeks to integrate PCOMS into therapist dev. plans, performance appraisals, & hiring practices.
6. Infrastructure (support staff, IT, hardware, etc) to support the collection & analysis of PCOMS data at consumer to agency levels.
4. Regular communication w/funders about PCOMS data
5. A HR training & dev. plan that supports ongoing PCOMS ed., including a core group of internal PCOMS trainers, & seeks to integrate PCOMS into therapist dev. plans, performance appraisals, & hiring practices.
6. Infrastructure (support staff, IT, hardware, etc) to support the collection & analysis of PCOMS data at consumer to agency levels.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 6
7. Supervisory infrastructure that uses data to identify at risk clients, proactively address needs, & improve therapist performance.
8. A structure & policy for addressing clients who are not progressing that ensures rapid transfer and continuity of care.
9. Incorporates consumer partnership, accountability, & PCOMS as central features in both “Mission Statement” and “Client Rights documents.”
7. Supervisory infrastructure that uses data to identify at risk clients, proactively address needs, & improve therapist performance.
8. A structure & policy for addressing clients who are not progressing that ensures rapid transfer and continuity of care.
9. Incorporates consumer partnership, accountability, & PCOMS as central features in both “Mission Statement” and “Client Rights documents.”
Data Is More than Just a Friend…
Data Is More than Just a Friend…
PCOMS Implementation: 4 Secrets2. Love Your Data
PCOMS Implementation: 4 Secrets2. Love Your Data
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 7
Love Your DataCollect Data from the Beginning
Love Your DataCollect Data from the Beginning
Used to think it could happen organically
What was I thinking! Collecting data allows:
knowing who is and whoisn’t doing it; who is and isn’t doing it correctly; data integrity (more on this later); real agency benefit
Used to think it could happen organically
What was I thinking! Collecting data allows:
knowing who is and whoisn’t doing it; who is and isn’t doing it correctly; data integrity (more on this later); real agency benefit
Therapists Do the Work Because They Want to Make a Difference
Therapists Want to Improveover Their Careers
Therapists Need to Growto Avoid Burnout
PCOMS Implementation: 4 Secrets3. Inspire the Front Line ClinicianPCOMS Implementation: 4 Secrets
3. Inspire the Front Line Clinician
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 8
Question #1:
Finding the right approach or selecting evidence based treatments will improve outcomes
FalseStudy after study, and studies of studies show that all treatments are the right treatment—for some clients.
How Do We Get BetterPop Quiz
How Do We Get BetterPop Quiz
How Do We Get BetterPop Quiz
How Do We Get BetterPop Quiz
Question #2:
Personal therapy and increasing our self awareness makes us a better person and improves our outcomes
FalseWhile helpers find personal therapy invaluable, it neither helps nor hinders outcomes.
Geller, J., Norcorss, J.,& Orlinksky D. (2005). The psychotherapist’s Own Psychotherapy. New York: Oxford Univ. Press.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 9
How Do We Get BetterPop Quiz
How Do We Get BetterPop Quiz
Question #3:
Professional Training and Continuing Education have a direct impact on outcomes.
FALSENo difference in outcomes between disciplines, training models, and not one study supports CE as helping outcomes
How Do We Get Better?Pop Quiz
How Do We Get Better?Pop Quiz
Question #4:
The accrued wisdom of clinical experience, years of seasoning, improves outcomes
FALSEThe cold hard reality is that experience seems to make little difference.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 10
Meta-analysis by Lambert & Shimokawa (2011)of PCOMS (the ORS and SRS)
Those in feedback group had 3.5 higher odds of experiencing reliable change
Those in feedback group had less than half the odds of experiencing deterioration
Feedback attained .48 ES
Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79.
Inspire the Front Line ClinicianMonitor & Quicken Your Development
Inspire the Front Line ClinicianMonitor & Quicken Your Development
Feedback tailors services based on response, provides an early warning system to prevent negative outcomes, & solves helper variability—feedback improves performance andit both monitors and quickens development
Feedback tailors services based on response, provides an early warning system to prevent negative outcomes, & solves helper variability—feedback improves performance andit both monitors and quickens development
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 11
But How Do You Get Them To See the Benefits?
But How Do You Get Them To See the Benefits?
The evidence? Maybe…Management dictates?
Maybe…Devotion to consumer
privilege? Maybe…Openness to new ideas?
Maybe…(older less so) But not likely!
The evidence? Maybe…Management dictates?
Maybe…Devotion to consumer
privilege? Maybe…Openness to new ideas?
Maybe…(older less so) But not likely!
TherapistsReaction to PCOMS
TherapistsReaction to PCOMS
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 12
The Fact: Only 25-33% Implement on Their Own
The Rest Have to Be Dragged Kicking and Screaming—not really but It Takes Ongoing Support/Motivation/Inspiration via Supervision
But Most Therapists Won’t Do It Despite the Evidence
PCOMS Implementation4 Secrets
PCOMS Implementation4 Secrets
1) In It for the Long Haul—organizational commitment at all levels;
2) Love Your Data—collection and use of data right out of the gate;
3) Inspire the Front-Line Clinician—connecting PCOMS to therapist’s desire to do good work & improve over their careers;
4) Supervision for a Change--in both clients and therapists
1) In It for the Long Haul—organizational commitment at all levels;
2) Love Your Data—collection and use of data right out of the gate;
3) Inspire the Front-Line Clinician—connecting PCOMS to therapist’s desire to do good work & improve over their careers;
4) Supervision for a Change--in both clients and therapists
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 13
Isomorphic Supervision Just the Facts Ma’am
Isomorphic Supervision Just the Facts Ma’am
The nuts & bolts of isomorphic, PCOMS supervision.
The nuts & bolts of isomorphic, PCOMS supervision.
PCOMS Supervision: Key toClient Benefit & Helper Growth
PCOMS Supervision: Key toClient Benefit & Helper Growth
Based on outcome data not theory or pontification.
Aimed at early identification of clients at risk so services can be modified.
Offers feedback, support, training for those who aspire to become better
Based on outcome data not theory or pontification.
Aimed at early identification of clients at risk so services can be modified.
Offers feedback, support, training for those who aspire to become better
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 14
Reviewing GraphsFirst Things FirstReviewing GraphsFirst Things First
Squeamishness Trajectories
(ETR) Clinical Cut Off Percent of
Change Target—Basis for Feedback Messages
Squeamishness Trajectories
(ETR) Clinical Cut Off Percent of
Change Target—Basis for Feedback Messages
This means that clients who report little or no progress early on will likely show no improvement over the entire course of therapy, or will end up on the drop-out list—early change predicts engagement in therapy and a good outcome at termination. Provides a tangible way for us to identify folks who are not responding so that we can chart a new course.
The Research about Early Change Is a Gift
The Research about Early Change Is a Gift
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 15
Early Change Doesn’t Fit My Clients!Some Clients Take Longer
Early Change Doesn’t Fit My Clients!Some Clients Take Longer
It is true that some clients take longer than others, but importantly not for change to start, but rather for change to plateau
It is true that some clients take longer than others, but importantly not for change to start, but rather for change to plateau
Baldwin, S., Berkeljon, A., Atkins, D., Olsen, J., & Nielsen, S. (2009). Rates of change in naturalistic psychotherapy: Contrasting dose-effect and good-enough level models of change. Journal of Consulting and Clinical Psychology, 77(2), 203-211.
Some clients do take longer, but the mythology never dies
N=4676; 77% attended 8 or less, and 91% 12 or less
Note that even for the clients who take longer (last curve bottom right), change starts early…just is flatter
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 16
Sudden Epiphany? NOTSudden Epiphany? NOT
Myth: Clients flat-line & then spike. Some clients do take longer but change starts right away. So the question remains: When do you start getting worried when clients are not responding? I vote for sooner rather than later.
Myth: Clients flat-line & then spike. Some clients do take longer but change starts right away. So the question remains: When do you start getting worried when clients are not responding? I vote for sooner rather than later.
What People ForgetWhat People Forget
Not Just Flicking a Form… A Clinical Process Fully
Integrated into the Work Itself Like any Clinical Process,
Success Rests on the Therapist: Have to Believe in It, Use It Sincerely, Make It Their Own
Worthless Unless Data Are Used to Identify at Risk Clients…and then Do Something about Them.
Not Just Flicking a Form… A Clinical Process Fully
Integrated into the Work Itself Like any Clinical Process,
Success Rests on the Therapist: Have to Believe in It, Use It Sincerely, Make It Their Own
Worthless Unless Data Are Used to Identify at Risk Clients…and then Do Something about Them.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 17
Fidelity Monitoring ToolFidelity Monitoring Tool
1. Administer and score the Outcome Rating Scale (ORS) each visit or “unit of service.”
2. Ensure that the client understands that the ORS is intended to bring his or her voice into the decision-making process and will be collaboratively used to monitor progress.
3. Ensure that client gives a good rating; i.e., a rating that matches the client’s description.
4. Ensure that the client’s marks on the ORS are connected to the reasons for service.
1. Administer and score the Outcome Rating Scale (ORS) each visit or “unit of service.”
2. Ensure that the client understands that the ORS is intended to bring his or her voice into the decision-making process and will be collaboratively used to monitor progress.
3. Ensure that client gives a good rating; i.e., a rating that matches the client’s description.
4. Ensure that the client’s marks on the ORS are connected to the reasons for service.
5. Use outcome (ORS) data to develop and graph individualized trajectories of change. 6. Plot client progress (ORS scores) on individualized trajectories from session to session to determine which clients are making progress and which are at risk for a negative or null outcome7. Use ORS scores to engage clients in a discussion in every session about how to continue to empower change if it is happening and change, augment, or end tx if it is not.8. Administer and score the Session Rating Scale (SRS) each visit or “unit of service.”
5. Use outcome (ORS) data to develop and graph individualized trajectories of change. 6. Plot client progress (ORS scores) on individualized trajectories from session to session to determine which clients are making progress and which are at risk for a negative or null outcome7. Use ORS scores to engage clients in a discussion in every session about how to continue to empower change if it is happening and change, augment, or end tx if it is not.8. Administer and score the Session Rating Scale (SRS) each visit or “unit of service.”
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 18
9. Ensure that the client understands that the SRS is intended to create a dialogue between therapist and client that more tailors the service to the client--and that there is no bad news on the measure.10. Use the SRS to discuss whether: the client feels heard, understood, and respected; the service is addressing the client’s goals for treatment; the service approach matches the client’s culture or worldview, or theory of change.
9. Ensure that the client understands that the SRS is intended to create a dialogue between therapist and client that more tailors the service to the client--and that there is no bad news on the measure.10. Use the SRS to discuss whether: the client feels heard, understood, and respected; the service is addressing the client’s goals for treatment; the service approach matches the client’s culture or worldview, or theory of change.
Fidelity Monitoring ToolFidelity Monitoring Tool
PCOMS Therapist Adherence ScalePCOMS Therapist Adherence Scale
Never Sometimes Often Regularly Always 1 2 3 4 5
Out of a total possible 50 points, adherence is considered acceptable at 40 or above at the 6 month mark and 45 or above at the one year after implementation. High adherence is ensured by the PCOMS supervisory process.
Never Sometimes Often Regularly Always 1 2 3 4 5
Out of a total possible 50 points, adherence is considered acceptable at 40 or above at the 6 month mark and 45 or above at the one year after implementation. High adherence is ensured by the PCOMS supervisory process.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 19
Supervision: Four StepsSupervision: Four Steps
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
1. Start with graphs of all clients not reflecting benefit; Alsoinclude scores in general. Ensureuse of measures & data integrity.
PCOMS SupervisionData Integrity: What to Look For
• 30% of Intakes over the Cutoff:• Client or therapist does not understand
ORS –Role play introducing the ORS• ORS Scores between 35-40:• Client or therapist does not understand
the measures; Rarely a good score; even mandated clients don’t score this high. Role play introducing the ORS, discussing score when it doesn’t match client description of experience
• ORS Scores Look Like a Saw• An emotional thermometer: Client or
Therapist does not understand ORS—Role play connecting the client’s reason for service to the marks on the ORS.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 20
30% of Intakes over the Cutoff
Intake ORS Scores 1.28.72.17.53.31.74.18.95.12.46.29.67.33.68.7.69.13.710.30.6
• Client or therapist likely does not understand ORS –Role play introducing the ORS
The First MeetingIntroducing the ORS
The First MeetingIntroducing the ORS
Introduce the ORS using your own words—convey the notion of monitoring outcome and ensuring client voice is heard
Measure the marks and add the scores
Introduce the ORS using your own words—convey the notion of monitoring outcome and ensuring client voice is heard
Measure the marks and add the scores
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 21
ORS Scores between 35-40Intake ORS Scores1.28.72.17.53.36.74.18.95.12.46.29.67.38.68.7.69.13.710.38.6
• Client or therapist does not understand the measures; Rarely a good score; even mandated clients don’t score this high. Role play introducing the ORS, discussing score when it doesn’t match client description of life
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 22
The First MeetingGetting A Good Rating
The First MeetingGetting A Good Rating
1. Score ORS & give feedback re score & cutoff; 2. Client describes situation inconsistent w/score; 3. Practice checking it out with the client
1. Score ORS & give feedback re score & cutoff; 2. Client describes situation inconsistent w/score; 3. Practice checking it out with the client
ORS Scores1.28.7, 17.1, 26.4, 12.7, 29.92.17.5, 19.6, 22.43.31.7, 12.2, 28.4, 6.7,4.18.9, 19.2, 19.75.12.4, 18.3, 9.9, 21.1, 11.86.29.6, 31.37.33,6, 9.3, 8.6, 34.9, 31.6, 3.48.7.6, 8.5, 9.59.13.7, 14.5, 17.5, 20.810.30.6
ORS Scores Look Like a SawThe Emotional Thermometer
Client or Therapist does not understand ORS—Role play connecting the client’s reason for service to the marks on the ORS
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 23
See SawSee Saw
Has to be Relevant to the Work
Or Becomes an Emotional Thermometer of Day to Day Life
Has to be Relevant to the Work
Or Becomes an Emotional Thermometer of Day to Day Life
Integrating the MeasuresProblems and Challenges?
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 24
The First MeetingIntegrating the Measures
The First MeetingIntegrating the Measures
1. Score ORS & give feedback re score & cutoff; 2. Connect marks to client description & reason for service; 3.Use examples from work & report
1. Score ORS & give feedback re score & cutoff; 2. Connect marks to client description & reason for service; 3.Use examples from work & report
Supervision: Four StepsSupervision: Four Steps
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
1. Start with graphs of all clients not reflecting benefit; Alsoinclude scores in general. Ensureuse of measures & data integrity.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 25
Reviewing GraphsOver Utilization
Reviewing GraphsOver Utilization
Creates wait lists, iatrogenic effects. First way is when the client continues in service in the absence of benefit.
Reviewing GraphsOver Utilization
Reviewing GraphsOver Utilization
When max benefit reached, talk about stepping down; not discharge, but planning for continued recovery out of tx.
If not stepped down, graphs look like a saw, rising and falling with everyday life; clients are disempowered
ORS represents life in general instead of client's perceptions connected to the purpose of the service.
When max benefit reached, talk about stepping down; not discharge, but planning for continued recovery out of tx.
If not stepped down, graphs look like a saw, rising and falling with everyday life; clients are disempowered
ORS represents life in general instead of client's perceptions connected to the purpose of the service.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 26
First order of business:What does the client say about this?
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 27
SupervisionGeneral Considerations
SupervisionGeneral Considerations
What does the client want?
What are the client’s ideas about change
What are the client’s expectations about our role?
What are the client’s strengths?
What does the client want?
What are the client’s ideas about change
What are the client’s expectations about our role?
What are the client’s strengths?
1.What does the client say?2.Is the client engaged? SRS?3.What has the helper done differently?4.What can be done differently now?5.What other resources can be rallied?6.Is it time to fail successfully?
Supervisory ConversationThe Longer w/o Change, the Quicker to #6
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 28
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 29
Brainstorming: From Thinking About Doing Something Different to Doing ItBrainstorming: From Thinking About
Doing Something Different to Doing It
What else can be done!?
People, places, things: Colleague or sup. consult; someone else from client support network; community support; faith based; peer recovery; or different provider…
What else can be done!?
People, places, things: Colleague or sup. consult; someone else from client support network; community support; faith based; peer recovery; or different provider…
1.What does the client say?2.Is the client engaged? SRS?3.What has the helper done differently?4.What can be done differently now?5.What other resources can be rallied?6.Is it time to fail successfully?
Supervisory ConversationThe Longer w/o Change, the Quicker to #6
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 30
Infrastructure for Non-Blaming Transfer
Infrastructure for Non-Blaming Transfer
Not dumping clients Says nothing about
competence of therapist Says nothing about
client’s ability to change Says everything about
doing something positive and proactive about clients who are not benefiting
Not dumping clients Says nothing about
competence of therapist Says nothing about
client’s ability to change Says everything about
doing something positive and proactive about clients who are not benefiting
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 31
Therapists Learn to Be Helpful byMoving Clients to Greener PasturesTherapists Learn to Be Helpful by
Moving Clients to Greener Pastures
Learn that all of us have clients who don’t benefit
If supervision re-visits these clients, therapists will see the transferred clients benefitting
Therapists have new way to help and feel good about the work
Learn that all of us have clients who don’t benefit
If supervision re-visits these clients, therapists will see the transferred clients benefitting
Therapists have new way to help and feel good about the work
Supervision: Four StepsSupervision: Four Steps
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
1. Start with graphs of all clients not reflecting benefit; Alsoinclude scores in general. Ensureuse of measures & data integrity.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 32
Love Your DataKey Performance Indicators
Love Your DataKey Performance Indicators
1. Average Change: Is it above 6?
2. % reaching reliable and significant change
3. Effect Size
1. Average Change: Is it above 6?
2. % reaching reliable and significant change
3. Effect Size
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 33
Love Your DataMyOutcomes.comLove Your Data
MyOutcomes.com
The single bit of info that tells you the most is the % who reach target—the mean trajectory for clients entering services with the same intake score.
The single bit of info that tells you the most is the % who reach target—the mean trajectory for clients entering services with the same intake score.
Collaboratively Form a Plan Improve/Foster DevelopmentCollaboratively Form a Plan
Improve/Foster DevelopmentDiscuss stats openly and
ask for supervisee’s ideas Co-develop a plan and
implement; evaluate quarter by quarter; modify if outcomes not improving
Foster continued professional reflection
Discuss stats openly and ask for supervisee’s ideas
Co-develop a plan and implement; evaluate quarter by quarter; modify if outcomes not improving
Foster continued professional reflection
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 34
Becoming BetterConsider Benefits of Tracking Outcome
Becoming BetterConsider Benefits of Tracking Outcome
Allows a systematic trial and error application of new learning as well as the refinement of the tried and true mechanisms that we know enhance outcomes.
Tracking cumulative career development enables reflection and action about effectiveness.
Allows a systematic trial and error application of new learning as well as the refinement of the tried and true mechanisms that we know enhance outcomes.
Tracking cumulative career development enables reflection and action about effectiveness.
Becoming BetterTake Charge
Becoming BetterTake Charge
Track effectiveness by active/inactive differences; 30 client block a good est.
Keep dev. front & center; implement ideas, practices, & models, as well as building skills.
Will readily see whether efforts are paying off, if chosen methods of increasing effectiveness need to be tweaked or changed outright.
Track effectiveness by active/inactive differences; 30 client block a good est.
Keep dev. front & center; implement ideas, practices, & models, as well as building skills.
Will readily see whether efforts are paying off, if chosen methods of increasing effectiveness need to be tweaked or changed outright.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 35
Cumulative Career DevelopmentStart with the Common FactorsCumulative Career DevelopmentStart with the Common Factors
Models/techniques, but… Focus on the common
factors. Practice well the skills of
the craft—the alliance. At some point, craft becomes art. Relational repertoire likely parallels your development
Models/techniques, but… Focus on the common
factors. Practice well the skills of
the craft—the alliance. At some point, craft becomes art. Relational repertoire likely parallels your development
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 36
Supervision: Four StepsSupervision: Four Steps
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
2. Look for over-utilization; Spend most time on at risk clients: shape discussion and brainstorms options 3. Review stats & discuss ways to improve; Encourage action4. Mentor via skill building, client teachings, & ongoing reflection
1. Start with graphs of all clients not reflecting benefit; Alsoinclude scores in general. Ensureuse of measures & data integrity.
Leave Time in Each MeetingContinual Professional Reflection
Leave Time in Each MeetingContinual Professional Reflection
Skill Building, Role-plays: Practice the skills of the craft; learn new techniques
Learn from Clients: Tease out what is working and what is not using client outcome as a guide.
Talk about therapist identity and encourage an evolving description of the work
Skill Building, Role-plays: Practice the skills of the craft; learn new techniques
Learn from Clients: Tease out what is working and what is not using client outcome as a guide.
Talk about therapist identity and encourage an evolving description of the work
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 37
Helping Supervisees Learn from Clients
Helping Supervisees Learn from Clients
Provider experiences of their current development are influenced mainly by the quality of their clinical experiences w/clients.
Supervision can help helpers make the best of it.
Provider experiences of their current development are influenced mainly by the quality of their clinical experiences w/clients.
Supervision can help helpers make the best of it.
Currently Experienced GrowthClients Are the Best TeachersCurrently Experienced GrowthClients Are the Best Teachers
Impossible to sit w/people& witness journey to a better place & not be changed.
Teach us about the human condition & ways people transcend adversity & cope w/the unthinkable.
Tracking outcomes takes this notion to a different & more immediately practical level.
Impossible to sit w/people& witness journey to a better place & not be changed.
Teach us about the human condition & ways people transcend adversity & cope w/the unthinkable.
Tracking outcomes takes this notion to a different & more immediately practical level.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 38
Tracking Outcomes: Keeps Our Utmost Attention on the Here and Now
Tracking Outcomes: Keeps Our Utmost Attention on the Here and Now
Clients teach us with their responses about the benefit & fit of service—as well as their reflections about the next step. Those clients not responding to our therapeutic business as usual help us step outside of our comfort zones.
Clients teach us with their responses about the benefit & fit of service—as well as their reflections about the next step. Those clients not responding to our therapeutic business as usual help us step outside of our comfort zones.
• Review current clients, consider lessons. Did you experience anything different? Did you do something you have never done when clients were changing, when they weren’t? Has this changed your work? What does this mean in terms of how you think about your work and your identity as a therapist?
Reviewing Your Currently Experienced Growth
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 39
Learning from ClientsOur Norwegian Colleague
Learning from ClientsOur Norwegian Colleague
I became more transparent, more courageous. I felt more secure and conveyed it.
Clients and I got more concrete about change, how it started, and what else would be helpful.
Feedback sharpened my focus—pinpointed that we have a common purpose.
I became more transparent, more courageous. I felt more secure and conveyed it.
Clients and I got more concrete about change, how it started, and what else would be helpful.
Feedback sharpened my focus—pinpointed that we have a common purpose.
Our Norwegian Colleague (cont)Be Proactive
Our Norwegian Colleague (cont)Be Proactive
Feedback helped me take risks and invite negative comments.
Made me more secure, I am far more daring. I am now more collaborative and allow things to emerge rather than following a set way to work.
Feedback helped me take risks and invite negative comments.
Made me more secure, I am far more daring. I am now more collaborative and allow things to emerge rather than following a set way to work.
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 40
Reflect about your identity & construct a story of your work that captures what you do.
Edit and refine your identity & accounts—evolve a description that you can have allegiance to but that doesn’t lead to dead ends.
Reflect about your identity & construct a story of your work that captures what you do.
Edit and refine your identity & accounts—evolve a description that you can have allegiance to but that doesn’t lead to dead ends.
You Do What?Identities and Descriptions
You Do What?Identities and Descriptions
You Do What?What is Your Identity?
You Do What?What is Your Identity?
How do you describe what you do? At your very best, what role do you play with your clients? What recent client represents the essence of your identity, illustrating what you embrace most about your work?
How do you describe what you do? At your very best, what role do you play with your clients? What recent client represents the essence of your identity, illustrating what you embrace most about your work?
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 41
You Do WhatLabor or ArtYou Do WhatLabor or Art
What we do is a measure of who we are. If we imagine our work as labor, we become laborers. If we imagine our work as art, we become artists.
Jeffrey Patnaude
What we do is a measure of who we are. If we imagine our work as labor, we become laborers. If we imagine our work as art, we become artists.
Jeffrey Patnaude
httpa://heartandsoulofchange.com 10/14/2014
barrylduncan@comcast.net 42
You’ll Have Them When…CEG Kicks In
You’ll Have Them When…CEG Kicks In They have conversations with
clients in ways not seemed possible before
They experience that first client who benefits
They recapture success with clients who would have ended negatively
They learn from clients and experience their current growth…they learn from you
They have conversations withclients in ways not seemed possible before
They experience that first client who benefits
They recapture success with clients who would have ended negatively
They learn from clients and experience their current growth…they learn from you