Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the...
Transcript of Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the...
![Page 1: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/1.jpg)
Better and Worse: Evaluating the Unevaluatable
Metanoia August 2015
Glenda H. Eoyang, PhD Executive Director
Human Systems Dynamics Institute
© 2015. HSD Institute. Use with permission. Better and Worse 1
![Page 2: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/2.jpg)
How will we work together?
» Turn judgement into curiosity » Turn conflict into shared exploration » Turn defensiveness into self-reflection » Turn assumptions into questions
© 2015. HSD Institute. Use with permission. 2 Better and Worse
![Page 3: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/3.jpg)
Good Evaluation Good Consulting
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 3 Better and Worse
![Page 4: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/4.jpg)
Good Evaluation Good Consulting Value and worth Fit for function
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 4 Better and Worse
![Page 5: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/5.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 5 Better and Worse
![Page 6: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/6.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 6 Better and Worse
![Page 7: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/7.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 7 Better and Worse
![Page 8: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/8.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 8 Better and Worse
![Page 9: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/9.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation Independent or dependent Interdependent
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 9 Better and Worse
![Page 10: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/10.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation Independent or dependent Interdependent Silos Networks
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 10 Better and Worse
![Page 11: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/11.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation Independent or dependent Interdependent Silos Networks Competencies Adaptive capacity
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 11 Better and Worse
![Page 12: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/12.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation Independent or dependent Interdependent Silos Networks Competencies Adaptive capacity Control and manage See, understand, influence
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 12 Better and Worse
![Page 13: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/13.jpg)
Good Evaluation Good Consulting Value and worth Fit for function Predictable future Unknowable future Global or local focus Global and local focus Whole is the sum of parts Whole not the sum of parts Replication Innovation Independent or dependent Interdependent Silos Networks Competencies Adaptive capacity Control and manage See, understand, influence Right answer Adaptive Action
Why HSD? See Systems
© 2015. HSD Institute. Use with permission. 13 Better and Worse
![Page 14: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/14.jpg)
Adaptive Action
What are current patterns? What do you observe? What surprises you? What happened before? What are people saying? What is the research? What . . .
© 2015. HSD Institute. Use with permission. 14 Better and Worse
What?
![Page 15: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/15.jpg)
Adaptive Action
So what are the tensions? So what is important? So what options do we have? So what does success look like now? So what . . .
© 2015. HSD Institute. Use with permission. 15 Better and Worse
So what? What?
![Page 16: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/16.jpg)
Adaptive Action
Now what will we do? Now what will we communicate? Now what will we measure? Now what will we look for next? Now what . . .
© 2015. HSD Institute. Use with permission. 16 Better and Worse
So what?
Now what?
What?
![Page 17: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/17.jpg)
Adaptive Action
© 2015. HSD Institute. Use with permission. 17 Better and Worse
So what?
Now what?
What?
![Page 18: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/18.jpg)
Complex Adaptive System (CAS) Self-Organizing System
A collection of individual agents who have the freedom to act in unpredictable ways, and whose actions are interconnected such that they produce system-wide patterns.
© 2015. HSD Institute. Use with permission. 18 Better and Worse
Agents interact
![Page 19: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/19.jpg)
Complex Adaptive System (CAS) Self-Organizing System
© 2015. HSD Institute. Use with permission. 19 Better and Worse
Agents interact
Those system-wide patterns, in turn, influence the behaviors of the agents
System-wide patterns emerge
![Page 20: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/20.jpg)
Dynamics in CAS
Know when your changes are in the zone of emergence
© 2015. HSD Institute. Use with permission. 20 Better and Worse
Unstable Seek Patterns
Stable Plan, Control
Far From Close To
Far F
rom
C
lose
To
Certainty
Agr
eem
ent
![Page 21: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/21.jpg)
Unstable Seek Patterns
Stable Plan, Control
Far From Close To
Far F
rom
C
lose
To
Certainty
Agr
eem
ent
Patterns on the Evaluation Landscape
© 2015. HSD Institute. Use with permission. 21 Better and Worse
large
small
many
few
loose
tight
Where are you now? Where do you want to be? How do you get there?
![Page 22: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/22.jpg)
Far From Close To
Far F
rom
C
lose
To
Certainty
Agr
eem
ent
Evaluation Options
© 2015. HSD Institute. Use with permission.
22
Better and Worse
Traditional Evaluation Strategies
![Page 23: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/23.jpg)
Traditional Evaluation
» Pre-determined indicators » Clear objectives » Randomized control trials » Outcome evaluation » Scorecards » Quantitative » Process measures » Formative and summative » Return on Investment » Hypothesis testing
© 2015. HSD Institute. Use with permission. 23 Better and Worse
![Page 24: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/24.jpg)
Far From Close To
Far F
rom
C
lose
To
Certainty
Agr
eem
ent
Evaluation Options
© 2015. HSD Institute. Use with permission.
24
Better and Worse
Exploratory Evaluation Strategies
![Page 25: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/25.jpg)
Exploratory Evaluation
» Perpetual scan » Searching for surprise » Listening widely » Multiple sources » Open-ended questions » Looking for weak signals » Grounded theory » Hypothesis building » Organized discovery
© 2015. HSD Institute. Use with permission. 25 Better and Worse
![Page 26: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/26.jpg)
Far From Close To
Far F
rom
C
lose
To
Certainty
Agr
eem
ent
Evaluation Options
© 2015. HSD Institute. Use with permission.
26
Better and Worse
Dialogic Evaluation Strategies
![Page 27: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/27.jpg)
Dialogic Evaluation
» Interviews » Large group meetings » Storytelling » Observation » Discussion » Reflective practice » Developmental evaluation » Hypothesis emerging
© 2015. HSD Institute. Use with permission. 27 Better and Worse
![Page 28: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/28.jpg)
Additional Resources
» Online: » Hsdlearning.org » Wiki.hsdinstitute.org
» Training: » Free monthly webinars » HSD Professional Certification » Open and custom Learning Labs » Eastern Mennonite University Summer Program 2016
» Books: » Adaptive Action: Leveraging Uncertainty in Your Organization » Facilitating Organization Change: Lessons from Complexity Scienct » Radical Rules for Schools » Simple Rules
© 2015. HSD Institute. Use with permission. 28 Better and Worse
![Page 29: Better and Worse: Evaluating the ... - Metanoia Instituutti · Better and Worse: Evaluating the Unevaluatable Metanoia August 2015 Glenda H. Eoyang, PhD Executive Director Human Systems](https://reader034.fdocuments.in/reader034/viewer/2022051812/602e073a894d530925221cbb/html5/thumbnails/29.jpg)
© 2015. HSD Institute. Use with permission. 29 Better and Worse