Art of Hosting Research Report CMA

8/14/2019 Art of Hosting Research Report CMA

1/28

EVALUATION OF THE ART OFHOSTING TRAININGS

Final Report

July 2008

Prepared for:Columbus Medical Association Foundation

Prepared by:Darryl Lang, Ph.D.

Deborah A. Crawford


2/28

EVALUATION OF THE ART OF HOSTING TRAININGSFinal Report

Table of Contents

Executive Summary. 3

Background and Purpose 6

Methods.. 6

Detailed Survey Results... 7

Participant characteristics....... 7

Training Experiences: General 8

Training Experiences: Post-training Events.. 9

Training Experiences: Satisfaction.10

Training Experiences: Feelings After Training..11

Training Experiences: Immediate Outcomes12

Training Applications: As A Participant. 14

Training Applications: Professional Setting. 16

Training Applications: Community Setting.. .18

Training Applications: Personal Setting 20

Personal Change.. 21

Future Needs. 22

ListServ Awareness.. 24

Additional Comments... 25

Additional Analyses.. 25

Conclusions26

Appendix Survey verbatim open-ended responses Art of Hosting community survey


3/28

Executive Summary

The Art of Hosting is a training and practice for persons wanting to lead and engage groups and teams ininteractive ways for the purpose of serving real needs in communities and to find new solutions. The focusof this evaluation project is to better understand the impact of the Art of Hosting training in Ohio and how itis practiced, especially focusing on identifying the extent of participant changes and application of what was

learned.

Method

Preliminary telephone interviews were conducted to collect qualitative information from a representativegroup of Art of Hosting training participants. Using these results, a written survey was developed andmailed to 149 training participants that had attended one of the Art of Hosting trainings between March2005 and October 2007. The final response rate was 62% (83/133), a very good return rate for this type ofsurvey.

Participant Characteristics

The majority of survey participants work for not-for-profit or education organizations, are 45 years of age orolder, female and represent a variety of Art of Hosting training experiences at various locations in Ohio.The main reason survey participants attended the training is to have the opportunity to learn somethingnew and nearly one-half of the survey participants did not know much about the Art of Hosting beforeattending the training.

Training Experiences

Sixty-nine percent (69%) of survey participants give the overall training experience high ratings (6 or 7 on ascale of 1 to 7). Participants reported that they appreciated learning new approaches to leadership and

working with others. While this is positive, ratings and comments show that there were either features ofthe training that were not as effective as they could have been or that some survey participants do not feelcomfortable with some aspects of the Art of Hosting model or its techniques. Below are some examples ofverbatim comments:

The facilitators led by example to show effectiveness. During the training, I was more aware of the diverseopinions in our office around issues that I had never considered.

I think I gained more from the training personally. I could not immediately see how it would applyprofessionally. It was somewhat unclear how the training would affect our organization, practices..

The Art of Hosting training appears to be most effective in promoting communication, personal connection,listening and participation. Fifty-one percent (51%) of survey participants gave high ratings (6 or 7)regarding their knowledge increase as a result of the training. Sixty percent (60%) of survey participantssaid they were ready to apply what they learned. Thirty-five percent (35%) reported high ratings on thetraining improving their effectiveness as a leader or staff member. Below are some examples of verbatimcomments:

The training was valuable. It helped to enhance my communication and facilitation skills. It provided anopportunity to challenge my current thinking and comfort level.


4/28

I use the World Caf concept the most because it automatically results in all people becoming active andinterested participants in the discussion.

I thought the training teaches leaders a better way to communicate.and it also provides innovative andinclusive ways to gather collective input and move projects forward.

Training Applications

Many survey participants applied the Art of Hosting concepts and techniques --- a very positive finding.They applied what they learned in different settings: 72% in their work organization, 40% in a communitysetting and 32% in a personal setting. Seventeen percent (17%) applied what they learned in all threesettings.

Survey participants find nearly all the Art of Hosting techniques useful in professional, community and/orpersonal settings. The most popular are: World Caf, Circle, Check In/Check Out, Talking Stick, OpenSpace and Powerful Questions.

Survey participants experiences in leading or hosting have been moderately effective in reaching desiredmeeting, discussion or dialogue goals. Below are examples of some verbatim comments:

The meeting participants seem to be growing into the Art of Hosting process. It is a work in progress, withpeople at various comfort levels actively participating in this new process.

At a board meeting, I asked the group to Check In by sharing what their desire was to be part of the group.It was incredibly meaningful to share with each other and it created a common bond.

Asking Powerful Questions brings focus and intentionality to meetings.There were lots of ideas generated and the participation was good. Now I ask myself what happensnext? and whos responsible? Accountability is a major issue.

I have found the conversation-based approach to a problem is difficult for those having never been throughthe Art of Hosting training to grasp.

Personal Change

The training had a positive impact on the way survey participants listen to others and ask the rightquestions. Nearly all survey participants (85%) said the Art of Hosting training changed them in a variety ofways, including looking at situations and individuals with more awareness and a deeper understanding.Below are some examples of verbatim comments:

It helped me look and listen more deeply and to zero in on details, then step back to assess the broaderpicture. It helped me to realize we cannot assume we know what others are thinking.

I have become a better listener. I am not so quick to offer my opinion. I wait to hear what has been saidand only respond if necessary. Silence is okay.


5/28

Future Needs

Nearly all the survey participants think that if more organizations and individuals applied the Art of Hostingconcepts and techniques, goals and outcomes would be more likely achieved. This shows that mostparticipants believe the Art of Hosting is valuable and shows promise.

Over one-half (55%) of the survey participants think that some type of follow-up activity or get-togetherwould increase their use of the Art of Hosting concepts and techniques..

Conclusions

Survey participant feedback shows a desire for a new way of approaching groups, leadership and problemsolving, but the complexity and unique approach of the Art of Hosting may require additional supports andreinforcements for applying the techniques in the real world. Survey participants feel they need moretraining on specific techniques and on how to apply and adapt the techniques in their particular setting inorder to use them effectively.

Behavior changes slowly, and behavioral change requires consistent feedback to reinforce messages.Many Art of Hosting survey participants expressed the desire and need for additional training andreinforcements to increase their comfort level and effectiveness at using the techniques.

In order to assess the impact of the Art of Hosting training in the future, the training and its desiredoutcomes need to be more well-defined and consistent. The trainings examined through this evaluationwere very different in several ways. These included how trainees were selected, the length and level ofintensity of the training, the written materials provided, the components and featured techniques, and thetypes and mix of participants.


6/28

Background and Purpose

The Art of Hosting training and practice focuses on leading by engaging through interactive ways ofworking with groups and teams and with a purpose to serve the real needs in communities and to find newsolutions. As stated on the Art of Hosting Web site:

The Art of Hosting is a pattern and a practice that allows us to meet our humanity in ourselves and in each

other - as opposed to trying to be machines meeting. The Art of Hosting training is an experience fordeepening competency and confidence in hosting group processes - circle, world caf and open space andother forms. Each of these processes generates connection and releases wisdom within groups of people.They foster synergy and provide ways for people to participate in intention, design, andoutcomes/decisions/actions. The experience is hosted by a team of facilitators who are skilled/trained in atleast one, if not all of these processes; and the experience is aimed at people who want to serve asconversational hosts in their work, community, and personal lives.1

The focus of this evaluation project is to better understand the impact of the Art of Hosting training in Ohioand how it is practiced, especially focusing on identifying participant changes and the application of whatwas learned and the resulting outcomes in various settings: professionally, in the community andpersonally. Another purpose is to identify ways to improve and expand the learning process.

Methods

Two data collection methods were selected for the research: telephone interviews and a mail survey.Telephone interviews were conducted to collect qualitative information from a representative group of Art ofHosting training participants. The interviews were designed to better understand training participantsopinions of the Art of Hosting and their experiences in applying what they learned. This information wasused to identify critical issues and develop the survey questions.

Telephone interviews were conducted with individuals who attended one of the Art of Hosting trainingsoffered between March 2005 and October 2007. Art of Hosting leaders selected 22 Art of Hosting trainingparticipants to represent different training experiences and various levels of programinterests. Out of the22 participants, 15 were interviewed between March 28 and April 4, 2008. Interviews took between 40-50minutes to complete.

A six-page survey was developed based on the interview results and mailed on May 23, 2008 to 149training participants. These were all the individuals who had attended one of the Art of Hosting trainingsbetween March 2005 and October 2007. Training participants were asked to return their completedsurveys to Saperstein Associates, Inc, an independent marketing research firm in Columbus, Ohio.

Response RateOf the 149 training participants who were mailed surveys, 9 addresses were incorrect due to changes inemployment and 7 said they had not attended any of trainings. Eighty-three (83) completed surveys werereturned. This resulted in a response rate of 62% (83/133). This is a very good return rate for this type ofsurvey.

1www.artofhosting.org, Home page


7/28

Detailed Survey Results

Participant Characteristics

The majority of survey participants work for not-for-profit or education organizations and educationalinstitutions.

Most survey participants are 45 years of age or older. Seventy-two percent (72%) are female.

2% 4%8%

23%

62%

1%0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Health Care For-Profit Self-Employed Government Education Not-For-Profit

6%

24%

58%

12%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Under 30 30 to 44 45 to 60 Over 60

Q31: What is your age?

Number of respondents = 83


Q30: What best describes your current place of employment?


8/28

Nearly one-half of the survey participants didnt know much about the Art of Hosting before attending thetraining.

Training Experiences: General

Survey participants represent a variety of Art of Hosting training experiences at various locations in Ohio. Itshould be noted that the Art of Hosting trainings were not necessarily similar in terms of trainers, attendeecharacteristics, length and the emphasis on Art of Hosting concepts and techniques.Phil/Jewell: Do you think all the trainings were well represented. Were we short on the Hocking Hillsgroup? Do you have dates for Raymond and Deer Creek. Keep in mind survey participants could havechecked more than one location.

Training LocationNumber of

Respondents

Shawnee State Park (April 2007) 28

Josephinium (October 2007) 23Darby Dan Farms (October 2007) 19

CMA/CMAF/COTS/PFC at City Parks (August 2006 &2007)

14

Raymond Memorial (date) 14Deer Creek (date) 6

Hocking Hills State Park (March 2005) 8

Our Optimal Health Core Hosting Group (April/May

2006)

6

Other locations (e.g., Shambhala Institute, John GlennSchool, Boulder, Colorado, etc.)

5

Note: Survey participants could have attended more than one training.

48%

22%29%

1%0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Almost Nothing A Little Some A Lot

Q2: Prior to attending your first Art of Hosting training how much did you know about theArt of Hosting concepts and techniques?



9/28

The main reason survey participants attended the training is to have the opportunity to learn somethingnew. Few said they attended because of an organizational requirement.

Reason for Attending TrainingNumber of

RespondentsPercent

Opportunity to learn something new 56 67%Invited to attend by training organizer 41 49%

Promoted/encouraged by my organization 39 47%Like the Art of Hosting concept 38 46%

Refresh my leadership/communication skills 37 45%Opportunity to interact with community leaders 28 34%

Required by my organization 18 22%

Other (e.g., fan of Phil Cass, to apply concepts topersonal/professional life, etc.)

5 6%

Note: Survey participants could have given more than one reason.

Sixty-seven percent (67%) attended the training with others from their organization.

One survey question asked if survey participants had attended any other Art of Hosting trainings not listedon the survey. Sixteen (16) or 20% said Yes. The following are the trainings they attended:

Additional TrainingCherry Valley

Pegasus Conference in Boston

Our Optimal Health

German Village and Columbus State

Shambhala Institute in 2004 and 2006Metro park in southeast Columbus

Public health in Nova Scotia

Kelloggs food conferenceWith my agency and CMA in May 2008

In Hilliard, Ohio

Follow-up training in May 2008CMA and AFC in May 2008

OSU at Deer Park

The main reason for attending these additional trainings was to deepen their understanding of the Art of

Hosting, learn more about the Art of Hosting and get more comfortable with the Art of Hosting conceptsand techniques.

Training Experiences: Post-training Events

As the following chart shows, over one-half of the survey participants have participated in at least one post-training Art of Hosting event or get-together. One-third has participated in three or more. The mainreasons they participate in post-training events or get-togethers are to reconnect and/or interact with othertraining participants and to share experiences.


10/28

Training Experiences: Satisfaction

Survey participants were asked to rate their Art of Hosting training experience overall on a scale of 1 to 7,where 1 is Poor and 7 is Excellent. Sixty-nine percent (69%) gave high (6 or 7) ratings.

Survey participants were asked to explain their rating. Seventy-two (72) wrote in comments. The reasonfor high ratings (6 or 7) focused on learning new approaches to leadership and working with others, seeinghow the Art of Hosting concepts and techniques can be applied and relating to the other training surveyparticipants. Here are some examples of the verbatim comments:

My first experience was very enlightening. I liked the whole concept of the Art of Hosting and I continue topractice it with positive results.

The training was valuable. It helped to enhance my communication and facilitation skills.

0% 1% 1% 2%

27%33% 36%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

ExcellentPoor

69%

Q5a: Rate your Art of Hosting experience overall


45%

10% 11%

34%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

None 1 2 3 or More

Q9: How many post-training Art of Hosting events or get-togethers have youattended?



11/28

The facilitators led by example to show effectiveness. During the training, I was more aware of the diverseopinions in our office around issues that I had never considered.

I learned and enjoyed the interactions with community leaders, learning new techniques, and the ability topractice them.

Those who gave lower ratings (less than a 6) tended to feel that the Art of Hosting concepts and techniqueswere too vague, too out there or didnt see how the Art of Hosting concepts and techniques could beapplied to their own situations. Below are some examples of verbatim comments:

I think I gained more from the training personally. I could not immediately see how it would applyprofessionally. It was somewhat unclear how the training would affect our organization, practices..

I think [the World Caf] is a great way to encourage participation. However, the concepts were made to betoo abstract and elusive...

It was a good experience overall; however, it lacked the training aspectI need more application.

All the verbatim comments are in the Appendix.

Training Experiences: Feelings After Training

Survey participants were asked to describe how they felt after their training experience. Nearly all (89%)said they felt as though they had a better understanding of the Art of Hosting concepts and techniques.Interestingly, many survey participants (60%) said they were read to apply what they learned and nearlyone-half felt that they had a better understanding of other survey participants opinions and ideas.

Feelings After TrainingNumber of

Respondents PercentBetter understanding of the Art of Hostingconcepts and techniques

72 89%

Ready to apply what I learned 49 60%

Better understanding of other trainingparticipants opinions and ideas

39 48%

Wanted to learn more abut the Art of Hosting 39 47%A changed person 25 31%

Not exactly sure how I would apply what Ilearned

19 23%

Part of the community 10 7%Note: Survey participants could have given more than one description.


12/28

Training Experiences: Immediate Outcomes

As the four charts below show, one-half of the survey participants increased their knowledge about Art ofHosting concepts and techniques a lot. Fewer said they developed relationships, improved theircommunications and interactions with others, and improved their effectiveness as a leader or staff membera lot.

.

0% 0%5% 5%

39%

28%23%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

A LotVery Little

51%

Q10-1: As a result of the first Art of Hosting training youattended, how much did your knowledge about the Art ofHostin conce ts and techni ues increase?

Number of respondents =82

Knowledge Increase

4% 2%

15%

24%30%

9%16%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

A LotVery Little

25%

Q10-2: As a result of the first Art of Hosting training you attended, how

much did your relationships with other training surveyparticipants develop?

Relationships Developed



13/28


14/28

Forty-one percent (41%) of the training survey participants are prepared or very prepared to apply whatthey learned professionally after the Art of Hosting training. Only three survey participants (4%) said theywerent prepared. Not surprisingly, those who rated their training experience higher, tended to feel theywere more prepared to apply what they learned after the training than those who rated their experiencelower.

Training Applications: As A Participant

Eighty-four percent (84%) of the survey participants said they had experienced the Art of Hosting conceptsand techniques as a participant in meetings, discussions, conferences and/or dialogues. Theyexperienced many of the Art of Hosting concepts and techniques. World Caf and Circle were the twotechniques they experienced the most:

4%

56%

32%

9%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Not Prepared Somewhat

Prepared

Prepared Very Prepared

41%

Q11: After the first Art of Hosting training, how prepared were you toapply what you learned professionally?


19%

29%

56%

59%

61%

63%

67%

79%

81%

13%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 1 00%

Divergence, Emergence, Convergence

Chaordic Path

Appreciative Inquiry

Harvesting

Powerful Questions

Open Space

Talking Stick

Check In and/or Check Out

Circle

World Caf

Q13: What Art of Hosting concepts and techniques did youparticipate in?



15/28

Survey participants thought these Art of Hosting concepts and techniques were effective in increasing thequality of the meetings, discussions, conferences and/or dialogues they participated in.

Survey participants were asked to explain their rating, 52 of the survey participants wrote in comments.Most were positive, making general comments about how the Art of Hosting provides an opportunity foreveryone to be heard and express themselves, creates an open environment to generate ideas andstimulate conversation, and results in more effective and productive discussions and meetings. Somecomments mentioned how a specific Art of Hosting concept or technique was effective, especially WorldCaf. Here are some examples of verbatim comments:

We started using techniques such as Talking Stick and Check In and / or Check Out and it really changedour meetings in a positive way. Before we were very negative and talked over each other. They are moreproductive and civil now.

It is a good way to get lots of ideas, is a great collaborative technique, and creates lots of involvement.The time constraints and the inability to handle large groups were things that were not effective.

I recently hosted a conversation in Spanish with 50 Hispanic immigrants. A space was created forlistening and not controlling. The responded in an amazing way!

It was helpful, but participants were not given enough information or instruction. Therefore, the World Caf

was not as powerful as it might have been.

I use World Caf the most because it automatically results in all people becoming active and interestedparticipants in the discussion.

I have found the techniques to consistently enhance the conversation. A specific example was a highschool level policy making task force at the university using World Caf. There were a lot of action plansthey could follow through with and it is a great set-up for action planning through the coming year.

Q14a: In general, how effective were these Art of Hosting concepts and

techniques in increasing the quality of the meetings, discussions,conferences or dialogues you participated in (didnt lead or host)?


0% 1%4%

12%

33%36%

14%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

Ver EffectiveNot Effective

50%


16/28

Reasons for lower ratings (less than six) focused on needing more time to prepare to implement the Art ofHosting concepts and techniques, people in their organization not understanding the Art of Hosting or notparticipating in the activities, and the need for more training on specific techniques. Here are someexamples of verbatim comments:

It would have been more effective if all the people understood more about the purpose of the techniques,which is to have dialogue that is democratic.

The desire and effort to incorporate the Art of Hosting concepts and tools is present, but the level of skill,time, and energy to do so is more of a challenge. This is especially so for starting an Art of Hosting teamfor the agency.


Training Applications: Professional Setting

Many of the survey participants (72%) said they had the opportunity to apply, lead or host an Art of Hostingconcept or technique in their work organization with staff or associates at meetings, discussions and/ordialogues. The survey participants applied, lead or hosted all the Art of Hosting techniques, with the mostpopular being Circle and World Caf (see chart below).

13%

23%

43%

52%

53%

58%

58%

65%

73%

8%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 1 00%


Chaordic Path


Open Space

Harvesting

Talking Stick

Powerful Questions

Check In and/or Check Out

World Caf

Circle

Q16: What Art of Hosting concepts and techniques did you apply,lead or host in your work organization?



17/28

The Art of Hosting concepts and techniques were moderately effective in reaching the goals or outcomes ofthe meetings, discussions and/or dialogues that participants hosted or led in a professional setting.

Survey participants were asked to explain their rating, 44 wrote in comments. Survey participantsmentioned how a specific Art of Hosting technique was used successfully and resulted in productiveoutcomes and achieving goals, and how Art of Hosting encouraged participation and provided structure.Here are some examples of verbatim comments:

The techniques prompted participation by reluctant members in a non-threatening manner.

The meeting participants seem to be growing into the Art of Hosting process. It is a work in progress, withpeople at various comfort levels actively participating in this new process.

At a board meeting, I asked the group to Check In by sharing what their desire was to be part of the group.It was incredibly meaningful to share with each other and it created a common bond.

Asking Powerful Questions brings focus and intentionality to meetings.

When I follow the Art of Hosting fully, it is much more successful. Sometimes relationship building is moreimportant than anything else and can be achieved with the Art of Hosting.

The comments pertaining to lower ratings (less than six) were about co-workers not understanding the Artof Hosting and/or not participating; needing more help implementing a technique; and more time is neededto make progress in their organization; and the lack of follow-up and accountability. Here are someexamples of verbatim comments:

There was not enough time for the process to unfold and occur. There was also a lack of people withknowledge of technology.

Q17a: In general, how effective were these Art of Hosting concepts and techniques

in reaching the goals or outcomes of the meetings, discussions and/or

dialogues you lead or hosted in your organization with staff or associates?


0% 0% 2%9%

43%

32%

14%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

Ver EffectiveNot Effective

46%


18/28

There were lots of ideas generated and the participation was good. Now I ask myself what happensnext? and whos responsible? Accountability is a major issue.

I have found the conversation-based approach to a problem is difficult for those having never been throughthe Art of Hosting training to grasp.


Training Applications: Community Setting

Thirty-three (33) survey participants (40%) said they had the opportunity to apply, lead or host an Art ofHosting concept or technique in a community meeting, discussions, conference and/or dialogues. As thefollowing chart shows, the survey participants applied, lead or hosted all the Art of Hosting techniques, withthe most popular being Powerful Questions, Circle, World Caf and Check In/Check Out.

12%

27%

36%

52%

55%

61%

61%

64%

70%

9%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 1 00%


Chaordic Path


Talking Stick

Harvesting

Open Space

Check In/Check Out

World Caf

Circle

Powerful Questions

Q19: What Art of Hosting concepts and techniques did you apply,lead or host in a community setting?



19/28

The Art of Hosting concepts and techniques were effective in a community setting, more so than in aprofessional setting (shown above).

Survey participants were asked to explain their rating, 22 wrote in comments. Survey participantsmentioned how the Art of Hosting encouraged participation, got people engaged and open to conversation,and enhanced their meetings and discussions to resolve issues and be more productive. Here are someexamples of verbatim comments:

I have used the techniques to help lead budget allocation and priority setting at my church. It is a multi-

month process and the techniques are very helpful.

The Art of Hosting techniques give you the courage and the tools to address difficult, but necessary,questions. Even when there is initial resistance, the techniques promote forward movement in thediscussion.

I was able to apply these techniques with a community organization with which we are partnering. Ithelped us get over some tricky issues relating to territory.

There was a group of university students who spent most of the day using World Caf and Open Space.The evaluations were almost unanimously positive. The group felt connected with each other and had

great, participatory conversation all day long.

The comments pertaining to lower ratings (five or less) were about the difficulty in going beyond generatingideas to follow-up and resolution. Here are some examples of verbatim comments:

The concepts generated a lot of ideas, got folks engaged, and created excitement; however, there was noeffective and timely follow-up. I ask myself whats different?

The process was effective in bringing forth good ideas, but could not go further.

0% 0%3%

0%

29%32%

36%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

Very EffectiveNot Effective

68%


Q20a: In general, how effective were these Art of Hosting concepts and techniques in

reaching the goals or outcomes of the meetings, discussions and/or dialoguesyou lead or hosted in a community setting?


20/28

Sometimes we didnt see goals achieved until after the sessions. Sometimes it takes time.


Training Applications: Personal Setting

Twenty-six (26) survey participants or 32% said they had the opportunity to apply, lead or host an Art ofHosting concept or technique in a personal setting, with family or friends. The survey participants applied,lead or hosted all but two of the Art of Hosting techniques, with the most popular being Powerful Questionsand Circle. Interestingly, the technique of Powerful Questions was used more in community and personalsettings than in the work organization.

0%

12%

15%

15%

19%

31%

35%

42%

69%

0%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 1 00%

World Caf


Open Space

Talking Stick

Chaordic Path

Harvesting

Check In/Check Out


Circle

Powerful Questions


Q22: What Art of Hosting concepts and techniques did youapply, lead or host in a personal setting?


21/28

These techniques were effective in helping survey participants reach the goals and outcomes in a personalsetting.

Survey participants were asked to explain their rating, 22 wrote in comments. Survey participants hadsuccessfully applied the Art of Hosting techniques and concepts with their family members resulting in moreopen communication, asking better questions and listening more. A few survey participants mentioned thechallenges in applying the Art of Hosting concepts and techniques in a personal setting. Here are someexamples of verbatim comments:

This has changed the way I try to have conversations with friends and family. Beginning with a question

and not knowing the answer has given lots of space for conversation and ease.

The techniques are very powerful in getting others to drill down to the real questions.

I have been more confident in asking wicked questions within my family. The resulting communication hasbeen more open and meaningful.

It is tougher in a personal setting versus a business setting.


Interestingly, some survey participants lead, hosted or applied the Art of Hosting concepts and techniquesat work, in the community and personally.

Personal Change

Nearly all the survey participants (85%) said the Art of Hosting training affected them in a way that changedhow they interact with others, feel about themselves and others, approach situations or issues or look at theworld around them. They were asked to specify what changed, 63 responded. The top ways surveyparticipants changed are:

0% 0% 0%

9%

30%

39%

22%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7

Very EffectiveNot Effective

61%

Q23a: In general, how effective were the Art of Hosting concepts and techniques inreaching the goals or outcomes of these personal settings?



22/28

! Listen much more to what others are saying (and dont react without thinking)! Recognize the importance of questions and formulate them better! Look at situations and people differently (e.g., go deeper, greater awareness)! Are more comfortable and/or open with others! Have a better understanding of others opinions and ideas! Look at the world differently since the training experience

Here are some examples of what the survey participants wrote:

My conversation technique changed and I enhanced my listening skills.

It is difficult to explain. I have less patience for conversations that arent meaningful. It sounds bad, but ithas provided me a lot of clarity. I am more willing to ask questions and try new ways of being and doingeven if the outcomes are unknown.

I have become a better listener. I am not so quick to offer my opinion. I wait to hear what has been saidand only respond if necessary. Silence is okay.

I cannot put this into words. I think that it is a spiritual process for me. I feel closer to my indigenous self. Iappreciate silence and meditation more.

I am more mindful of capturing and holding up other peoples input and reactions to topics at hand.

It somewhat changed me. It makes me think about the questions I ask in discussions with others. I try tobe more open in my responses.

It helped me look and listen more deeply and to zero in on details, then step back to assess the broaderpicture. It helped me to realize we cannot assume we know what others are thinking.

I try to stay in the present and enrich mindfulness. I ask questions not to just look for an answer, but tolisten.

I renewed my hope that our society may be able to work together to solve tough problems.


Future Needs

Nearly all the survey participants (97%) think that if more organizations and individuals applied the Art ofHosting concepts and techniques, goals and outcomes would be more likely achieved.

Survey participants were asked what it would take for them to apply, lead or host the Art of Hostingconcepts and techniques more, if at all. As the following chart shows, more than one-half think moreexposure to situations where it would be appropriate to apply the Art of Hostingwould increase their use ofthe Art of Hosting concepts and techniques. In other words, survey participants would like to betterunderstand how the Art of Hosting concepts and techniques have been successfully applied, so they canbe more successful at applying them to their own situations.


23/28

What It Would Take Number Percent

More exposure to situations where it wouldbe appropriate to apply the Art of Hosting

45 56%

More training on specific techniques 39 49%More training to help me apply thetechniques to my situation

38 47%

If others in my organization were trained 27 34%Someone to help or supports me 22 28%

More support from my manager, myorganization

11 14%

Note: Survey participants could have attended more than one selection.

Over one-half of the survey participants think some type of follow-up activity or get-together after the Art ofHosting training would increase the use of the Art of Hosting concepts and techniques.

Survey participants were asked what type of follow-up activities they thought would be best, 51 wrote insuggestions. The two most frequently mentioned were to have more trainings and learning opportunitiesand to have more meetings, get-togethers and/or discussions. Survey participants also want more supportfrom individuals experienced in the Art of Hosting, more access to information and communications on theInternet and more follow-up with other training survey participants. Here are some examples of what the

survey participants wrote:

I think it would be helpful to have more training and opportunities to learn from those who areexperienced.

Practice, practice, practice! It helps build skills and courage.

Have a day-long training devoted to specific tools. It can cover how to develop Powerful Questions,conducting World Caf, Harvesting, and what to do as follow-up.

9%2%

34%

55%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Don't Know No Maybe Yes

Q27a: Do you think some type of follow-up activity or get-together after Art ofHosting training would increase the use of the Art of Hosting conceptsand techniques?

Number of res ondents = 83


24/28

Have special interactive learn-ins on a topic-by-topic basis.

Anything via the Internet or email would be best. Face-to-face participation may be limited for me.I suggest getting together for training to apply the concept in different settings, and then have a debriefingafterward.

I would like numerous opportunities to meet and electronic ways to reach out at intervening times.

Have refresher courses discussing best practices and where the Art of Hosting is being used and how.There can also be newsletter or e-mail communication.

There should be follow-up gatherings to practice, brainstorm, and share.

I need support from others who are trained and have an opportunity to share experiences.


Survey participants were presented with four possible follow-up training activities. As the chart below

shows, of the four activities, a two-hour refresher training with Art of Hosting trainers is the activity surveyparticipants would most likely attend.

ListServ Awareness

Two-thirds (67%) of the survey participants are aware of the Art of Hosting ListServ.

32%

45%

57%

14%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Monthly One-hour

Conference Calls With

Trainer or Host

Use of Web Technology

Quarterly Two-hour

Gatherings with Other

Training Participants

Two-hour Refresher

Training with AOH

Trainers

Q28: Likeliness of attending? (Percentages of Very Likelyresponses)



25/28

Additional Comments

Survey participants were asked to provide any additional input, thoughts, recommendations or comments.Twenty-five (25) responded. Most of the comments were positive, thanking the Art of Hosting sponsorsand saying how appreciative they are for the opportunity to participate in the trainings. Here are someexamples:

Thank you for your continuing support of this work in the community. Thank you for the encouragement tohave this kind of listening and healthy training.

Thank you for hosting the original trainings and for asking me how to support and further the cause.

Thanks to CMA for providing the opportunities.

I would like to convey my thanks and appreciation for the opportunity to engage in the Art of Hosting. It isa most respectful and honoring form of meeting and engaging in meaningful dialogue.

It was wonderful to have a block of time set aside to participate in the Art of Hosting training. Thanks to

the planners and participants for all their work, and being willing to take risks and be open to a new way ofthinking and doing. Thank you Phil and Diane.

Four survey participants wrote in suggestions:

If there is a downside to the Art of Hosting in organizations it would have to do with getting work done andmaking decisions in a timely manners. Not all organizations or business processes are conducive to theArt of Hosting. It works best when dealing with the development of mission purpose statements andstrategic planning.

There might be a perception in the community that the Art of Hosting is more of a spiritual retreat in the

new age or Buddhist tradition. This will appeal to some, but raise red flags for others.

The Art of Hosting is very helpful for initial gatherings, but once the question and direction of the group isestablished the World Caf style is not so productive.

I appreciated the training. Thank you! I had a couple of thoughts. Make activities and concepts lesselusive and more concrete. Explain the values and principles upon which the Art of Hosting is based, suchas democratic decision-making and working collectively. Explain the benefits, such as enhancedsustainability.


Additional Analyses

To better understand why some survey participants rated their Art of Hosting training experience somewhatlower than others, a cross-tabulation analysis was conducted. It should be noted that dividing the surveydata into various categories could result in numbers too small to detect any significant relationships. Forthis analysis possible trends or relationships are noted only when a statistically significant difference wasfound.


26/28

Attended with Others in Their Organization

The one relationship worth noting has to do with whether a survey participant attended the Art of Hostingtraining with others from their organization or not. When a survey participants attended the Art of Hostingtraining with others from their organization they were somewhat less prepared to apply what they learnedprofessionally and tended not to lead, host, or apply what they learned in their work organization, thecommunity or personally than those who didnt attend the Art of Hosting training with others from their workorganization.

However, those who attended the training with others from their work organization experienced as much ofa personal change from the Art of Hosting training as others. Also, attending training with others from theirwork organization or not didnt effect participants perceptions of training outcomes, such as increasing theirknowledge about Art of Hosting concepts and techniques, developing relationships, improving theircommunications and interactions with others, and improving their effectiveness as a leader or staffmember.

Participated in Post-training Events or Get-togethers

Another relationship worth noting has to do with those survey participants who participated in post-trainingevents or get-togethers versus those who did not. Those who made the effort to continue to be involved inthe Art of Hosting after their initial training, reported the training increased their knowledge about the Art ofHosting more, tended to develop more relationships with other training participants and think theircommunications and interactions with others improved more as a result of the training, compared to thosewho didnt participate in follow-up events or get-togethers. Interestingly, there was no difference in howmuch survey participants effectiveness as a leader or staff member improved.

In addition, those who participated in post-training events or get-togethers did not feel more prepared toapply what they learned after the training than those who didnt participate in post-training events or get-togethers. However, they did tend to lead or host Art of Hosting concepts and techniques in their work

organizations more and think the techniques were more effective, compared to those who didnt participatein post-training events or get-togethers.

Conclusions

The survey participants represent a variety of Art of Hosting training experiences and organizationalbackgrounds. Survey participants have learned about the Art of Hosting concepts and techniques andhave applied them in professional, community and/or personal settings. The Art of Hosting trainingappears to be most effective in promoting communication, personal connection, listening and participation.

Survey participants experiences in leading or hosting using Art of Hosting concepts and techniques hasbeen moderately effective in reaching the desired meeting, discussion or dialogue goals. The training hada positive impact on the way some participants listen to others and ask the right questions.

Participants have also encountered situations where applying Art of Hosting concepts and techniques hadits challenges. These appear to relate to a variety of issues including the following:


27/28

Lacking clarity on how the model takes the conversations and ideas to the next step action,decision and accountability

Using the techniques with people who do not like participating Needing help to effectively apply Art of Hosting concepts and techniques in their own specific

situations

To better understand the results, evaluators assessed them using research on training impact. Based onthe well known work of Donald Kirkpatrick2, assessing the impact of training is often conducted on fourlevels:

1. Satisfaction with training2. Acquisition of new knowledge or skills3. Application of what was learned4. Longer term impact on the organization

These evaluation results show that the Art of Hosting training has had generally positive results on the firstthree levels.

1. Satisfaction For the most part, survey participants gave the training moderately high ratings.Participants reported that they appreciated learning new approaches to leadership and working with others.The evaluators would have expected higher ratings based on their experience with this rating scale.Somewhat lower ratings could be explained by some participants being unclear how to apply the conceptand techniques to their professional situations.

2. Acquisition of new knowledge or skills Half of the survey participants gave high ratings regardingtheir knowledge increase as a result of the training and over half said they were ready to apply what theylearned. Less than half of survey participants reported the training improved their communications andinteractions and their effectiveness as a leader or staff member. While this is positive, the evaluators wouldhave expected higher ratings based on their experience with this rating scale.

3. Application of what was learned Despite some survey participants saying their knowledge of the Artof Hosting concepts and techniques did not increase greatly due to their training experience, participantsapplications of Art of Hosting concepts and techniques appear to be at fairly high levels. Surveyparticipants report actually applying what they learned in different settings: 72% in their work organization,40% in a community setting and 32% in a personal setting. Seventeen percent (17%) applied the Art ofHosting concepts and techniques in all three settings.

4. Longer term impact - It was not within the scope of this evaluation to determine the longer term impactof the Art of Hosting training and use of techniques in organizations and the community. In regards tolonger term impact, the World Bank Institute (WBI), which has conducted thousands of training programs

intended to increase teamwork and leadership worldwide, reports that evaluation research on theeffectiveness of corporate training is very limited and that that only 8% of organizations carry out results orimpact evaluations on training. 3

2 Donald Kirkpatrick, Evaluating Training Programs: The Four Levels, 1998

3Features of Staff Learning that Contribute to Effectiveness in the World Bank, Marlaine E. Lockheed and Diana J. Arango,WBI Evaluation Studies, No. EG05-107, The World Bank Institute, The World Bank, Washington, D.C., April 2005


28/28

In spite of the lack of training impact information for comparative purposes, these findings lend themselvesto the following additional conclusions.

Nearly all the participants think that if more organizations and individuals applied the Art of Hostingconcepts and techniques, goals and outcomes would be more likely achieved. This shows thatmost participants believe the Art of Hosting is valuable and has promise as an effective leadershiptool.

Many participants emphasized the positive impact of the Art of Hosting training on their listening andcommunication styles. They mentioned that rather than react quickly to what others say, they listenintently to others and this has improved their professional and personal interactions.

Participants reported that the Art of Hosting techniques were more effective in the community andpersonal settings as opposed to the professional setting. More exploration needs to occur aroundwhat factors could have an impact on the Art of Hosting concepts and techniques being moreeffective in one setting as opposed to another.

One possible reason for the lower ratings on some of the survey questions could be that

participants feel they need more training on specific techniques and more training on how to applyand adapt the techniques in their particular setting or organization in order to use them effectively.

Participant feedback shows a desire for a new way of approaching groups, leadership and problemsolving, but the complexity and unique approach of the Art of Hosting may require additionalsupports and reinforcements for applying the techniques in the real world.

Behavior changes slowly, and behavioral change requires consistent feedback to reinforcemessages. Many Art of Hosting training participants expressed the desire and need for additionaltraining and reinforcements to increase their comfort level and effectiveness in using thetechniques.

In order to better assess the impact of the Art of Hosting training in the future, the training and itsdesired outcomes need to be more well-defined and consistent. The trainings examined throughthis evaluation were very different in several ways: how trainees were selected, the length and levelof intensity of the training, the written materials provided, the components and featured techniques,the types and mix of participants and the ways participants were invited to attend.

Art of Hosting Research Report CMA

Documents

Transcript of Art of Hosting Research Report CMA