2019 China Participant Satisfaction Survey Results · The Duke of Edinburgh [s International Award...

2019 China Participant Satisfaction Survey Results

© 2020 The Duke of Edinburgh’s International Award Foundation1

RESEARCH TEAM


The Duke of Edinburgh’s International Award Foundation:

Melek De-Wint, Research and Evaluation Director

Amy Pearce, Research Manager

Thea Walker, Research Administrator

The Duke of Edinburgh’s International Award China:

Lyla Meng, China Programme Manager

CONTENTS


TITLE PAGE

Introduction 4

Methodology 6

Survey Respondent Demographics 9

Results : Net Promoter Score 16

Results : Activation of the Award 18

Results : Achievements of the Award 24

Results : Administration of the Award 31

Results : Aspirations of the Award 39

Conclusion 45

INTRODUCTION


The Duke of Edinburgh’s International Award Foundation (the Foundation) runs satisfaction surveys annually with young people around the world who are involved in the Award.

These surveys give young people an outlet to give anonymous feedback on their Award experience which provides invaluable insights for the Foundation and its national and local delivery partners. The results should help us maintain high quality support to young people as they participate in the Award, and assist plans to make the Award more accessible.

In this this report we present the results of the analysis of participant satisfaction survey data comprised of 78 responses that were collected in China, between January and December 2019.

The report consists of the following sections:

• In the first section of this report, we set out the methodology we followed in data collection and analysis of the survey data.

• Secondly, we introduce the demographic categories we used in the survey and present the distribution of data by these demographic categories.

• As a way of providing an assessment of the respondents’ overall satisfaction of their Award experience, we start the results section with presenting the Net Promoter Score (NPS) of the Award. NPS is a widely used measure of satisfaction of the user of a product or service.


The rest of the results are organised under the following themes:

❖ Activation of the Award: In this section we present the results about the change in activity levels of respondents in physical activity, skills practice, volunteering and outdoor activity as a result of participating in the Award.

❖ Achievements of the Award: The results in this section are about what young people got out of participating in the Award, such as making new friends, feeling challenged, experiencing personal change and so on.

❖ Administration of the Award: In this section we look into the Award experience of respondents from hearing about the Award all the way to Award ceremonies and continuing to the next level.

❖ Aspirations of the Award: The aspiration shared across The Duke of Edinburgh’s International Award Association is that the Award delivery is aligned with certain key and guiding principles. This section of the results is about respondents’ feedback on how much they observed these principles throughout their Award journey. The principles included in this section are Inclusive, Individual, Enjoyable, Inspirational and Non-competitive.

Finally, in the conclusion section we present the limitations of this survey and provide a discussion of these limitations and the findings.

INTRODUCTION

METHODOLOGY



Survey

The survey questions were originally based on the satisfaction survey in the Duke of Edinburgh’s Award’s Quality Toolkit. They were reviewed and revised by a working group consisting of Foundation staff and representatives of national delivery partners prior to the launch of the 2018 and 2019 rounds.The survey was conducted through an online data collection platform, called Qualtrics.

Recruitment

Young people received a system email from the Online Record Book (where participants record their Award activities) which invites them to complete the survey to give feedback on their Award experience.

Data Cleansing

Survey data was cleansed to remove duplicated survey responses, testing survey responses, and survey responses where the respondent answered in an incoherent manner (for example, answering all the multiple choice questions with the same answer and not answering any open-ended survey responses).

METHODOLOGY

https://www.qualtrics.com/

METHODOLOGY


Quantitative analysis

The responses to the closed-ended questions were analysed using descriptive statistics and the analysis function of Qualtrics. Following this, the results were verified by an external researcher and minor revisions were made upon her feedback.

Qualitative analysis

The responses to open-ended questions were visualised using the word cloud function on Qualtrics, where similar words are grouped and irrelevant words or words that were featured within the question were cut out.

Quotes from young people which give a good level of detail in their response, have then been selected to be presented within this report, to ensure the voices of young people themselves, are presented within these results.

SURVEY RESPONDENT DEMOGRAPHICS


SAMPLE SIZE, GENDER

Sample size: 78

To put this in context, in 2018*, 459 Awards were completed in China. The gender of participants who gained an Award in 2018:

• 47% male• 53% female• 0.2% not disclosed

Female participants are therefore over-represented in this survey data

*Since the 2019 annual participation statistics are not yet available, this survey data has been compared to the most recent demographic data we have, from the 2018 annual participation statistics.


AGE

Age Distribution

The Award is available to young people aged 14 to 24. In some circumstances, young people may begin their Award slightly before their 14th birthday and may complete their Award slightly after their 24th birthday.


AWARD CENTRE TYPE

Overall, the majority of respondents are from Independent Schools (86%).

In 2018, 84% of all Award Centres in China were Independent Schools and 9% were Government Schools.

As this highlights, the respondent sample of this survey roughly represents the total population of Award participants in China.


ETHNIC MINORITIES

DISABILITIES

18% have an ethnic minority background

2% have a disability


SOCIOECONOMIC STATUS

The majority of Award participants’ families are from a high Socio-Economic Status, according to their parental education levels.


AWARD LEVEL

76% of Silver level respondents had previously completed their Bronze Award.100% of Gold level respondents had previously completed their Bronze and/or Silver Award.

To put this in context, in 2018, out of the 459 Awards completed in 2018, 81% were Bronze level, 18% Silver, and 1% Gold. Young people can begin their Award at any level, but 44% of all Silver and Gold participants who gained an Award in China in 2018 were continuing from previous Award levels:

• 40% of all of the Silver Awards gained in 2018 were continuing from the Bronze level. • 100% of Gold Awards gained in 2018 were continuing from Bronze or Silver level.


RESULTS : Net Promoter Score


NET PROMOTER SCORE (NPS)

Overall NPS for the Award in China = 22 (Good).

What is NPS score? NPS aims to measure the loyalty that exists between a provider and a user. Survey respondents mark on a scale from 1 (not at all likely) to 10 (extremely likely), how likely they are to recommend your product to others. You subtract the percentage of detractors, from the percentage of promoters (ignoring the neutrals) to calculate your NPS score. Scores above 0 are considered good, scores 50+ excellent and scores 70+ world class. Based on global NPS standards, any score above 0 would be considered ‘good’. This simply means that the majority of your user base is loyal.

Compared to the 2018 survey results, NPS scores increased in China by 27 points.


RESULTS : Activation of the Award


THE PHYSICAL RECREATION SECTION

Before the Award, the majority of young people already took part in physical recreation at least once a week (70%).

After the Award, there is a 7% increase in young people planning to exercise more than once a week.

Of the participants that exercised once a month or less before the Award… 45% now intend to do physical recreation at least once a week after completing their Award.


THE SKILLS SECTION

Before the Award, 72% of young people already practised a skill at least once a week. After the Award, this rises to 87%.

The percentage of young people practicing a skill less than once a month drops by 8% after the Award.

Of the participants that practiced a skill less than once a month before the Award… 58% now intend to practice at least once a week and 25% intend to practice once a month.


THE VOLUNTARY SERVICE SECTION

Out of the physical recreation, skills and voluntary service section of the Award, we see the greatest change in activity levels in the voluntary service section.

Before the Award, 64% of young people volunteered regularly (at least once a month). After the Award, 80% intend to volunteer regularly.

Of the participants that volunteered less than once a month before the Award… 54% now intend to continue volunteering regularly.


THE ADVENTUROUS JOURNEY

Before the Award, 17% of young people had never participated in an Adventurous Journey (AJ) type of activity, such as hiking, kayaking, sailing etc. After, only 2% said they would never participate in this type of activity again.

Before the Award, 34% of young people participated in an AJ type activity at least once a month. After the Award, this rises to 60%.

Of the participants that never participated in an AJ type of activity before the Award… 40% now intend to continue doing an AJ type of activity at least once a month50% now intend to continue doing an AJ less than once a month and 10% intend to continue to never participate.


THE ADVENTUROUS JOURNEY

Please describe the impact that participating in the Adventurous Journey had on you. For example, did it help you develop any skills or was it a new experience for you?

“Yes it could be absolutely seen that I will do more outdoor activities in the future.”

“The adventure journey is very challenge to me and develop new skills to survive in some unfamiliar area. Through hiking, cooking food by firewoods, and camping, I viewed this journey is very joyful and encouraging

me to have more activities like this. Most important, I learn how to cooperate with people I never meet before, and it will benefit me for my future education life and career life”

“Adventurous Journey was amazing, we tried a lot of new things that we couldn't try before, and we had to challenge ourselves to push ourself into our goal. I really liked it”


RESULTS : Achievements of the Award


TRYING NEW THINGS

92% of participants tried something new


MAKING NEW FRIENDS

77% of participants feel they have made new friends through participating in the Award

This is a new question that was added to the survey this year.


FEELING PART OF THE COMMUNITY

76% of participants feel part of their community after participating in the Award.

Compared to the 2018 survey results, feeling part of the community has increased in China by 3%.


PERSONAL CHANGE

60% of participants feel they have changed as a person, as a result of their Award participation.

As a result of your Award participation, have you changed as a person?

Compared to the 2018 survey results, personal change decreased in China by 7%.


PERSONAL CHANGE – IN THEIR WORDS

Please explain how you've changed.

“More confident on public speaking and leadership. More responsibility on running projects. Better communicator and engager.“

“It helped me to understand that there are lots of risks and hard tasks in our lives, which needs us to overcome them.”

“more independent and learn some wilderness survival with team work.“


RESULTS : Administration of the Award


REGISTERING TO TAKE PART

Finding out about the Award

❖96% found out about the Award through their school/organisation❖2.7% through word of mouth❖0% through online search

What made you interested in participating in the Award? Please tell us what you see as the main

appeal of the Award

“Universities find it attractive when you are applying.”

“My awareness of volunteering. I want to learn some new skills and some experience of

unfamiliar life.”

“I try to challenge myself and want to take part in more exploration of myself and the world.”


MY AWARD LEADER

87% of participants feel comfortable contacting their Award Leader for support.

90% feel supported and encouraged by their Award Leader.

Compared to the 2018 survey results, feeling supported by their Award Leader increased in China by 4%.


MY AWARD LEADER - IN THEIR WORDS

How would you describe the role your Award Leader played when you were going through your Award programme?

“the advice giver, the supervisor, the helper when we need help and encourages us all the way”

“He helped me a lot and always encouraged me, gave me suggestions while I am facing difficulties.”

“He guided me and encouraged me when I felt confused and exhausted.”

“He is a kind and responsible person.”


TRAINING AND FEEDBACK

91% of participants feel they had the training they needed.

87% felt their progress and achievements were reviewed regularly.

Compared to the 2018 survey results, feeling they had the training they received in China increased by 4%.


AWARD ACTIVITIES

80% of participants feel there was enough activity choice


AWARD CEREMONIES

76% of participants said there are enjoyable Award ceremonies.


PROGRESSION WITHIN THE AWARD

Overall, 51% plan to continue to the next Award level33% are undecided, and 16% don’t wish to continue

Are you planning to continue to the next Award level?

Each year we have the highest number of participants at the Bronze level, with less at Silver level, and fewest at the Gold level.

These survey results suggest that Silver participants are 35% less likely to continue to the next level than Bronze participants.

This question was not asked to Gold participants (since there is no Award level higher than Gold).

Compared to the 2018 survey results, planning to continue to the next level increased in China by 9%.


PROGRESSION WITHIN THE AWARD

Are you planning to continue to the next Award level?Please tell us why

“It is a big challenge for me to improve myself during the journey.”

“It is good for entering a good university”

“I think this is a good project and I can learn more about myself during the activities so I will continue it.”

“Not sure if I have enough time to do so”


RESULTS : Aspirations of the Award


THE AWARD IS ENJOYABLE

85% of participants enjoyed doing their Award.


THE AWARD IS CHALLENGING

94% of participants felt challenged.

Compared to the 2018 survey results, feeling challenged has increased in China by 7%.


THE AWARD IS INSPIRATIONAL

89% of participants felt inspired.

Compared to the 2018 survey results, feeling inspired has increased in China by 17%.


THE AWARD IS NON-COMPETITIVE

70% of participants feel the Award is non-competitive.

To explain what we mean by non-competitive, participants were asked the following question: Do you agree or disagree with the following statement:The Award is non-competitive.

(Being ‘non-competitive’ means that you don’t compete with your peers, but challenge yourself according to your abilities. Within the Award, it would mean that although there may be some competition between you and your peers in your activities, this competitiondoes not affect your ability to achieve your Award.)

Do you feel the Award is non-competitive? Please rate your response to the statement.

Compared to the 2018 survey results, feeling the Award was non- competitive increased in China by 7%.


THE AWARD IS INDIVIDUAL

91% planned their own Award program.

Compared to the 2018 survey results, feeling able to plan their own programme increased in China by 16%.


THE AWARD IS INCLUSIVE

91% believe the Award is inclusive within their Award Centre

Does everyone aged 14-25 in your school/organisation have the opportunity to take part in the Award if they want to?

Compared to the 2018 survey results, feeling the Award was inclusive increased in China by 15%.


CONCLUSION


CONCLUSION

As these surveys results demonstrate, generally Award participants who complete their Award in China are very satisfied with their experience and would recommend the Award to others. Most Chinese participants are from private junior and senior middle schools aged between 14 to 19. By doing the Award, participants tried new things, made new friends and feel more engaged with their community. Chinese participants found the Award is enjoyable, challenging, inspiring and non-competitive to them.

It is worth noting that since these surveys are shared with young people when they complete each Award level, through the Online Record Book (ORB) communications, the results are mostly from Award participants who have completed their Award level (mostly, because the web links to surveys may also be shared by Award Operators at various times throughout the year, to increase response numbers). Further research must be done to ensure we can capture, and act on, the feedback and experiences of young people who do not complete their Awards, as their satisfaction rates will be lower and they may provide more constructive feedback about how we could improve their experience with the Award.


For more information on these research results, please contact us at:

E: [email protected]

W: www.intawardchina.cn


mailto:[email protected]

http://www.intawardchina.cn/

2019 China Participant Satisfaction Survey Results · The Duke of Edinburgh [s International Award...

Documents

Transcript of 2019 China Participant Satisfaction Survey Results · The Duke of Edinburgh [s International Award...