Wessex AHSN Stakeholder Research report 2016

44
Academic Health Science Networks - stakeholder research 2016 Wessex summary report

Transcript of Wessex AHSN Stakeholder Research report 2016

Academic Health Science Networks -stakeholder research 2016

Wessex summary report

Overview

2

Survey details

3

This online survey was administered to stakeholders of the Academic Health Science Networks and covers the same areas as the first wave in 2015.As with last year, stakeholders were initially pre-identified and provided with the opportunity to comment on any of the following:

• The AHSN which they are identified as having worked with/are associated with;

• Any other AHSN; and• The entire AHSN network at a national level.

In addition, individuals who were not pre-identified as stakeholders were also given the chance to comment on AHSNs of their choosing via open links disseminated by NHS England, other stakeholders, and through AHSNs’ own communication channels.

This report contains responses specifically given in relation to Wessex AHSN. This is based on 116 responses. In the report, the data is compared against the 2015 results for this AHSN, and also the total figure for all AHSNs for each specific question.

The survey ran between 17th August and 19th September 2016.

Who took part?

13%

17%

1%

4%

7%

22%

17%

3%

14%

12%

14%

3%

3%

3%

5%

38%

2%

21%

Clinical Commissioning Group (CCG)(n=14)

Higher Education Institute (n=16)

Local Economic Partnership (LEP) (n=3)

Local government (n=3)

Patients group (n=4)

Private company (n=6)

Health or social care provider (n=44)

Voluntary and Community Sector (VCS)(n=2)

Other (n=24)

Stakeholder type

2015

2016

S1. Which of the following best describes your organisation? S2. Which, if any, of the following applies to your organisation....? S3. Is this response on behalf of your entire organisation or you as an individual?

4

(64%)

Working relationship

59%(55%)

59%(58%)

6%(9%)We see ourselves as a

member /partner of the AHSN

We have worked with theAHSN in the last 12 months

Neither of the above

Note: All AHSN figures in brackets

28%(33%)

72%(67%)

The organisation

As an individual

Answering on behalf of their organisation or as an individual

Note: All AHSN figures in brackets

Sample source

37%(65%)

62%(31%)

Non pre-identified stakeholders(Open Link)

Pre-identified stakeholder(Targeted list)

Note: All AHSN figures in brackets

Understanding the results

5

(64%)

A sample of stakeholders were surveyed, rather than the entire population of stakeholders. The percentage results are subject to sampling tolerances – which vary depending on the size of the sample and the percentage concerned.

Confidence levels say how ‘sure’ we are about the results. That is, at 95% confidence level we have 95% probability that the results didn’t happen by chance but are similar to what is real for the population. If the survey was rerun 100 times the results in 95 of those surveys would fall very closely to the first run.

For example, for a question where 50% of the stakeholders in a sample of 100 respond with a particular answer, the chances are 95 in 100 that this result would not vary more than one percentage point, plus or minus, from the result that would have been obtained from a census of the entire population of stakeholders (using the sample procedure).

However, caution should be taken where the sample is smaller than 100. When comparing an individual AHSN’s results to the national average, a difference must be of at least a certain size to be statistically significant. The table below illustrates the percentage difference needed based on example size sizes and percentage, in order to be at the 95% confidence level.

Also please note that sometimes the adding together of two percentages will not equal the net calculation because of rounding.

Size of sample Approximate sampling tolerances applicable to percentages at or near these levels (at the 95% confidence level)

90% 70% 50%

100 6% points 9% points 10% points

70 7% points 11% points 12% points

50 8% points 13% points 14% points

Summary

6

Summary (1)

7

2015• Three quarters would recommend working with Wessex AHSN (slide 42). This is

similar (-3 percentage points (pp)) to 2015. Only 9% say they would not recommend working with the AHSN while a further 17% say they are unsure.

• In 2015, two-thirds (66%) agreed that the AHSN helped them achieve their objectives over the previous year (slide 40). In 2016, 56% say the same representing a fall of 10 percentage points. This is slightly behind the average for all AHSNs in 2016 (62%).

• 36% of stakeholders state that they have a ‘good’ understanding of Wessex AHSN’s role (slide 10). A further 43% say that they have a fair understanding while 21% indicate that they either have little or no understanding. The number who say that they have a good understanding is 6pp lower than that recorded in 2015.

• 18% state that they have a good understanding of Wessex AHSN’s plans and priorities with another 43% having a fair understanding (slide 14). When compared to 2015, the number of those with a good understanding has declined by 17pp while the number with a fair understanding has remained roughly the same.

Summary (2)

8

2015• The number of stakeholders who say that they have a good working relationship with

the AHSN (72%) has declined slightly compared to 2015 (82%).

• 59% agree that Wessex AHSN has a clear and visible leadership while a further 15% said that they neither agree nor disagree. The same portion again state that they disagree with this sentiment (slide 19). The number of people who agree has fallen by 15pp in the current period.

• Two thirds agree that the AHSN’s priorities are aligned to local priorities (slide 23). Although this has declined by 8pp since 2015, this still places Wessex AHSN in the middle tier out of all AHSNs.

• 65% think Wessex AHSN’s work is valuable in terms of ‘quality improvement’ over the past 12 months. The represents an increase of 12 percentage points compared to 2015. Furthermore, over half now value the AHSN’s work in ‘patient safety’ (54%) compared to 41% this time last year (slide 29).

• Two thirds consider the ‘quality of support’ provided by Wessex AHSN as ‘good’ (slide 35). This is a slight decline on 2015 data (-2 pp) but still places it in the middle tier out of all AHSNs.

Understanding the role of the AHSN

9

10

Q. To what extent do you feel you understand the role of the AHSN?

1%7%

20%

51%

43%

42%36%

2015 (n=69) 2016 (n=116)

A goodunderstanding

A fairunderstanding

A littleunderstanding

None at all

46%

37%

14%4%

2016 Average

11

Q. And thinking about the past 12 months, to what extent has the role of the AHSN become more or less clear?

Net: more clear = % much more clear + % more clearNet: less clear = % much less clear + % less clear

61%

30%

9%

2016 Average

56%

38%

6%

2016 (n=116)

Net: More clear No change Net: Less clear

2015 (n=69)

70%

25%

6%

Q. Which AHSN initiatives or programmes are you aware of?

12

iSPACE Dementia Friendly Practice

Medicines Optimisation

MISSION ABC

Patient safety collaboratives

Understanding of AHSN plans and priorities

13

14

Q. To what extent, if at all, do you understand the AHSN's plans and priorities?

1%6%

22%

33%

42%

43%

35%

18%

2015 (n=69) 2016 (n=115)

A good understanding

A fair understanding

A little understanding

None at all

26%

42%

25%

7%

2016 Average

Stakeholder relationship with the AHSN

15

16

Q. Overall, how would you rate your working relationship with your AHSN?

41%

32%

15%

5%3%

2016 Average

1% 3%1%4%

13%

16%

39%

41%

43%

31%

2015 (n=69) 2016 (n=115)

Very good

Quite good

Neither good norpoor

Quite poor

Very poor

17

Q. Thinking back over the past 12 months, would you say your working relationship with the AHSN has got better, worse, or is about the same?

1% 2%4% 3%

38% 39%

29%23%

26%32%

2015 (n=68) 2016 (n=115)

A lot better

A little better

About the same

A little worse

A lot worse

28%

25%

41%

4%2%

2016 Average

Stakeholder perceptions

18

19

Q. To what extent do you agree or disagree with the following?

The AHSN has clear and visible leadership

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

68%

15%

11%7%

2016 Average

59%

15%

15%

10%

2016 (n=110)

Net agree Neither disagree nor agree

Net disagree Don’t know

2015 (n=68)

74%

13%

10%3%

20

Q. To what extent do you agree or disagree with the following?

I have confidence in the AHSN to deliver its plans and priorities

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

64%19%

10%7%

2016 Average

63%15%

15%

7%

2016 (n=110)

Net agree Neither disagree nor agree

Net disagree Don’t know

2015 (n=68)

66%

21%

12%1%

21

Q. To what extent do you agree or disagree with the following?

AHSN staff are knowledgeable

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

78%

11%

5%6%

2016 Average

74%

16%

3%7%

2016 (n=110)

Net agree Neither disagree nor agree

Net disagree Don’t know

2015 (n=68)

75%

18%

7%

22

Q. To what extent do you agree or disagree with the following?

AHSN staff are helpful

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

% agree that AHSN staff are helpful

Wessex: 77%

13

13

13

Upper

Lower

Middle

82%

9%4%5%

2016 Average

77%

13%

4%6%

2016 (n=110)

Net agree Neither disagree nor agree

Net disagree Don’t know

2015 (n=68)

85%

10%4%

23

Q. To what extent do you agree or disagree with the following?

AHSN priorities are aligned to local priorities

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

63%18%

8%

11%

2016 Average

66%

15%

11%

8%

2016 (n=110)

Net agree Neither disagree nor agree

Net disagree Don’t know

2015 (n=68)

74%

16%

9% 1%

24

Q. To what extent do you agree or disagree that in the last 12 months?

26%

27%

32%

30%

24%

25%

44%

33%

38%

38%

32%

33%

14%

18%

21%

13%

20%

13%

15%

11%

5%

7%

17%

15%

2%

6%

3%

6%

8%

7%

5%

2%

7%

7%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

Strongly agree Tend to agree Neither agree nor disagree

Tend to disagree Strongly disagree Don’t know

You have felt involved in the AHSN

The AHSN has engaged with you effectively

when developing its plans and priorities

The AHSN has listened to your views

Net agree = % strongly agree + % tend to agree

% of those who agree that…..

All: 63%

Wessex: 68%

All: 54%

Wessex: 58%

All: 61%

Wessex: 60%

Attitudes towards AHSN staff

25

26

Common words used to describe Wessex AHSN are excellent, knowledgeable and helpful.

“All my interactions with the AHSN have been excellent. Staff are enthusiastic but also realistic and deliver on time what they promise”Health or social care provider

“We have had excellent support from AHSN staff members”Private company

“Since becoming my organisations innovation link for WAHSN and being very well supported with several projects”CCG

Q. If you have any comments about the AHSN’s staff, leadership and priorities, please type in below

“Welcoming and open culture - keen to build bridges and make

connections between multiple stakeholders”

“Katherine Barbour is innovative and motivated and supports us to make

change”

“Julia Sinclair is very knowledgeable, dedicated and helpful, a pleasure to

work with”

CCG Higher Education Local Government

Theme(s) identified within the answers provided by specific stakeholder groups include:

Q. If you have any comments about the AHSN’s staff, leadership and priorities, please type in below [continued from previous page]

Theme #1: Knowledgeable and helpful Staff

“Have always found them extremely helpful and supportive.”

Health or social care provider

“I have personally found the team in Wessex to be helpful and

supportive in the work I am doing within the Trust as exec lead on QI.”

“I've worked with 4 AHSNs closely over the last 12 months, all have

been knowledgeable, without prejudice and keen to roll out

projects at pace. Wessex AHSN has been one of these and I think the

last 12 months has seen a blossoming of relationships and

scale..”

Value associated with the level of support provided

28

Q. The AHSN aims to work with organisations on the following themes. For each theme, how valuable or not has been the support from the AHSN in the last 12 months?

Commissioning support

% of those who think that that the AHSN has

provided valuable support on….

29

27%

35%

30%

33%

53%

65%

41%

54%

20%

13%

24%

19%

14%

12%

14%

11%

24%

24%

20%

18%

12%

13%

18%

17%

29%

28%

26%

30%

21%

9%

27%

18%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

Net valuable Net not valuable Not received support Not applicable

Commercial development

Patient safety

Quality improvement

Net valuable = % very valuable + % quite valuable

All: 49%

Wessex: 54%

All: 65%

Wessex: 65%

All: 43%

Wessex: 33%

All: 35%

Wessex: 35%

Wessex 2016: 83%All 2016: 85%

Wessex 2015: 75% All 2015: 82%

% of those who think that that the AHSN has provided valuable

support excluding those answering ‘not received’ and ‘not

applicable’

Wessex 2016: 84%All 2016: 88%

Wessex 2015: 80% All 2015: 78%

Wessex 2016: 64%All 2016: 77%

Wessex 2015: 56% All 2015: 68%

Wessex 2016: 73%All 2016: 76%

Wessex 2015: 58% All 2015: 63%

Q. The AHSN aims to work with organisations on the following themes. For each theme, how valuable or not has been the support from the AHSN in the last 12 months? [continued from previous page]

% of those who think that that AHSN has provided

valuable support on..

30

44%

47%

67%

67%

65%

62%

14%

18%

17%

13%

12%

13%

14%

21%

9%

13%

12%

17%

29%

14%

8%

7%

11%

8%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

2015 (n=66)

2016 (n=106)

Net valuable Net not valuable Not received support Not applicable

Providing leadership to the local health economy

Facilitating collaboration

Identification, adoption and spread of innovation

Net valuable = % very valuable + % quite valuable

All: 70%

Wessex: 67%

All: 68%

Wessex: 62%

All: 51%

Wessex: 47%

% of those who think that that the AHSN has provided valuable

support excluding those answering ‘not received’ and ‘not

applicable’

Wessex 2016: 83%All 2016: 86%

Wessex 2015: 84% All 2015: 79%

Wessex 2016: 84%All 2016: 87%

Wessex 2015: 80% All 2015: 84%

Wessex 2016: 72%All 2016: 80%

Wessex 2015: 76% All 2015: 74%

Preferred methods of communication between AHSN and stakeholders

31

32

Q. Which, if any, of the following are or would be your preferred ways for the AHSN to communicate with you?

75%

70%

47%

47%

20%

19%

10%

82%

74%

57%

66%

25%

11%

18%

Email newsletter

Workshops, consultations or events

One to one meetings

Presentations to peer networks

Telephone

Social media

Printed newsletters

2016 (n=105) 2015 (n=65)

Impressions of AHSN performance & effectiveness

33

34

Q. Overall, how would you rate the AHSN’s…

31%

29%

34%

28%

38%

23%

40%

37%

40%

38%

37%

41%

14%

15%

12%

13%

20%

14%

3%

4%

8%

7%

4%

3%

3%

3%

5%

5%

7%

9%

13%

3%

9%

11%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

2015 (n=65)

2016 (n=104)

2015 (n=65)

2016 (n=104)

2015 (n=65)

2016 (n=104)

Very good Quite good Neither good nor poor Quite poor Very poor Don’t know

Accessibility

Responsiveness

Net good = % very good + % quite good

Quality of advice

Position indicator:% of those who rate the AHSN as

very / quite good for…

All: 70%

Wessex: 65%

All: 70%

Wessex: 66%

All: 70%

Wessex: 64%

35

Q. Overall, how would you rate the AHSN’s…[continued from previous page]

25%

27%

31%

35%

31%

28%

38%

34%

42%

34%

37%

38%

20%

18%

12%

11%

20%

12%

11%

7%

5%

4%

5%

8%

2%

4%

3%

2%

2%

5%

5%

11%

8%

15%

6%

11%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

2015 (n=65)

2016 (n=104)

2015 (n=65)

2016 (n=104)

2015 (n=65)

2016 (n=104)

Very good Quite good Neither good nor poor Quite poor Very poor Don’t know

Quality of support

Knowledge of the local

landscape

Net good = % very good + % quite good

Promoting change in the

local health economy

Position indicator:% of those who rate the

AHSN as good for…

All: 64%

Wessex: 61%

All: 74%

Wessex: 68%

All: 69%

Wessex: 65%

36

Q. How effective or ineffective is the AHSN in doing each of the

following? Focusing on the needs of patients and local populations

Net effective = % very effective + % quite effectiveNet ineffective = % quite ineffective + % very ineffective

64%11%

7%

17%

2016 Average

65%

12%

10%

13%

2016 (n=104)

Net effective Neither effective nor ineffective

Net ineffective Not sure

2015 (n=65)

71%

11%

5%

14%

37

Q. How effective or ineffective is the AHSN in doing each of the

following? Building a culture of partnership and collaboration

Net effective = % very effective + % quite effectiveNet ineffective = % quite ineffective + % very ineffective

71%

10%

9%

10%

2016 Average

70%

10%

11%

10%

2016 (n=104)

Net effective Neither effective nor ineffective

Net ineffective Not sure

2015 (n=65)

75%

15%

5%5%

38

Q. How effective or ineffective is the AHSN in doing each of the

following? Speeding up adoption of innovation into practice

Net effective = % very effective + % quite effectiveNet ineffective = % quite ineffective + % very ineffective

59%14%

10%

17%

2016 Average

55%

17%

14%

13%

2016 (n=104)

Net effective Neither effective nor ineffective

Net ineffective Not sure

2015 (n=65)

54%

18%

15%

12%

39

Q. How effective or ineffective is the AHSN in doing each of the

following? Creating wealth

Net effective = % very effective + % quite effectiveNet ineffective = % quite ineffective + % very ineffective

33%

19%10%

38%

2016 Average

24%

23%

10%

43%

2016 (n=104)

Net effective Neither effective nor ineffective

Net ineffective Not sure

2015 (n=65)

28%

23%11%

38%

40

Q. Thinking about the last 12 months to what extent would you agree or disagree that the AHSN has helped you / your organisation achieve your objectives?

Net agree = % strongly agree + % tend to agree

28%

34%

18%

8%

8%4%

2016 Average

3%5%7%

11%

13%

18%

21%

46%

37%

20% 19%

2015 (n=65) 2016 (n=103)

Strongly agree

Tend to agree

Neither agree nordisagree

Tend to disagree

Strongly disagree

Don’t know

41

Q. Has the AHSN achieved more or less than you expected in the last 12 months?

Net more than expected = % much more + % somewhat more

13%

26%

31%

9%

6%

16%

2016 Average

6%

15%8%

9%14%

12%

40%

33%

28%21%

5%11%

2015 (n=65) 2016 (n=102)

Much more

Somewhat more

About what wasexpected

Somewhat less

Much less

Not sure

42

Q. Would you recommend involvement in /working with the AHSN to others?

78%

6%

16%

2016 Average

75%

9%

17%

2016 (n=102)

Yes No Not sure

2015 (n=65)

78%

6%

15%

43

“Improving patient safety”Health or social care provider/Patients group/Other

“Identifying innovation and best practice”Health or social care provider

“Educational support”Health or social care provider

Theme(s) identified within the answers provided by specific stakeholder groups include:

Q. To help your organisation meets its objectives over the next 5 years, what are the most valuable areas of support AHSNs could offer?

44

Health and Social Care Provider

Theme(s) identified within the answers provided by specific stakeholder groups include:

Q. To help your organisation meets its objectives over the next 5 years, what are the most valuable areas of support AHSNs could offer?

Patient Groups Other

“improving patient safety”

Theme #1: Improving patient safety

“improving patient safety”“Improving patient safety and

ensuring equitable experience across Wessex”

Health and Social Care Provider

Higher Education Institute Private company

“identifying innovation and supporting spread across

organisations (standardisation)”

Theme #2: Innovation and best practice

“identifying innovations and best practice”

“Innovation and commercialisation”

“identifying best practice and innovations around nutrition”