Wessex AHSN stakeholder survey - full report

AHSN-stakeholder research 2015

Overview

2

Survey details

3

An online survey was administered to stakeholders of the Academic Health Science Networks. Stakeholders were initially pre-identified and provided with the opportunity to comment on any of the following:

• The AHSN which they are identified as having worked with/are associated with;

• Any other AHSN; and• The entire AHSN network at a national level.

In addition, individuals who were not pre-identified as stakeholders were also given the chance to comment on AHSNs of their choosing via open links disseminated by NHS England, other stakeholders, and through AHSNs’ own communication channels.

This report contains responses specifically given in relation to Wessex AHSN. This is based on 69 responses. In the report, the data is compared against the total figure for all AHSNs for each specific question.

The survey ran between July 9th and 7th August 2015.

Who took part?

26%

21%

12%

12%

6%

5%

4%

4%

2%

1%

0%

7%

17%

25%

13%

17%

6%

10%

4%

3%

1%

3%

Health or social care provider (n=12)

Private industry (n=17)

Clinical Commissioning Group (n=9)

Higher Education Institute (n=12)

Government / ALB (n=4)

Patients group (n=7)

Local government (n=3)

Voluntary and Community Sector (n=2)

Strategic Clinical Network (n=-)

Commissioning Support Unit (n=-)

Local Economic Partnership (n=1)

Other (n=2)

Stakeholder type

All AHSNs(n=1,098)

Wessex AHSN(n=69)

S1. Which of the following best describes your organisation? S2. Which, if any, of the following applies to your organisation....? S3. Is this response on behalf of your entire organisation or you as an individual?

4

2015

(64%)

Working relationship

67%54%

1%We see ourselves as amember /partner of the AHSN

We have worked with theAHSN in the last 12 months

Neither of the above

(7%)

(58%)

Note: All AHSN figures in brackets. Multiple choice question.

(53%)

38%62%

The organisation

As an individual

Answering on behalf of their organisation or as an individual

(64%)

Note: All AHSN figures in brackets

(36%)

Sample source

55%45%

Non pre-identified stakeholders(Open Link)

Pre-identified stakeholder(Targeted list)

Note: All AHSN figures in brackets

(38%)

(62%)

Understanding the results

5

(64%)

A sample of stakeholders were surveyed, rather than the entire population of stakeholders. The percentage results are subject to sampling tolerances – which vary depending on the size of the sample and the percentage concerned.

Confidence levels say how ‘sure’ we are about the results. That is, at 95% confidence level we have 95% probability that the results didn’t happen by chance but are similar to what is real for the population. If the survey was rerun 100 times the results in 95 of those surveys would fall very closely to the first run.

When comparing an individual AHSN’s results to the ‘all AHSNs’ average or other AHSNs, a difference must be of at least a certain size to be statistically significant. The table below illustrates the percentage difference needed based on example size sizes and percentages at the 95% confidence level.

Size of sample Approximate sampling tolerances applicable to percentages at or near these figures (at the 95% confidence level)

90% / 10% 70% / 30% 50%

100 +/- 6 +/- 9 +/-10

70 +/- 7 +/- 11 +/-12

50 +/-8 +/- 13 +/-14

6

Explanation of the positioning graphic

All AHSNs: 80%

This AHSN: 70%

Upper

Middle

Lower

% of those agreeing with the statement Description of the category used

The percentage across all AHSNs followed by percentage for the AHSN specific to this report.

Relative position is indicated by highlighting whether the AHSN occupies a place in the upper, middle or bottom third relative to other AHSNs. Position is shown by the dashed line in the relevant box.

A comparator display has been included to help support the AHSN in their development. Although caution should be taken in light of the sampling tolerance levels outlined previously, AHSNs have indicated it will be useful to understand their results in relation to other AHSNs.

Summary

7

Summary (1)

8

2015• Over three-quarters (78%) of Wessex AHSN stakeholders recommend working with it (slide 42) and a third (32%) feel that it has achieved more than expected in the last 12 months (slide 41).

• Two-thirds (66%) agree that it has helped them achieve their objectives in the last year (slide 40), a figure that is 10 percentage points (pp) higher than the all AHSN average.

• 42% have a ‘good’ understanding of its role (slide 11) which is consistent with the national AHSNs average and many (70%) feel that clarity about its role has increased in the last 12 months (slide 12).

• Over a third (35%) have a good understanding of Wessex AHSN’s plans and priorities and only 1% have no understanding at all (slide 14).

• The vast majority (83%) report having a ‘good working relationship’ with Wessex AHSN, which compares favourably with the all AHSNs average of 72%. Furthermore 56% believe that the relationship has improved in the last year and 5% believe it has worsened (slide 17).

Summary (2)

9

2015• Nearly three-quarters (74%) agree that it has ‘clear and visible leadership’ (slide 19) which is consistent with the all AHSNs figure and 66% ‘have confidence in the AHSN to deliver its plans and priorities’ (slide 20).

• Again nearly three-quarters (74%) feel that its ‘priorities are aligned to local priorities’ (slide 23) and all three measures of engagement and involvement are in the upper third in comparison to other AHSNs, for example 70% feel ‘involved in the AHSN’ (slide 24).

• 67% value its work in ‘facilitating collaboration’ and 65% on the ‘identification, adoption and spread of innovation’ (slides 29 and 30).

• Its accessibility and responsiveness are rated in the upper third of AHSNs with, for example, 75% reporting that accessibility is quite or very good (slide 34).

• 71% consider Wessex AHSN effective at ‘focusing on the needs of patients and local populations’, a proportion that is 10 percentage points higher than the all AHSN average (slide 36).

Understanding the role of the AHSN

10

9

9

9

11

Q. To what extent do you feel you understand the role of the AHSN?

2%

14%

7%

40%51%

44% 42%

All AHSNs (n=1,100) Wessex AHSN (n=69)

A goodunderstanding

A fairunderstanding

A littleunderstanding

None at all

Overall, 9

8%

said th

at they h

ave at least a little un

derstan

din

g o

f their A

HSN

’s role

10

0%

said th

at they h

ave at least a little un

derstan

din

g of th

e ro

le o

f Wessex A

HSN

% of those with a good understanding of the

AHSN’s role

All: 44%

Wessex AHSN : 42%

Upper

Middle

Lower

Please note that net percentages may not be an exact match with the adding of component percentages due to rounding.

12

Q. And thinking about the past 12 months, to what extent has the role of the AHSN become more or less clear?

Net: more clear = % much more clear + % more clearNet: less clear = % much less clear + % less clear

70%

25%

6%

Wessex AHSN (n=69)

Net: More clear No change Net: Less clear

66%

25%

9%

All AHSNs (N=1,093)

% for whom role has become more clear

All: 66%

6

6

6

Wessex AHSN : 70%

Upper

Middle

Lower

Understanding of AHSN plans and priorities

13

2

2

2

14

Q. To what extent, if at all, do you understand the AHSN's plans and priorities?

6%1%

24%

22%

43%

42%

27%35%


A good understanding

A fair understanding

A little understanding

None at all9

9%

said th

ey have at least a little u

nd

erstand

ing o

f Wessex A

HSN

plan

s and

prio

rities

Overall, 9

4%

said th

ey have at least a little u

nd

erstand

ing o

f their A

HSN

’s p

lans an

d p

riorities

% of those with a good understanding of the

AHSN’s plans and priorities

All: 27%

Wessex AHSN : 35%

Upper

Middle

Lower


Stakeholder relationship with the AHSN

15

3

3

3

16

Q. Overall, how would you rate your working relationship with your AHSN?

3% 1%

4%1%

19%

13%

35%

39%

36%43%


Very good

Quite good

Neither good norpoor

Quite poor

Very poor

Overall, 7

2%

said th

ey have eith

er a qu

ite goo

d o

r very go

od

wo

rking relatio

nsh

ip w

ith th

eir AH

SN

83

% said

that th

ey have eith

er a qu

ite goo

d o

r very go

od

wo

rking relatio

nsh

ip w

ith W

essex AH

SN

% with a quite or very good working

relationship with the AHSN

All: 72%

Wessex AHSN : 83%

Upper

Middle

Lower


17

Q. Thinking back over the past 12 months, would you say your working relationship with the AHSN has got better, worse, or is about the same?

2% 1%5% 4%

36% 38%

28% 29%

29% 26%


A lot better

A little better

About the same

A little worse

A lot worse

Overall, 5

6%

said th

at their w

orkin

g relation

ship

with

th

eir AH

SN h

as got b

etter over th

e last 12

mo

nth

s

56

%said

that th

eir wo

rking relatio

nsh

ip w

ith W

essex A

HSN

has go

t better o

ver the last 1

2 m

on

ths

% relationship has got a lot or little better in the

last 12 months

All: 56%

8

8

8

Wessex AHSN : 56%

Upper

Middle

Lower


Stakeholder perceptions

18

19

Q. To what extent do you agree or disagree with the following?

The AHSN has clear and visible leadership

69%

15%

11%

5%

74%

10%

13%

3%

Wessex AHSN (n=68)

Net agree Neither disagree nor agree

Net disagree Don’t know

All AHSNs (N=1,048)

Net agree = % strongly agree + % tend to agreeNet disagree = % strongly disagree + % tend to disagree

% agree the AHSN has clear and visible

leadership

All: 69%

6

6

6

Wessex AHSN : 74%

Upper

Middle

Lower

20


I have confidence in the AHSN to deliver its plans and priorities

60%21%

13%

6%

66%

12%

21%

1%

Wessex AHSN (n=68)



All AHSNs (N=1,048)


% agree have confidence to deliver plans and

priorities

All: 60%

5

5

5

Wessex AHSN : 66%

Upper

Middle

Lower

21


AHSN staff are knowledgeable

75%

7%

18%

0

Wessex AHSN (n=68)



73%

15%

5%6%

All AHSNs (N=1,048)


% agree AHSN staff are knowledgeable

All: 73%

7

7

7

Wessex AHSN : 75%

Upper

Middle

Lower

22


AHSN staff are helpful

85%

4%

10%0

Wessex AHSN (n=68)



80%

11%

4%5%

All AHSNs (N=1,048)


% agree that AHSN staff are helpful

All: 80%

5

5

5

Wessex AHSN : 85%

Upper

Middle

Lower

23


AHSN priorities are aligned to local priorities

74%

9%

16%

1%

Wessex AHSN (n=68)



61%20%

11%

8%

All AHSNs (N=1,048)


% agree that AHSN priorities are aligned to

local priorities

All: 61%

2

2

2

Wessex AHSN : 74%

Upper

Middle

Lower

5

5

5

5

5

5

5

5

5

24

Q. To what extent do you agree or disagree that in the last 12 months?

22%

24%

29%

32%

26%

26%

31%

32%

33%

38%

37%

44%

20%

20%

20%

21%

17%

14%

14%

17%

7%

5%

11%

15%

9%

8%

5%

3%

7%

2%

4%

6%

2%

2%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All AHSNs (n=1003)

Wessex AHSN (n=66)

All AHSNs (n=1003)

Wessex AHSN (n=66)

All AHSNs (n=1003)

Wessex AHSN (n=66)

Strongly agree Tend to agree Neither agree nor disagree

Tend to disagree Strongly disagree Don’t know

You have felt involved in the AHSN

The AHSN has engaged with you effectively when developing its plans and priorities

The AHSN has listened to your views

Net agree = % strongly agree + % tend to agree

% of those who agree that…..

All: 62% Upper

Middle

Lower

All: 53%

Wessex AHSN: 56%

Upper

Middle

Lower

All: 62%

Wessex AHSN: 70%

Upper

Middle

Lower

Wessex AHSN: 70%

Please note that the Net % on the right hand side may not be an exact match with the adding of two percentages due to rounding.

Attitudes towards AHSN staff

25

26

Theme(s) identified within the answers provided by specific stakeholder groups include:

Q. If you have any comments about the AHSN’s staff, leadership and priorities, please type in below

“In some workstreams it seems the AHSN priorities are less aligned to the work of local Public Health teams/CCGs. As an example, in general the main ones I am involved with have been very collaborative (medicines optimisation) but an intervention one for alcohol has been quite demanding although this is a tiny proportion of my work.”

Clinical Commissioning Group

Theme: Priorities

“The AHSN priorities are very much led by the AHSN, rather than seeking the CCG views and there is a lot of re-inventing the wheel that earlier SHAs and PCTs have already done.”

“A very useful resource for innovation and wealth creation.”

Health or social care provider

Theme: Helpful

“Staff at the AHSN are always very helpful and communicate clearly.”

“There is an opportunity in the next few years to select a smaller number of major projects, informed by patient need and leading expertise in the region, and deliver these well.”

Higher Education Institute

Theme: Focus

“Given that two figureheads of the WAHSN are leaving, the direction of the leadership is unclear.”

27


Q. If you have any comments about the AHSN’s staff, leadership and priorities, please type in below [continued from previous page]

“I still feel the 'us and them' divide is too wide at Board level (separate to AHSN staff).”

Private industry

Theme: Engagement

“The staff that I have met have been helpful, but I think the organisation it is new and still developing their relationships with NHS organisations.”

“Wessex AHSN need to communicate more with its members, especially in industry… I went to the initial meetings with a feeling of enthusiasm but this waned over time as the communication became more sparse.”

Value associated with the level of support provided

28

6

6

6

12

12

12

5

5

5

14

14

14

Q. The AHSN aims to work with organisations on the following themes. For each theme, how valuable or not has been the support from the AHSN in the last 12 months?

Commissioning support

Position indicator:% of those who think that that the AHSN has

provided valuable support on….

29

25%

27%

36%

30%

51%

53%

48%

41%

15%

20%

16%

24%

13%

14%

10%

14%

25%

24%

21%

20%

17%

12%

19%

18%

36%

29%

27%

26%

20%

21%

23%

27%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All AHSNs (n=1011)

Wessex AHSN (n=66)

All AHSNs (n=1011)

Wessex AHSN (n=66)

All AHSNs (n=1011)

Wessex AHSN (n=66)

All AHSNs (n=1011)

Wessex AHSN (n=66)

Net valuable Net not valuable Not received support Not applicable

Commercial development

Patient safety

Quality improvement

Net valuable = % very valuable + % quite valuable

All: 51%

Wessex AHSN: 53%

Upper

Middle

Lower

All: 48%

Wessex AHSN: 41%

Upper

Middle

Lower

All: 36%

Wessex AHSN: 30%

Upper

Middle

Lower

All: 25%

Wessex AHSN: 27%

Upper

Middle

Lower

11

11

11

8

8

8

13

13

13

Q. The AHSN aims to work with organisations on the following themes. For each theme, how valuable or not has been the support from the AHSN in the last 12 months? [continued from previous page]

Position indicator:% of those who think that that AHSN has

provided valuable support on..

30

46%

44%

67%

67%

62%

65%

16%

14%

13%

17%

16%

12%

19%

14%

14%

9%

14%

12%

20%

29%

6%

8%

9%

11%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All AHSNs (n=1011)

Wessex AHSN (n=66)

All AHSNs (n=1011)

Wessex AHSN (n=66)

All AHSNs (n=1011)

Wessex AHSN (n=66)

Net valuable Net not valuable Not received support Not applicable

Providing leadership to the local health

economy

Facilitating collaboration

Identification, adoption and

spread of innovation

Net valuable = % very valuable + % quite valuable

All: 67%

Wessex AHSN: 67%

Upper

Middle

Lower

All: 62%

WessexAHSN: 65%

Upper

Middle

Lower

All: 46%

Wessex AHSN: 44%

Upper

Middle

Lower

Preferred methods of communication between AHSN and stakeholders

31

32

Q. Which, if any, of the following are or would be your preferred ways for the AHSN to communicate with you?

11%

21%

23%

49%

50%

71%

77%

18%

11%

25%

57%

66%

74%

82%

Printed newsletters

Social media

Telephone

One to one meetings

Presentations to peer networks

Workshops, consultations or events

Email newsletter

Wessex AHSN (n=65) All AHSNs (n=998)

Impressions of AHSN performance & effectiveness

33

5

5

5

6

6

6

4

4

4

34

Q. Overall, how would you rate the AHSN’s…

30%

31%

29%

34%

30%

38%

36%

40%

38%

40%

37%

37%

14%

14%

15%

12%

15%

20%

3%

3%

5%

8%

7%

3%

3%

5%

3%

4%

5%

14%

9%

9%

3%

7%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All AHSNs (n=991)

Wessex AHSN (n=65)

All AHSNs (n=991)

Wessex AHSN (n=65)

All AHSNs (n=991)

Wessex AHSN (n=65)

Very good Quite good Neither good nor poor Quite poor Very poor Don’t know

Accessibility

Responsiveness

Net good = % very good + % quite good

Quality of advice

Position indicator:% of those who rate the AHSN as

very / quite good for…

All: 67%

Wessex AHSN: 74%

All: 67%

All: 65%

Wessex AHSN: 71%

Wessex AHSN: 75%

Upper

Middle

Lower

Upper

Middle

Lower

Upper

Middle

Lower


3

3

3

35

Q. Overall, how would you rate the AHSN’s…[continued from previous page]

24%

25%

35%

31%

28%

31%

32%

38%

34%

42%

37%

37%

20%

20%

12%

12%

16%

20%

6%

11%

5%

5%

5%

5%

5%

2%

2%

3%

4%

2%

14%

5%

11%

8%

10%

6%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All AHSNs (n=991)

Wessex AHSN (n=65)

All AHSNs (n=991)

Wessex AHSN (n=65)

All AHSNs (n=991)

Wessex AHSN (n=65)

Very good Quite good Neither good nor poor Quite poor Very poor Don’t know

Quality of support

Knowledge of the local

landscape

Net good = % very good + % quite good

Promoting change in the

local health economy

Position indicator:% of those who rate the

AHSN as good for…

All: 69%

Wessex AHSN: 72%

All: 65%

All: 56%

Wessex AHSN: 63%

Wessex AHSN: 68%

Upper

Middle

Lower

Upper

Middle

Lower

Upper

Middle

Lower


36

Q. How effective or ineffective is the AHSN in doing each of the

following? Focusing on the needs of patients and local populations

61%12%

9%

18%

71%

5%

11%

14%

Wessex AHSN (n=65)

Net effective Neither effective nor ineffective

Net ineffective Not sure

All AHSNs (N=986)

Net effective = % very effective + % quite effectiveNet ineffective = % quite ineffective + % very ineffective

% effective at focusing on the needs of patients and

local populations

All: 61%

3

3

3

Wessex AHSN : 71%

Upper

Middle

Lower

37


following? Building a culture of partnership and collaboration

75%

5%

15%

5%

Wessex AHSN (n=65)



67%

12%

13%

8%

All AHSNs (N=986)


% effective at building a culture of partnership and

collaboration

All: 67%

4

4

4

Wessex AHSN : 75%

Upper

Middle

Lower

38


following? Speeding up adoption of innovation into practice

54%

15%

18%

12%

Wessex AHSN (n=65)



51%

17%

14%

19%

All AHSNs (N=986)


% effective at speeding up adoption of innovation

into practice

All: 51%

6

6

6

Wessex AHSN : 54%

Upper

Middle

Lower

39


following? Creating wealth

28%

11%

23%

38%

Wessex AHSN (n=65)



28%

21%11%

39%

All AHSNs (N=986)


% effective at creating wealth

All: 28%

8

8

8

Wessex AHSN : 28%

Upper

Middle

Lower

40

Q. Thinking about the last 12 months to what extent would you agree or disagree that the AHSN has helped you / your organisation achieve your objectives?

3%

9%

5%

10%

11%

21%

18%

35%46%

21% 20%

All AHSNs (n=982) Wessex AHSN (n=65)

Strongly agree

Tend to agree

Neither agree nordisagree

Tend to disagree

Strongly disagree

Don’t know

Overall, 5

6%

said th

at they agreed

that

their A

HSN

help

ed th

em to

achieve th

eir o

bjectives in

the last 1

2 m

on

ths

66

%said

that th

ey agreed th

at Wessex A

HSN

help

ed th

em to

ach

ieve their o

bjectives in

the last 1

2 m

on

ths

Net agree = % strongly agree + % tend to agree

% agreeing that AHSN has helped you / your

organisation achieve its objectives

All: 56%

3

3

3

Wessex AHSN : 66%

Upper

Middle

Lower


41

Q. Has the AHSN achieved more or less than you expected in the last 12 months?

11%6%

7%

8%

13%14%

37% 40%

24%28%

9%5%

All AHSNs (n=981) Wessex AHSN (n=65)

Much more

Somewhat more

About what wasexpected

Somewhat less

Much less

Not sure

Overall, 3

2%

said th

at they th

ink th

at th

eir AH

SN ach

ieved m

ore th

an

expected

over th

e last 12

mo

nth

s

32

%said

that th

ey thin

k that W

essex AH

SN ach

ieved

mo

re than

expected

over th

e last 12

mo

nth

s

Net more than expected = % much more + % somewhat more

% stating AHSNs have achieved more than expected

in the last 12 months

All: 32%

7

7

7

Wessex AHSN : 32%

Upper

Middle

Lower


42

Q. Would you recommend involvement in /working with the AHSN to others?

78%

6%

15%

Wessex AHSN (n=65)

Yes No Not sure

75%

7%

18%

All AHSNs (N=976)

% that would recommend involvement in / working

with the AHSN

All: 75%

7

7

7

Wessex AHSN : 78%

Upper

Middle

Lower

43


Q. What would you like AHSNs to keep doing?

“Encouraging joint working, sharing ideas, and communication between organisations. The AHSN should stop us all becoming 'islands'.”

Health or social care provider

Theme: Engage

“Bringing together individual organisations to work jointly on improvement projects. Providing grants to support innovation.”

“Act as a vehicle to bring academia and industry together with the NHS to enhance patient care.”


Theme: Engage

“Keep open lines of communication and dissemination of work.”

“To keep strong clinical leadership and local engagement.”

Other

Theme: Engage

“Collaborating and being visible to demonstrate its effectiveness and willing to listen to ensure delivery across the whole health economy.”

“Consulting & engaging.”

44


Q. What would you like AHSNs to keep doing? [continued from previous page]

“Close involvement with the SME sector, especially high-risk, pioneering, micro-SMEs.”

Private industry

Theme: Engage

“Fostering connections between local SMEs, academia and NHS organisations.”

“Considering us for future events and keep on being in touch.”

45


Q. What improvements could the AHSNs make over the next 12 months?

No consistent themes. Above are some examples of quotes from different groups.


“Develop a coherent strategy for NGO engagement and project support. Identify projects with capacity for national development and research applications.”

“Focus on a smaller number of major projects, building on world-leading expertise in the region.”

Theme: Focus

“Scale up and spread, engage in more collaborative activities e.g. student projects, placements.”

Other

“To consider Knowledge Transfer Partnerships and secondments from industry.”

Theme: Information sharing

“More investment and promotion of technology: development of telemedicine, information sharing etc.”

Private industry

“More involvement and communication on how they can help.”

Theme: Engage

“Make a LinkedIn Group, find out what companies are offering and facilitate meetings with possible collaborators to find out if their service is needed in the Healthcare Sector.”

Wessex AHSN stakeholder survey - full report

Health & Medicine

Transcript of Wessex AHSN stakeholder survey - full report