REF Impact PilotLaura TylerMarketing & New Media ManagerUniversity of Glasgow

Glasgow’s involvement

• Clinical Medicine (17 case studies) + Earth Systems (4 case studies).

• Writing team formed

• Reporting to a Steering Group (SG) of senior academics chaired by VP R&E.

• Process was:

− Trawl for stories led by SG

− Interviewed researchers where possible

− SG inputted to the stories

− Staff survey (Clin Med) for impacts of indicators

− External reading team from user community was extremely helpful

The exercise

• Extremely positive, if challenging, experience.

• Created excellent examples of the benefits of our own research.

• Raised (really raised!) awareness.

• Created a strong academic/administrative team.

….there were of course some challenges

Practical issues with the pilot

Impact statement•Questions were open to interpretation

Case study template•Split sections caused confusion – not logical flow and caused repetition

Duplication

•Across all three elements – impact statement, case studies and research context document

Labour intensiveness

Labour-intensive for the staff involved (Academics, R&E, Faculty Contacts).

− Collection and collation of the material we required to submit to HEFCE

− the iterative nature of the drafting process.

• It will be important to manage colleagues’ expectations from the outset.

External support

• Challenging to engage external contacts when preparing case studies and gathering evidence:

- identifying the people

- changes of staff in users/lack of corporate memory

- this includes the engagement of academic staff who have now left GU.

Identifying/quantifying impact

• Capturing the extent of the impact and the precise time when that impact occurred.

• Meeting the pilot definition of impact – the academic understanding of impact was often not aligned with the HEFCE criteria.

• We need to support colleagues in identifying and describing the impact of their research once the final HEFCE criteria are known.

• Difficult to quantify the impact of research when technologies have been sold on to third parties.

Commercial sensitivities

• We were allowed to flag case studies as being commercially sensitive, however we cannot guarantee confidentiality.

• In a number of cases, research users would not provide us with information.

HEI control

• To a large extent, Universities are reliant on another party to create the Impact (companies/other organisations).

• We are limited in the control we have on the nature and extent of the impact achieved.

Research

New Knowledge

Networking/ Events

Consultancy

CPD

Collaborative Research

Contract Research

Licensing

Company Creation

Teaching

Knowledge

£

$

ALL SORTS OF OTHER FACTORS

Start-up

Spin-out

Society

Government

Policy-makers

Small

Companies

Big Companies

ALL SORTS OF OTHER FACTORS

Jobs

New Products

New services

Turnover

Policy Changes

Health Impacts

Cultural Impacts

Profit

R&D expenditure

% turnover from new products/ services

RESEARCH OUTPUTS KE CHANNELS USERS / BENEFICIARIES

KE

IMPACTS

Publications

Processes

Technology

Know-how

Innovation

Skills

Materials

Researchers

HEFCE guidance

• Guidance was not always entirely clear and sometimes open to interpretation, with definitions being iterated as we went (as expected in a pilot).

• Important for the final REF impact criteria to be as clear and unambiguous as possible, to minimise the scope for confusion and hopefully the pilot has moved us towards this.

Subjectivity

How will the panel weight different ‘types of impact’?

Quality of story writing will also be a major factor

Polarised views within our working group and our reading group

“A fantastic example of work”

“I’m not sure it’s eligible”

In summary

• We found the exercise extremely useful in gathering impact stories, which are hugely valuable in themselves.

• We found that the exercise helped to educate the broader community regarding impact.

• We are concerned that impact has more to do with our users than this exercise recognises – to some extent we are trying to measure the performance of others.

• The subjective nature of comparing stories makes us a little nervous.

• The results of the Pilot were not surprising

Thank you

laura.tyler@glasgow.ac.uk