Research impact assessment workshop cara 170507 v140724
46
MOBILIZING FOR IMPACT David Phipps, PhD. MBA, Executive Director, Research & Innovation Services @researchimpact
-
Upload
kmb-unit-york-university -
Category
Education
-
view
185 -
download
0
Transcript of Research impact assessment workshop cara 170507 v140724
MOBILIZING FOR IMPACT
David Phipps, PhD. MBA, Executive Director, Research & Innovation Services @researchimpact
Time Activity 130-215 Research Impact – background 215-245 Creating Research Impacts - tool 245-300 Break
300-330 Impact Planning case study (groups)
330-345 Impact Planning – report back (groups) 345-415 Impact Assessment – theory & tool 415-430 Q&A
WHAT IS
• ISED: economic impact from university research • Naylor Report: chapter 2 • CSPC 2017: Impact Agenda as a stream • Federal Budget: funding for homelessness, women’s
issues, Indigenous, biodiversity, coasts, disaster mitigation, LGBTQ
About an “Impact Agenda”
Using Evidence
Knowledge Mobilization helps make research useful to society by supporting engaged research from inception to impact.
Knowledge Mobilization
“community”
campus
campus
“community”
Impact HOW WHAT
Knowledge mobilization helps make research useful to society by supporting engaged scholarship from inception to impact
Activity Output Outcome
Impact
Dissemination Uptake Implementation Co-production
+ Toronto Hot Weather Response Plan
http://www.thestar.com/article/462613
Toronto Hot Weather Response Plan
Activity Output Outcome Impact (?)
Dissemination Uptake Implementation Co-production
Co-produced pathway to impact
Knowledge Mobilization
Communications
Partners have a key role to play not only in creating impact but in providing the evidence of impact. Researchers don’t always know when impact has occurred. Ask a researcher but don’t stop there.
How do you get to impact?
What type of indicators will you use to measure your KMb efforts? Rreach indicators (# distributed, # requested, # downloads/hits, media exposure) Usefulness indicators (read/browsed, satisfied with, usefulness of, gained knowledge, changed views) Doing more with what you know • use indicators (# intend to use, # adapting the information, # using to inform • policy/advocacy/enhance programs, training, education or research, # using to improve practice or
performance) Partnership/collaboration indicators (# products/services developed or disseminated with partners, # or type of capacity building efforts, social network growth, influences, collaborativeness) Practice change indicators (intent or commitment to change, observed change, reported change) Program or service indicators (outcome data, documentation, feedback, process measures) Policy indicators (documentation, feedback, process measures) Knowledge change (quantitative & qualitative measures) Attitude change (quantitative & qualitative measures) Systems change (quantitative & qualitative measures)
How do you assess impact?
Impact Assessment (it’s more than just here)
Knowledge Mobilization
Communications 1 2
3a
3b
Collecting the evidence of impact
documents, testimonials, surveys
throughout
interviews
end users / partners
demonstrate impact
on line, in person
Impact
What type of indicators will you use to measure your KMb efforts? Rreach indicators (# distributed, # requested, # downloads/hits, media exposure) Usefulness indicators (read/browsed, satisfied with, usefulness of, gained knowledge, changed views) Doing more with what you know • use indicators (# intend to use, # adapting the information, # using to inform • policy/advocacy/enhance programs, training, education or research, # using to improve practice or
performance) Partnership/collaboration indicators (# products/services developed or disseminated with partners, # or type of capacity building efforts, social network growth, influences, collaborativeness) Practice change indicators (intent or commitment to change, observed change, reported change) Program or service indicators (outcome data, documentation, feedback, process measures) Policy indicators (documentation, feedback, process measures) Knowledge change (quantitative & qualitative measures) Attitude change (quantitative & qualitative measures) Systems change (quantitative & qualitative measures)
• 6,975 impact case studies • 149 fields of research • 60 impact topics • 36 UoAs • 3,709 unique pathways to impact • £7,000/REF submission (estimate)
REF Item Research Impact Change Rationale Definition of research: REF 2014 linked impact to published research “First brought into the public domain during the publication period, 1 January 2008 to 31 December 2013”
RIC is linking impact to published research as well as research expertise which can include research and creative activities of undergrad and graduate students.
We are seeking to create and communicate impacts from the university’s entire research enterprise, not all of which is represented by a published article in a particular date range
Description of underlying research: REF 2014 only included outputs from researchers.
RIC specifically includes the contributions of non-academic research partners that also underpin the creation of impact.
Impact doesn’t happen through research alone. We recognize the critical role that non-academic partners bring to creating impact.
Knowledge mobilization: the efforts an institution makes to create/support impact were described in the institutional environment section of REF 2014 reporting.
RIC added a separate entry to the impact case study template describing the specific knowledge mobilization efforts made to support the impact case.
This more directly couples the institutions efforts to the research impact. Not all impact is supported by the institution but this allows the institution to speak to the efforts specific to each case, where applicable.
Guidance for collecting the evidence of impact: REF 2014 provided none.
RIC adapted the questions of contribution analysis to help guide interviews to collect the evidence of impact.
These 7 questions are the interview guide for semi structured interviews.
Collecting the evidence of impact
documents, testimonials, surveys
throughout
interviews
end users / partners
demonstrate impact
on line, in person
Impact
What type of indicators will you use to measure your KMb efforts? Rreach indicators (# distributed, # requested, # downloads/hits, media exposure) Usefulness indicators (read/browsed, satisfied with, usefulness of, gained knowledge, changed views) Doing more with what you know • use indicators (# intend to use, # adapting the information, # using to inform • policy/advocacy/enhance programs, training, education or research, # using to improve practice or
performance) Partnership/collaboration indicators (# products/services developed or disseminated with partners, # or type of capacity building efforts, social network growth, influences, collaborativeness) Practice change indicators (intent or commitment to change, observed change, reported change) Program or service indicators (outcome data, documentation, feedback, process measures) Policy indicators (documentation, feedback, process measures) Knowledge change (quantitative & qualitative measures) Attitude change (quantitative & qualitative measures) Systems change (quantitative & qualitative measures)
