F&I Matt Wallace - Business Intelligence II: Research Impact

17
1 CASRAI ReConnect Conference Ottawa, November 19-21, 2014 Research portfolios in support of societal challenges: concepts, data and analysis Matthew L. Wallace · INGENIO (CSIC-UPV) Ismael Rafols · INGENIO (CSIC-UPV) · SPRU (University of Sussex)

Transcript of F&I Matt Wallace - Business Intelligence II: Research Impact

Page 1: F&I Matt Wallace -  Business Intelligence II:  Research Impact

1

CASRAI ReConnect ConferenceOttawa, November 19-21, 2014

Research portfolios in support of societal challenges: concepts, data and analysis

Matthew L. Wallace · INGENIO (CSIC-UPV)Ismael Rafols · INGENIO (CSIC-UPV) · SPRU (University of Sussex)

Page 2: F&I Matt Wallace -  Business Intelligence II:  Research Impact

2

Can ‘research portfolios’ help allocate resources to tackle grand societal challenges?

1. What do (and what can) research portfolios mean?

Looking at current practices and moving beyond a ‘financial’ model

2. Case study: avian influenza as a ‘societal challenge’

Understanding a research landscape to inform portfolio design

OUTLINE

Page 3: F&I Matt Wallace -  Business Intelligence II:  Research Impact

3

DRIVERS FOR PORTFOLIO-LEVEL ANALYSIS

• Central problem: perceived mismatch between research and desired outcomes

• Responding to current policy demands in grand societal challenges• Tackling large-scale, multi-stakeholder issues

• Transparency, accountability, cost-effectiveness, etc.

• Seeking out alternative research avenues spawning new solutions.

BUT… What ‘baggage’ does the term already have for science policy?

Page 4: F&I Matt Wallace -  Business Intelligence II:  Research Impact

4

‘TYPICAL’ R&D PORTFOLIOS

Page 5: F&I Matt Wallace -  Business Intelligence II:  Research Impact

5

CURRENT PUBLIC SECTOR PRACTICES

Page 6: F&I Matt Wallace -  Business Intelligence II:  Research Impact

6

POLICY “PULL” AND SCIENCE “PUSH”…

Making explicit connections between research options and societal outcomes

Page 7: F&I Matt Wallace -  Business Intelligence II:  Research Impact

7

BROAD VIEWS OF OUTCOMES AND OPTIONS…

(Figure adapted from Stirling & Scoones, 2009)

Moving towards a broad set of outcomes and acknowledging high uncertainty

Page 8: F&I Matt Wallace -  Business Intelligence II:  Research Impact

8

SYNERGIES, COMPLEMENTARITIES…

Looking for potential positive interactions based on the existing research landscape

Page 9: F&I Matt Wallace -  Business Intelligence II:  Research Impact

9

AVIAN FLU AS A CASE STUDYFunding and publications

Avian influenza funding by main funding agencies ($M), from ÜberResearch data

Main avian flu and swine flu strain articles (PubMed)

Page 10: F&I Matt Wallace -  Business Intelligence II:  Research Impact

10

AVIAN FLU AS A CASE STUDYDebates on research, outcomes and values

Page 11: F&I Matt Wallace -  Business Intelligence II:  Research Impact

11

THE RESEARCH LANDSCAPE

Network of terms and clusters from abstracts of avian influenza publications (2004-2013), mapped according to co-occurrence

Page 12: F&I Matt Wallace -  Business Intelligence II:  Research Impact

12

Virology as a WoS subject categoryRESEARCH APPROACHES AND OBJECTS

Page 13: F&I Matt Wallace -  Business Intelligence II:  Research Impact

13

“Virology” as a Medical Subject Heading qualifierRESEARCH APPROACHES AND OBJECTS

Page 14: F&I Matt Wallace -  Business Intelligence II:  Research Impact

14

MAPPING EXISTING INFLUENZA PORTFOLIOS

Canadian Institutes for Health Research(Influenza A, 2010-12)

GlaxoSmithKline(Influenza A, 2010-12)

Welcome Trust(Influenza A, 2010-12)

Maps generated from overlays of funding data in Web of Knowledge onto the ‘landscape’ of Influenza A research overall

Page 15: F&I Matt Wallace -  Business Intelligence II:  Research Impact

15

• Public debates, different research pathways highlight the need for diversity

• We can tentatively identify some dominant lines of research: epidemiology, molecular biology, immunology…

• We can see where connections lie: e.g., very few connections between epidemiology and virology

• We can see how different portfolios reflect (or not) priorities of funders

AVIAN FLU IN THE CONTEXT OF PORTFOLIO DESIGN

Page 16: F&I Matt Wallace -  Business Intelligence II:  Research Impact

16

Our (modest) claim: Research portfolio approaches can be useful for better understanding current resource allocation for problem-driven research and for facilitating policy deliberations

• We need to clarify what we mean by “portfolio”• Portfolio lens has the potential to help tackle complex

societal problems: – Move beyond “excellence”, – Inform diversification– Recognize multiple outcomes, promote inclusive policy

process• Mapping from bibliometric (or funding) data can be

useful, – But cannot produce a “one-dimensional”, prescriptive

view– Data remains scarce!

CONCLUSION