SIOR: recognition of the social impact of research through

open access resources

IMPACT-EVEvaluating the impact and

outcomes of European SSH research (2014-2017)

Research Team

Director: CREA – University of Barcelona, Spain,

Members:

MTAK KIK-TTO, Hungary (András Schubert, Editor of Scientometrics)

Trinity College Dublin, Ireland. (Paul Holm, the President of the European Consortium for Humanities Institutes and Centres (ECHIC)

DANS-KNAW, The Netherlands, Center for Organisational Research (CORe), Università della Svizzera Italiana, Switzerland, Institute for Economic Research on Firms and Growth (CERIS–CNR), Italy, Trinity Long Room Hub, Population and Social Policy Consultants (PSPC), Belgium, Health Economics Research Group (HERG), Brunel University, United Kingdom.

IMPACT-EV

Some of the research activities the European Commission are requesting us to conduct:

1. The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.

2. To explain the evaluators how to use these criteria

3. The ex-post evaluation of all SSH projects of the PF7 (2007-2013) and last call FP6 (2006).

4. The creation of an open repository on research social impact.

Some of the research activities the European Commission are requesting us to conduct:

1. The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.

2. To explain the evaluators how to use these criteria

3. The ex-post evaluation of all SSH projects of the PF7 (2007-2013) and last call FP6 (2006).

4.The creation of an open repository on research social impact:SIOR

Social Impact- Researchers are not used to think about their

work as generating social impact… - Not a tradition of gathering evidences of our

research social impact- Social Impact occurs beyond the research

projects lifespan- Problems of attribution- How to measure social impact

…

“It is a bad idea to keep repacking one's

bags for a trip that one never takes”

Talcott Parsons

Olin Wright, E. Class Counts: comparative studies in class analysis(Cambridge University Press, 1997), p.15.

Here during these two days at the #ORCIDCASRAI15, we are all starting the trip…

What is SIOR?

SIOR is a non-profit initiative launched by the IMPACT-EV

consortium (European Commission).

http://www.ub.edu/sior/index.php

SIOR is an open source repository to store evidence of social impact.

Any researcher or research group around the world can freely upload evidence of their research social impact

through registering to SIOR with an ORCID id.

Any institution or citizen around the world can freely see the evidences of the studies, researchers and research groups with social impact factor through registering to SIOR with an

ORCID id.http://www.ub.edu/sior/index.php

SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php sior@ub.edu

Why ?

To respond to the open demand of measurable parameters of social improvements generated by scientific projects, promoting a necessary alternative to the stagnation of scientific results and enabling real social impact.

What is contributing to?

Enhance SSH research with social impactAllow researchers and research institutions make clear contributions to science, to the societies and to their own work (linked to ORCID)Increase the visibility of this research worldwideWidening the concern about social impact across the esearch community

How does SIOR work?

SOCIAL IMPACT CRITERIA

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

SOCIAL IMPACT CRITERIA

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

SIOR takes those targets already defined by citizens through their democratically

elected representatives as a reference to define what is considered social impact.

Font: http://ec.europa.eu/archives/commission_2010-2014/president/news/documents/pdf/20100303_1_en.pdf

SOCIAL IMPACT CRITERIA

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

SOCIAL IMPACT CRITERIA

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

Score Criteria

10 30% of improvement

9 20-29% of improvement

8 10-19% of improvement

7 Some improvement

SOCIAL IMPACT CRITERIA

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

SOCIAL IMPACT CRITERIA

• In this repository only the researchers and studies that have had social impact appear.

• Even if their value is 1 it means a good result, because many others do not even achieve enough social impact to be in this repository.

Example: This situation is similar to journal rankings ; for instance , to be in the 4th quartile in JCR means to have a scientific impact that most journals do not reach.

Examples

27

SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php sior@ub.edu

SOCIAL IMPACT PROJECTS 

INCLUSIVE CITIES PROJECTHarvard Kennedy School

Reducing urban poverty from the organizational capacities of the working poor

Restoring Fukushima

University of Tokyo

Strict control of

agricultural

products after

nuclear disaster.

Decontamination

with agricultural

procedures.

Social impact: Increase in school performance (performance rates)

Connection to UN Millennium Goals, EU2020 target or other similar official social targets

Europe 2020 Target on Education: Reducing the rates of early school leaving below 10%

Has achieved more than 30% of improvement

- La Paz Primary School (highly deprived area): Increase of a 68% in the % of students who pass the official exam on reading skills (from 17% to 85% in 5 years , 2001-2006).

- Primary school with Roma population: Increase of a 58,95% in the percentage of students who achieve read and write skills in pre-primary education (5 years old) in 2012-2013.

Transferability: at least implemented in 2 different contexts

- 172 Schools in Latin America (Argentina, Brazil, Chile, Colombia, México, Perú)

- 6 schools in UK (Cambridge, Norwich)

Social impact published on scientific journals with recognized impact (at least 1 article), governmental or non-governmental official bodies

- Scientific papers: Flecha, R., & Soler. M. (2013). Turning difficulties into possibilities: engaging Roma families and students in school through dialogic learning. Cambridge Journal of Education, 3(44), 451.465.

Sustainability of the impact throughout time

Increase in educational attainment continues in above mentioned schools

Total score: 10

Social impact: Creation of employment in locations of extreme poverty

Connection to UN Millennium Goals, EU2020 target or other similar official social targets

Europe 2020 Target on Employment: 75% of the 20-64 year-olds to be employed

Has achieved more than 30% of improvement

- One of the poorest neighborhoods in southern Europe: 39% of employment increase (586 new jobs , Miquel Fenollera Cooperative)

Transferability: at least implemented in 2 different contexts

- Catalan neighbourhood. Social initiative launched in 2013 consisting on a sewing women group.

- Primary school: school volunteers have been employed by the city council

Social impact published on scientific journals with recognized impact (at least 1 article), governmental or non-governmental official bodies

- Scientific articles . Burgués, A., Martin, S. & Santa Cruz, I. (2013). La relación entre cooperativas transformadoras y desigualdades sociales en los territorios . Scripta Nova, 427(XVII).

- Reports from City council services

Sustainability of the impact throughout time

Employment in the cooperative is sustained

Total score: 10

Before publishing the project, the SIOR team revises all the information uploaded (peer review), and if everything is correct, the project is published.

To End…

• SIOR is an ongoing process, directed by academics and counting with the support of the technical team.

• SIOR working with the funding and evaluation agencies to have access to this information (ex ante, ex post)

• SIOR is already transforming the scientific community:– Researchers who do not know whether their work has

achieved social impact, start to consider it and seek for evidences (even in finished projects)

– Researchers whose work does not have achieved social impact, start to consider so.

We cannot change the past, but we can change the present and the future, and SIOR, among other

initiatives, is already contributing to do so.

Social impact are the evidence based improvements experienced by individuals and societies (according to societal objectives), resulting from the transference of excellent research.

Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations.

Social impact are the evidence based improvements experienced by individuals and societies, according to societal objectives, resulting form the transference of excellent research.

Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations