RESEARCH ASSESSMENT, STRATEGIC PLANNING AND RESEARCH MONITORING IN ST.PETERSBURG STATE UNIVERSITY

Moskaleva OlgaAdvisor to the Director of SPbSU Research Library

WAYS TO USE CITATION INDEXES AND ANALYTIC INSTRUMENTS IN ST.PETERSBURG STATE UNIVERSITY

Development program of St.Petersburg State University Start – 2009 up to 2020 Priority Fields

Biomedicine & Human Health Computer science Ecology, Environmental & Geosciences Nanotechnology & Materials Science Social Science & Management

Creating different Reports Receiving publication data for grant

proposals Choosing organizations for research

collaboration

OBJECTIVES FOR STRATEGIC PLANNING

Presidential decree N599, 07/05/2012 "On Measures for the implementation of state policy in the field of education and science":5 Russian HEI are to be in top-100 of university

rankings till 2020Share of Russian publications in Web of Science

must be 2,44% till 2016 Thus, main attention is paid to quantity

and quality of university research publications

CHOOSING PRIORITY FIELDS

Priority Fields in Russian Federation Existing Competencies in SPbSU Analyzing Subject Area Ranking Comparing the publication dynamics of Russia and

SPbSU in Citation databases (Web of Science, Scopus, Russian Citation Index) and via Benchmarking in SciVal

Choosing the priority fields for Development Program

TARGET RESEARCH INDICATORS IN DEVELOPMENTAL PROGRAM (2020)

Number of publications in Web of Science & Scopus (2250 in 2020)

Number of publications in Science & Nature Publ. Group

Share of research publications in foreign languages

Share of publications in Web of Science & Scopus in international collaboration

Share of academic staff with publications in Web of Science & Scopus

TARGET RESEARCH INDICATORS IN DEVELOPMENTAL PROGRAM (2020)

Share of academic staff involved in Russian and international research grants

Number of patent proposals Share if income from research & IP

transfer Number of academic staff, who

participated in international research conferences

University position if international university rankings

SPBSU PUBLICATIONS IN DIFFERENT CITATION INDEXES (2010-2014)

RISC

Web of Science

Scopus

Natural Sciences

40%

Engi-neering

and Tech-nical…

5%

Medical Sciences5%

Agricultural Sciences

1%

Social Sci-

ences28%

Hu-man-ities21%

PUBLICATIONS OF SPBSU IN RUSSIAN INDEX OF SCIENTIFIC CITATION (HTTP://ELIBRARY.RU )

SS,A&H

ADMINISTRATIVE SOLUTIONS

Staff recruiting according to publication indicators (Quantity & Quality)

Effective contract with Academic staff (salary depends on research results, e.g. publications in Web of Science & Scopus, number of research grants)

Competitive research funding distribution Additional faculty payments depending on

development program indicators Material stimulation of publications in Web of

Science & Scopus

PROGRAM OF PUBLICATION STIMULATION

Main principles of material stimulation for research publications: Additional payments depends on journal rank (2011-

2014 – journal impact-factor, from 2015 – journal quartile)

Research field is taken into account Fractional counting for publications

Results from 2011 till now Increasing of journal publications VS publications in

local collections of papers (especially in Social Science &Humanities)

Increasing of publications in international journals VS local journals

Increasing of publications in Web of Science &Scopus

THE BASIS FOR “QUARTILE” APPROACH TO PUBLICATION ASSESSMENT

The goal – enhancement of journal quality for university publications

Share of publications in top journals – one of indicators in subject ARWU ranking

Good correlation between publications in top journals and Field-weighted citation

Easy way to perform cross-disciplinary comparisons

PUBLICATIONS IN TOP JOURNALS OF DIFFERENT UNIVERSITIES

PUBLICATIONS IN TOP JOURNAL IN DIFFERENT SUBJECT AREAS (OECD)

CHANGES IN STRUCTURE OF PUBLICATION TYPE

2010 2011 2012 2013 20140

20

40

60

80

100

120

140

160Scopus, SS&Hum

2010 2011 2012 2013 20140%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

SPbSU IASArticle in book

Article in journal

PUBLICATIONS IN SCOPUS OF DIFFERENT RUSSIAN UNIVERSITIES AFTER THE IMPLEMENTATION OF PUBLICATION STIMULATION PROGRAMS

2009 2010 2011 2012 20130

200

400

600

800

1000

1200

1400

1600

1800

2000

SPbSU

UrFU

HSE

FULL-TEXT ELECRTONIC RESOURCES AND SPBSU PUBLICATIONS

2007 2008 2009 2010 2011 2012 2013 20140

500

1000

1500

2000

2500

0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

800,000

900,000

1,000,000

Whole read documents

Publications in Scopus

Publications in Web of Science

wri

te

read

SPBSU PUBLICATION IN SCOPUS AND SCIENCEDIRECT USAGE

2007 2008 2009 2010 2011 2012 2013 20140

500

1000

1500

2000

2500

0

50,000

100,000

150,000

200,000

250,000

Freedom Collection Elsevier (read documents)

Publications in Scopus

wri

te

read

SCOPUS ALERTS

12/1

1/20

11

1/20

/201

2

2/29

/201

2

4/9/

2012

5/19

/201

2

6/28

/201

2

8/7/

2012

9/16

/201

2

10/2

6/20

12

12/5

/201

2

1/14

/201

3

2/23

/201

3

4/4/

2013

5/14

/201

3

6/23

/201

3

8/2/

2013

9/11

/201

3

10/2

1/20

13

11/3

0/20

13

1/9/

2014

2/18

/201

4

3/30

/201

4

5/9/

2014

6/18

/201

4

7/28

/201

4

9/6/

2014

10/1

6/20

14

11/2

5/20

14

1/4/

2015

2/13

/201

5

3/25

/201

5

5/4/

2015

6/13

/201

5

7/23

/201

50

20

40

60

80

100

120

140

160

180

201120122013201420152016

2011 2012 1013 2014 20150

500

1000

1500

2000

2500

3000

pub

prediction

OBTAINING DATA FOR REPORTS AND GRANT PROPOSALS

University report or proposal

Indicator Source of Information

Monitoring of dissertation councils

List of articles with journal impact factor (for each research specialization)

Source article listing from Scopus or SciVal Overview & Web of Science (InCites)

Monitoring of HEI Number of articles Scopus & Web of Science

Number of citations in certain year of papers, published in previous 5 years

Citation Overview in Scopus & Citation Report in Web of Science

Share of international publications

Collaboration in SciVal Overview

Grant proposals Cumulative impact factor of journals for publications of organization

Source article listing from Scopus or SciVal Overview & Web of Science (InCites)

Number of articles and citations for certain research areas

Scopus & SciVal OverviewWeb of Science (InCites)

TARGET INDICATOR FOR RESEARCH FOUNDATIONS AND ORGANIZATIONS

Number of publications, written with financial support of certain foundation (RFBR, RFH, RSF) or institutionsThe obligate point in all research proposals The goal – to evaluate the effectiveness of

funding from different sources

SOME PROBLEMS IN SCOPUS

The limit of 2000 articles for citation overview

The existing limits for any export Absence of refine options for funding details

PROBLEMS WITH AUTHOR DETAILS

Absence of any export options for the list of authors affiliated with organization

The limitations for the viewing of author list (not more then 4000)

DISCREPANCY WITH SOME JOURNAL DATA IN SCOPUS

THE MAIN WAYS OF SCIVAL USING

Determining of priorities in research activity Determining of budgetary priorities Searching of collaboration partners for

research Determining of certain fields for

collaboration with certain institutions Benchmarking

ОСНОВНЫЕ МОДУЛИ SCIVAL

SUMMARY ON UNIVERSITY PUBLICATIONS

DIFFERENT JOURNAL CLASSIFICATION

SCIENCE MAPS FOR DIFFERENT COUNTRIES

Russian Federation, 2013 Germany, 2013

CIRCLE AND MATRIX SCIENCE MAPS OF SPBSU

CHANGES IN COMPETENCES DURING DEVELOPMENT PROGRAM REALIZATION

2005-2009

2007-2011

• Nanotechnology & Materials Science

• Biomedicine & Human Health

• Ecology, Environmental & Geosciences

• Computer science

• Social Science & Management

79 competencies • 15 “ distinct “ • 64 “emerging”

56 competencies:• 13 “ distinct “• 43 “emerging”

BENCHMARKING

COLLABORATION DATA IN SCIVAL AND EXISTING AGREEMANETS

Collaborating organizations in SciVal

Number of agreements

Germany 93 27

Italy 55 11

France 73 14

USA 227 19

Australia 21 1

Canada 31 4

Brazil 9 2

Finland 14 10

Poland 21 7

China 36 20

INTERNATIONAL COLLABORATION

FINDING POTENTIAL COLLABORATION

GENERAL PROBLEMS IN RUSSIAN SCIENCE Lack of research in corporate sector Lack of real collaboration of academic

science and industry

THE MAIN PROBLEMS IN UNIVERSITY RESEARCH PRESENTATION

Incorrect author affiliation in articles Incorrect selection of journals for publication of

research results Many publications in Russian-language editions,

that are not indexed in international citation databases

Small proportion of open access publications Overall imbalance of research fields - weak

development of the biomedical and social and humanitarian areas

WISH-LIST FOR OPEN ACCESS

To provide easy way to find open-access journals and open-access articles in Scopus

Special conditions for author payment (open-access publications in hybrid journals) to authors from institutions with subscription to certain journals

Agreements with Russian research foundations (RFBR, RFH, RSF) about open-access payments

THE MAIN WAYS TO CORRECT THE SITUATION IN SPBSU

Training for electronic resources and citation databases

Training for Academic writing Stimulation of research publications -

additional payment for articles in high ranking journals and good citation, compensation of publication fees

Development of material-technical base of research in priority fields

SUMMARYScopus and SciVal helps to find

strong and weak areas in institution research

Very convenient for publication monitoring

Good benchmarking instrumentHelps monitoring the existing

collaboration and looking for potential collaboration