Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An...

13
www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments Institutional Planning and Assessment| June 12, 2014

Transcript of Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An...

Page 1: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

www.usask.ca/ipa

International Activities Committee – June 12, 2014

University Rankings:An overview of research indicators

used in rankings instruments

Institutional Planning and Assessment| June 12, 2014

Page 2: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Institutional Rankings of Interest QS (Quacquarelli Symonds) THE (Times Higher Education) ARWU (Academic Ranking of World Universities) Maclean’s Research Infosource

Page 3: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Institutional Rankings of Interest Each instrument has its own indicators to measure

academic performance Indicators generally fall into four categories:

1. Reputation

2. Research Performance

3. Student/Faculty Composition

4. Other/Miscellaneous

Page 4: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance Research Input – income/expenditures

(Maclean’s, Research Infosource, THE) Research Output – number of papers published

(ARWU, Research Infosource, THE) Research Impact – number of citations

(ARWU, QS, Research Infosource, THE)

Page 5: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Input”Instrument Indicator

Placement Among U15

Research Infosource Total sponsored research income 12th

THE Research income per academic staff Not published

Maclean’s Total research spending per full-time faculty 13th

Research Infosource Total research income per full-time faculty position 13th

Maclean’sSocial sciences & humanities (SSHERC) grants per full-time faculty

14th

Maclean’sMedical/Science (NSERC & CIHR) grants per full-time faculty

13th

THE Research income from industry per academic staff 3rd

Page 6: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Input”Total sponsored research income

Total research spending per full-time faculty

Total research income per full-time faculty position

Social sciences & humanities (SSHERC) grants per full-time faculty

Medical/Science (NSERC & CIHR) grants per full-time faculty

Research income from industry per academic staff

1

8

15

Page 7: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Output”Instrument Indicator

Placement Among U15

Research Infosource Total number of publications 15th

ARWU Total number of papers 15th

THEAcademic papers per academic and research staff

Not published

Research InfosourceTotal number of publications per full-time faculty

15th

ARWUTotal number of papers published in Nature and Science

14th

THE International co-authorships Not published

Page 8: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Output”Total number of publications

Total number of papers

Publications per full-time faculty

Papers published in Nature and Science 1

8

15

Page 9: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Impact”Instrument Indicator

Placement Among U15

Research InfosourceProbability of being cited based on the journal which an paper is published on (Average Relative Impact Factor)

15th

THE Normalized average citations per paper 15th

QS Citations per faculty 15th

ARWUNumber of highly cited researchers in 21 broad subject categories

10th

ARWUAlumni of an institution winning Nobel Prizes & Fields Medals

7th

ARWUStaff of an institution winning Nobel Prizes & Fields Medals

Tied for 4th

Page 10: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Research Performance: “Impact”Average Relative Impact Factor (ARIF)

Normalized average citations per paper

Citations per faculty

Number of highly cited researchers

Alumni winning Nobel Prizes & Fields Medals

Staff winning Nobel Prizes & Fields Medals

1

8

15

Page 11: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Data Sources Most data for research indicators are obtained

from third-party sources:Thomson Reuters’ Web of Science CAUBO

Elsevier’s Scopus Tri-Agency

Source

Rankings

QS THE ARWU Maclean’sResearch Infosource

Bibliometrics and public/third-party sources 20% 38.5% 100% 80% 100%

Reputational surveys 50% 33%   20%  

Data provided by institutions 30% 28.5%      

Page 12: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

Moving Forward… Better/easier ways to access data/results from

ranking instruments (e.g. Ranking Dashboard) Integrate Ranking Strategies into institutional

planning, decision making and communication activities where appropriate

Explore the possibility of a Rankings Task Force to increase our understanding of how rankings work and how the U of S can improve in each instrument

Page 13: Www.usask.ca/ipa International Activities Committee – June 12, 2014 University Rankings: An overview of research indicators used in rankings instruments.

Institutional Planning and Assessment| June 12, 2014

www.usask.ca/ipa

For More InformationContact:

Troy Harkot

Director of Institutional Effectiveness

[email protected]

IPA Website: http://www.usask.ca/ipa/assessment/external_rankings.php