Off to New Horizons - scientometrics-school.eu · 1. Publications data retrieved from different...

Off to New Horizons: the Crucial Role of Libraries in Bibliometric Analyses

Juan Gorraiz and Christian GumpenbergerBerlin, 10th September 2013

Agenda

1• Rationale

1

• Historical overview and organizational embedding

2g g

3• Activities

32

Bibliometrics – a perfect fit for scientific libraries

• Librarians are information specialists• Librarians are information specialists • Librarians are used to work with metadata, search

engines and databases• Libraries do already collect necessary content

(publications) and license required tools (databases)• Libraries are independent and interdisciplinary• Libraries are independent and interdisciplinary

institutions • Libraries are free of scientific bias• Libraries can provide up-to-date usage statistics for the

construction of current usage metrics

3

From a bibliometrics working group towards a dedicated department

i 2006 f ti f ki S i t t i “in 2006 formation of working group „Scientometrics“

since 2008 Bibliometrics Department implemented as part of Library and Archive Servicesy

Quality Assurance Vice RectorateResearch & Development Research Services

BibliometricsConsortiasPhaidra: Digital Asset Management System

Research Documentationu:chris (PURE)

eResource Management(WoK, InCites, ResearcherID,

Scopus)Open Access Team

u:scholar: Repository

Library and Archive Services4

Activities of the Bibliometrics Department

Teaching

Consul-tancy and

Expert analyses

Scientific Output

EventsProjects

Develop-ment

Partner-hi

6


Teaching

7

Teaching

Basic Database

University Course Library and Information

Trainings Studies, Module

Bibliometrics

PhD courses for data sources

(WoS, Scopus, Supervision of

Students (Project theses Master( oS, Scopus,

etc), for publication strategies & bibliometrics

theses, Master theses,

exchange semesters)

8


Consul-tancy and

Expert analyses

9

Consultancy and expert analyses

Expert searchesExpert analyses (Inter-)national

Support for Vienna University

Researchers

Expert analysesReports

- faculty evaluations- individual evaluations

Enhancement ofResearch

Documentation(u:cris) activities

(Inter )national expert analyses, e.g.

for scienceagencies, science

foundations, universities- professorial

appointment proceduresuniversities

10


Expert searchesExpert analyses

Reports (Inter-)nationalSupport for Vienna

University Researchers

Reports- faculty evaluations

- individual evaluations

Enhancement of Research

Documentation (u:cris) activities


for science agencies, science

foundations, universities etc- professorial

appointmentprocedures

universities, etc.

11

Bibliometric profiles:Bibliometric profiles: support for scientists in ‘publish or perish’ dilemma

1 Publications data retrieved from different data sources (Web of1. Publications data retrieved from different data sources (Web of Science (WoS), Scopus, other subject specific databases, etc.)

2. Cross-check with the scientists and coverage analysis3. Bibliometric analysis4. Validation and discussion of the results with the scientists

Optional:• Support with increasing the scientist’s visibility

(ResearcherID ORCID Google Citations Profile)(ResearcherID, ORCID, Google Citations Profile)• Mapping with Open Source Tools like Bibexcel, Pajek and

VosViewerK l d b i R f l (Cit d )• Knowledge basis: References analyses (Cited sources)

12

Mapping for scientists

Generation of purpose specific maps:

• Collaboration Network: Co-Authors, Co-Affiliations, Countries

• Main Research Focus & Interdisciplinarity Network: Subject Categories, Sources, Keywords & AbstractsSubject Categories, Sources, Keywords & Abstracts

• Citation Analysis Network:Citing Authors, Citing Institutions, Citing Countries

• Funding Agencies Network• Funding Agencies Network

13

Open Access & Bibliometrics

Supporting the OA activities of the University of Vienna:Supporting the OA activities of the University of Vienna:

• Representative of the OA-Board• Expert support for further development of u:scholar (IR) and

u:cris (CRIS) • Bibliometric analyses concerning the availability and impact

of OA Publications and Gold OA journals (to avoid contradictory strategies)

• Administration of Gold Open Access publications fees• Expert support for in-house publishing activities

(https://openaccess.univie.ac.at/beratung/publikationsberatung)

14

http://bibliometrie univie ac athttp://bibliometrie.univie.ac.at

15




Researchers








appointment proceduresuniversities, etc.

16

Data collection

• Formulating reproducible & adjustable search stringsFormulating reproducible & adjustable search strings• Data harvesting in two steps (institution and author based)• Manual disambiguation of authors and affiliations

C h k i h id d bli i li• Cross-check with provided publication lists

17

Data analysis (enhanced by Incites)

Activity # of publications # of co-authors author role (firstActivity # of publications, # of co authors, author role (first, last, corresponding), differentiation of several document types, timelines, coverage analysis

Visibility ‘most published in’ journals, IF, quartiles,Visibility most published in journals, IF, quartiles, (comparison with list of selected journals provided by faculties)

Impact # of citations, #citations/paper, max citations,Impact # of citations, #citations/paper, max citations, h-index, i-Index (i50), percentiles (baselines fromInCites or ESI), self-citations

Collaboration co-authors, co-affiliations, countriesCollaboration co authors, co affiliations, countries mapping

Scope disciplinary vs. cross- vs. interdisciplinary

St t f th t f l i

18

State-of-the-art references analysis

Bibliometric reports for faculties

• Periodic and cyclic evaluation of publication output of the 15 f lti d 3 t ( 4 l )faculties and 3 centres (approx. 4 year cycle)

• „Performance Agreements“ between rectorate and faculty prepared by Quality Assurance Department

• Discussion if and to what degree a bibliometric analysis makes• Discussion if and to what degree a bibliometric analysis makes sense

• Analyses based on enhanced data provided by InCites, which hasbeen implemented to reflect the actual organisational structure ofbeen implemented to reflect the actual organisational structure ofthe Vienna University (from faculty to research group)

• Reports are NOT results of evaluation, but a discussion paper presented to the dean in advance, to the selected peer in revised form, and to the rectorate in revised and annotated form

• Optional: benchmarking via InCites (only possible in certain subject areas or WoS categories, however, not on organisational/structural level)organisational/structural level)

19

Bibliometric reports for individual professors

• some professors are being evaluated 5 years after their appointment under the terms of their contract

• depending on the discipline the rectorate asks the Bibliometrics Department for a bibliometric report

• Such reports are only complimentary to the professor’s self-assessments and are always generated and finalised in mutual agreement between the BibliometricsDepartment and the professors to be evaluated.

• Once finalised these reports are checked by the Quality Assurance Department and then forwarded to the prectorate.

• Optional: delineation of hot topic (guided by researcher under evaluation))

20

P f i l i t t dProfessorial appointment procedures

• offered service for faculty administration to analyse applications for vacant chairs (in collaboration with Quality Assurance department)

• critical discussion about standards and criteria deemed as important by faculty

• agreed standards and criteria then applied to analyses of either all publications retrieved from database searches and/or provided publication lists

• Preference of basic instead of composite indicatorsPreference of basic instead of composite indicators• Top counts approach allows for the multi-dimensionality of the

analyses taking into account different publication cultures as well as different strategic considerations in a flexible waywell as different strategic considerations in a flexible way

21




Researchers








appointment proceduresuniversities, etc.

22

Consultancy and expert analysesConsultancy and expert analyses

S pport for Vienna

Expert searchesExpert analyses

R tEnhancement of

(Inter-)national expert analyses, e.g.Support for Vienna

University Researchers

Reports- faculty evaluations

- individual evaluations- professorial

i t t d



expert analyses, e.g. for science

agencies, science foundations,

universities, etc.appointment procedures

23


Events

24

Bibliometric Events

• STI (Science and Technology Indicators) Conference 2008 Vienna

• InCites and SciVal Workshops 2009• Open Access Day 2010• Science metrix: Activity 2010• Ranking Day 2010• Bibliometric talk: The tool-box of

SCImago 2011• Scientometric Indicators for Arts &

Humanities and Social Sciences 2011• Book Citation Index 2012• Bibliometrie Regensburg 2012• ISSI (International Society for

S i t t i d I f t i )Scientometrics and Informetrics) Conference 2013 Vienna 25


26Develop-ment

Partner-hi

Development partnerships

• partnerships with industry for strategic reasons• especially recommended for sophisticated and pricy products• opportunity to trim products according to institutional needs• opportunity to trim products according to institutional needs• negotiation of special prices as an „early adopter“• industry gains valuable input in returny g p• win-win situation for both sides• University of Vienna is development partner for InCites

(Th R t ) t f S iV l (El i ) d l(Thomson Reuters), was partner for SciVal (Elsevier) and also supports ResearcherID (Thomson Reuters) and ORCID

27


Projects

28

N i l P jNational Project:Bibliometrics Survey in Austria

• within the scope of a master thesis• within the scope of a master thesis• purpose: documentation of awareness for bibliometrics in Austria• survey period: May – August 2010• respondents: scientists from 10 Austrian Universities, the Austrian

Academy of Sciences, and the FWF Austrian Science Fund• Response rate: 1352 scientists• Results were presented at the ISSI conference 2011 in Durban,

South Africa

29

International ProjectsInternational Projects

30

European Summer School for Scientometrics

scientometrics as an „emerging field“

l k f ti t i t t ilack of a pertinent scientometrics education in Europe

only few expertsonly few experts

increasing demand

31

esss organization

collaboration of 3 institutionsEnglish languague of instruction

l i t & dditi lannual main event & additionalworkshops on special topicsrotating venue2 conference-like introductory days 3 practical daysstate-of-the-art & hot topicsstate of the art & hot topics

32


Scientific Output

33

Scientific output: topics

• Bibliometric methods applicable for librariesComparison and evaluation of data sources and analytical tools• Comparison and evaluation of data sources and analytical tools

• Development of bibliometric indicators for research evaluation (sciencepolicy) and collection management of (e)-resources

• Open Access• Open Access • Usage (downloads, loans) versus citation metrics• Altmetrics• Researcher and institutions identifiers• Researcher and institutions identifiers• Collaboration analyses• Negative Results

Q tit ti th d f th S i l S i d th H iti• Quantitative methods for the Social Sciences and the Humanitieshttp://bibliometrie.univie.ac.at/aktivitaeten/publikationen/

34

Scientific output: conferences

35

Take-home messages

• Bibliometrics is ideal for academic librarians to strengthen their on-campus position!

• This field offers lots of opportunities to provide innovativeThis field offers lots of opportunities to provide innovative services for both academic and administrative university staff to complement peer-review!

• Doing so you can contribute to the development of newDoing so you can contribute to the development of new strategies and the fostering of innovation!

• Actively participate in the scientific discourse and disseminate your gained experience in the scientificdisseminate your gained experience in the scientific community!

36

Many thanks for your attention!Many thanks for your attention!

37

Off to New Horizons - scientometrics-school.eu · 1. Publications data retrieved from different...

Documents

Transcript of Off to New Horizons - scientometrics-school.eu · 1. Publications data retrieved from different...