Guillaume RivalleGuillaume.rivalle@thomsonreuters.com

APRIL 2014

MEASURE YOUR RESEARCH PERFORMANCE WITH INCITES

• Annual reports, Board of trustees reports

• Strategic plans/performance dashboards

• Strategic publishing/funding

• Competitive analysis

• PR, research magazines

• Recruitment, expert finding

• Collaboration analysis

• Departmental research strategy

• Building an institutional repository

• Build faculty expertise database

HOW DO CUSTOMERS USE INCITES?

Universities and other research producing institutionsUniversities and other research producing institutions

Research funding organizationsResearch funding organizations

PublishersPublishers

Corporate sectorCorporate sector

3

INTEGRATE CITATION METRICS INTO YOUR WORKFLOW

4

THE CHALLENGES OF USING CITATION METRICS•Work with « clean », unified and consistent data

•Generate relevant and normalised indicators

•Work and visualize several indicators (multiple angles) simultaneously

•Quickly and regularly produce standardised and reliable reports

• Identify weaknesses and demonstrate strengths of research activities

•Analyse collaborations and identify the most fruitful and efficient ones

•Being able to run fair comparisons between entities (people, departments, universities, countries, etc.)

5

WEB OF SCIENCE- A TRULY UNIQUE CITATION RESOURCE

•Selectivity and control of content: consistent, transparent standards

•Content: 12500 journals,12000 annual conferences 50000 books and 800 million Cited References

•Multidisciplinary: 251 subject categories

•Consistent and reliable data:

- Cover-to-cover indexing

- Cited references for all years of coverage

- Indexing of all author names and addresses

•Funding acknowledgments: link funding source to outputs

INDEXINGDIFFERENT LEVELS OF METADATA CAPTURE

6

MEDLINE/PUBMED recordMEDLINE/PUBMED recordWeb of Science Core Collection recordWeb of Science Core Collection record

All AuthorsAll AffiliationsAll Funding sources

All AuthorsAll AffiliationsAll Funding sources

Without consistency, no meaningful data analysis is possible

Without consistency, no meaningful data analysis is possible

JOURNAL SELECTION PROCESS FOR WEB OF SCIENCE Core Collection

Journal Publishing Standards

Editorial Content

International Diversity

Citation Analysis

Four Points of Evaluation

Core coverage in Web of Science is not static !

NEUTR

AL

For decades, Thomson Reuters has carefully evaluated journals for potential inclusion in the database

100 %of the top 100 universitieshave Web of Science

GOLD STANDARDused by 7,000+ institutions in 100+ countries

SELECTIVE……YET COMPREHENSIVE

Web of Science data provide the foundation for research analytics solutions

Thomson Reuters data sources and

expertise

Client Expertise and Information

• Address unification (5000 unified institutions by 2015)

• Author-Affiliation linking• Normalization & baselines• Default 10 years world dataset

• Researchers• Departments, research units,

institutes• Repository

InCites Researchers

Profiles

InCites Reports

RIV

How “good” is this? What is the context?

Additional metrics are needed to understand research performance.

23.3 cites/paperH-index: 13

Citation rates vary among fields and scientific communities.

What is good or average in mathematics is very different from what is good or average in biochemistry.

InCites provides REAL Metrics

14.5 cites/paperH-index: 7 9.8 cites/paper

H-index: 7 4.2 cites/paperH-index: 3

11

12

Should this article be one of the most impactful publication of this author?Is this a high number of citations?

Should this article be one of the most impactful publication of this author?Is this a high number of citations?

The JIF is informative because it gives me the average influence of a journal, NOT of a researcher/institution/country/…

The JIF is informative because it gives me the average influence of a journal, NOT of a researcher/institution/country/…

13

According to Essential Science Indicators, this article is within the 1% of the most cited 2011 articles in Chemistry

According to Essential Science Indicators, this article is within the 1% of the most cited 2011 articles in Chemistry

Should this article be one of the most impactful publication of this author?Is this a high number of citations?

Should this article be one of the most impactful publication of this author?Is this a high number of citations?

A new Essential Science IndicatorsA new Essential Science Indicators

15

For each publication, InCites will take into account different data points for creation of truly Contextualized impact.

According to InCites, this article has an impact that is 126 times above the expected impact in this category, and 58 times above the expected impact for this journal

For each publication, InCites will take into account different data points for creation of truly Contextualized impact.

According to InCites, this article has an impact that is 126 times above the expected impact in this category, and 58 times above the expected impact for this journal

Run Direct comparisons between the world’s institutions, countries, journals, researchers,

Run Direct comparisons between the world’s institutions, countries, journals, researchers,

EXAMPLES

Run Direct comparisons between the world’s institutions, countries, journals, researchers,

Run Direct comparisons between the world’s institutions, countries, journals, researchers,

EXAMPLES

Quickly analyze the effects of a collaborationQuickly analyze the effects of a collaboration

EXAMPLES

Drill into one institution publication activitiesDrill into one institution publication activities

EXAMPLES

Use the “Analytics” tab to access your existing reports, do new analyses and generate new ‘tiles’

Use the “Analytics” tab to access your existing reports, do new analyses and generate new ‘tiles’

The “Explore” features allow you to do comprehensive analyses of various different entities

The “Explore” features allow you to do comprehensive analyses of various different entities

“System Reports” allow you to access various pre-configured reports

“System Reports” allow you to access various pre-configured reports

“Scenario Planner” is designed to help you test the impact of various scenarios.

For example the potential of a proposed merger or the impact of hiring a particular individual

“Scenario Planner” is designed to help you test the impact of various scenarios.

For example the potential of a proposed merger or the impact of hiring a particular individual

The ‘Explore Organizations’ page lets you run complex analyses, browse institutions and benchmark your performance to peers,

The ‘Explore Organizations’ page lets you run complex analyses, browse institutions and benchmark your performance to peers,

Filter results using a variety of attributesFilter results using a variety of attributes

Also limit your search to certain research areas, document types, specific journals or to articles in Open Access journals

Also limit your search to certain research areas, document types, specific journals or to articles in Open Access journals

Change the type of visualization

Change the type of visualization

Each report (tile) can be based on any group of publications, e.g a researcher, a department, an institute, a journal, a topic, a country, etc.

Each tile can be drilled through for analysis at individual article level

Reports can be shared and sent to other users

Each report (tile) can be based on any group of publications, e.g a researcher, a department, an institute, a journal, a topic, a country, etc.

Each tile can be drilled through for analysis at individual article level

Reports can be shared and sent to other users

By saving and building up a collection of your own tiles you can create your own ‘Dashboard’.

Easy to access, interpret and share, yet built on robust and careful analysis

By saving and building up a collection of your own tiles you can create your own ‘Dashboard’.

Easy to access, interpret and share, yet built on robust and careful analysis

A new Journal Citation Report with more powerful and flexible analysis capabilities

A new Journal Citation Report with more powerful and flexible analysis capabilities

Click a specific category in the Node & Link Network or the # of journals to view the journals for that category

Click a specific category in the Node & Link Network or the # of journals to view the journals for that category

Navigate between journal or category ranks

Navigate between journal or category ranks

Instantly search any journal titleInstantly search any journal title

Easily navigate to previous editions of the JCR to view trends. All customers have access to the full archive back to 1997

Easily navigate to previous editions of the JCR to view trends. All customers have access to the full archive back to 1997

All customers have access to both Science and Social Sciences editions of the JCR at the same time.

All customers have access to both Science and Social Sciences editions of the JCR at the same time.

For the first time it is possible to group journals by the Essential Science Indicators subject classification schema of 22 disciplines

For the first time it is possible to group journals by the Essential Science Indicators subject classification schema of 22 disciplines

Limit your analysis to only those journals in certain quartiles of their subject area

Limit your analysis to only those journals in certain quartiles of their subject area

Or limit to a specific range of Impact Factors

Or limit to a specific range of Impact Factors

Guillaume RivalleGuillaume.rivalle@thomsonreuters.com

APRIL 2014

MEASURE YOUR RESEARCH PERFORMANCE WITH INCITES