Gauging Research Output and Influence
-
Upload
guestb4248d -
Category
Business
-
view
1.227 -
download
1
description
Transcript of Gauging Research Output and Influence
Gauging Research Output and Influence Using Traditional Citation Tools and Unique Analytical Solutions.
ALA 2010 Midwinter MeetingJan 15-19, Boston
Paul TorpeyJeff Dougherty
Today’s Discussion
Web of Science Data
• Foundational strengths and what this provides
• Unleashed -- unique presentation and utilization in multiple resources
Origins: The Web of Science and Citation Indexing Dr. Eugene Garfield, the concept: A citation index
approach to scientific and scholarly discovery – unique methods for identifying associations and connections between published works on a multidisciplinary scale.
The Web of Science Foundation
Web of Science Content Quality
– Carefully managed , ongoing Collection Development . Every Journal is individually selected for influence within its respective discipline .
– Unique Data - Thomson Reuters captures available author cited references for all published papers back to 1900
Diversity -- Truly Multidisciplinary Journal Coverage
– All fields of study are included, 250+ categories – 12,000+ unique titles
– Science Citation Index Expanded – 8,160 titles
– Social Sciences Citation Index – 2,780 titles
– Arts & Humanities Citation Index – 1,500 titles
Depth -- Great Depth of Coverage is Available
– To 1900 in the Sciences – To 1900 in the Social Science– To 1975 in the Arts & Humanities
The Web of Science Foundation
Web of Science Conference Proceedings
Proceedings literature is an essential component of international scholarly communication.
Web of Science Conference Proceedings Citation Indexes:• Conference Proceedings Citation Index- Science (CPCI-S)
• Conference Proceedings Citation Index- Social Science & Humanities (CPCI-SSH) 1990-present
• CPCI files are fully integrated into Web of Science, behaving exactly as the SCIE, SSCI and A&HCI files.
– Weekly updates
– Coverage of approximately 12,000 conferences annually
– Proceedings in book or book series form, monographic sources, account for approximately 70% of content.
Web of Science Content Quality
– Carefully managed , ongoing Collection Development . Every Journal is individually selected for influence within its respective discipline .
– Unique Data - Thomson Reuters captures available author cited references for all published papers back to 1900
Diversity -- Truly Multidisciplinary Journal Coverage
– All fields of study are included, 250+ categories – 11,300 unique titles
– Science Citation Index Expanded – 8,090 titles
– Social Sciences Citation Index – 2,716 titles
– Arts & Humanities Citation Index – 1,500 titles
Depth -- Great Depth of Coverage is Available
– To 1900 in the Sciences – To 1900 in the Social Science– To 1975 in the Arts & Humanities
The Web of Science Foundation
Web of Science – More than “Science” Social Sciences Citation Index – 2,700+ TitlesAnthropology Gerontology Psychology
Area Studies Health Policy & Services Public Administration
Business History Public, Environmental & Occupational Health
Communication Hospitality, Leisure, Sport & Tourism
Rehabilitation
Criminology & Penology Industrial Relations & Labor Social Issues
Demography Information Science & Library Science
Social Sciences
Economics International Relations Social Work
Education Law Sociology
Environmental Studies Linguistics Substance Abuse
Ergonomics Management Transportation
Ethics Nursing Urban Studies
Ethnic Studies Planning & Development Women’s Studies
Family Studies Political Science
Geography Psychiatry Diversity – Web of Science Supports All Academic Programs
Arts & Humanities Citation Index – 1,500 Titles
Archaeology Folklore Medieval & Renaissance Studies
Architecture History Music
Art Humanities Philosophy
Asian Studies Language & linguistics
Poetry
Classics Literary Reviews Religion
Dance Literary Theory Theater
Film, Radio, Television
Literature
Web of Science – More than “Science”
Diversity – Web of Science Supports All Academic Programs
One of the truly powerful features of Web of Science is the Cited Reference Search
Retrieves information often missed through use of Keywords alone -- essential for truly comprehensive searching. AND…
The ability to enter a wide range of items in the Cited Work field – not only a Journal but a Film, a notable Book or Report, Novel, or even Work of Art, and retrieve articles that have cited these works – is a way to gather relevant information that may not have been found in any other way.
A True Citation Index – Unmatched in Depth and Diversity Displaying all cited works, whatever the form – Journal Articles, Books, Conference Papers, etc. Browse – Discover Select Precise Works on which to search, or to eliminate from a search.
Web of Science Forward Citation Map
Psychology, Experimental
Computer Science, Artificial Intelligence
Business
Religion
Business
Web of Science Content Quality
– Carefully managed , ongoing Collection Development . Every Journal is individually selected for influence within its respective discipline .
– Unique Data - Thomson Reuters captures available author cited references for all published papers back to 1900
Diversity -- Truly Multidisciplinary Journal Coverage
– All fields of study are included, 250+ categories – 11,300 unique titles
– Science Citation Index Expanded – 8,090 titles
– Social Sciences Citation Index – 2,716 titles
– Arts & Humanities Citation Index – 1,500 titles
Depth -- Great Depth of Coverage is Available
– To 1900 in the Sciences – To 1900 in the Social Science– To 1975 in the Arts & Humanities
The Web of Science Foundation
Web of Science Content Quality
– Carefully managed , ongoing Collection Development . Every Journal is individually selected for influence within its respective discipline .
– Unique Data - Thomson Reuters captures available author cited references for all published papers back to 1900
– Consistent indexing• All author names and all address are indexed for every Web of
Science record
The Web of Science Foundation
Web of Science – Consistent Indexing
Web of Science Content Quality
– Carefully managed , ongoing Collection Development . Every Journal is individually selected for influence within its respective discipline .
– Unique Data - Thomson Reuters captures available author cited references for all published papers back to 1900
Diversity -- Truly Multidisciplinary Journal Coverage
– All fields of study are included, 250+ categories – 11,300 unique titles
– Science Citation Index Expanded – 8,090 titles
– Social Sciences Citation Index – 2,716 titles
– Arts & Humanities Citation Index – 1,500 titles
Depth -- Great Depth of Coverage is Available
– To 1900 in the Sciences – To 1900 in the Social Science– To 1975 in the Arts & Humanities
The Web of Science Foundation
Faculty and Institutional Publication Output and Evaluation
• Analyze Results– View trends and access subsets of data
• Citation Report– Quickly produce an overview of a topic or one’s published
works, as well as an indication of the collective influence of those works.
• Citation Map– Visualize two generations of forward and backward
citations
Wright State UniversityTop 10 Cited Papers 1900-2008
Web of Science Citation Report: Ronald Glaser
Citation Report: Influenza Topic Search
Web of Science – powerful “Analyze Results” features
Analyze Results features are present in all ISI Web of Knowledge databases
– as well as All Databases search results.
Web of Science – Citation Map
Web of Science – Backward Citation Map
2nd generation citations reveal citation pathways
Web of Science®
Web of Science is an extremely valuable “intelligence” resource – a tool for characterizing and gauging published
output and influence for institutions, individuals, countries, etc. – indispensible for basic comparisons.
Journals
Papers
Authors
InstitutionsDisciplines
Web of ScienceWeb of Science
Web of Science®
Appalachian State University
A comparison of output and citation of Economics papers.
Western Illinois University
Appalachian State University
A comparison of output and citation of Economics papers.
Western Illinois University
Web of Science is an extremely valuable “intelligence” resource – a tool for characterizing and gauging published
output and influence for institutions, individuals, countries, etc. – indispensible for basic comparisons.
Web of Science®
Using Web of Science to compare five faculty researching and publishing within Materials Science, we know which produces the more
influential work on average.
Using Web of Science to compare five faculty researching and publishing within Materials Science, we know which produces the more
influential work on average.
But, how “good” is this?
Avg. Cites Per Paper
3.2
5.7
7.8
10.5
13.3
Web of Science is an extremely valuable “intelligence” resource – a tool for characterizing and gauging published
output and influence for institutions, individuals, countries, etc. – indispensible for basic comparisons.
Web of Science®
Comparison of “averages” to gauge performance is valuable, but only within the appropriate context, within
some definitive or authoritative group.
Web of Science®
Comparison of “averages” to gauge performance is valuable, but only within the appropriate context, within
some definitive or authoritative group.
Web of Science®
For serious assessment activities it is essential to take a more sophisticated approach to the data.
Bibliometrics Scientometrics InfometricsCitation
Metrics
Evaluation of Research
• Self-Assessment – understanding where you’ve been, where you are today, and where you want to be in the future.
• Use your precious resources more effectively – Strategic planning
– Assist in measuring ROI
– Researcher-level assessments- tenure review, etc.
– Report progress to government bodies, boards of directors/ trustees, funding agencies, etc.
– Recruiting
Of Key Importance -- the Establishment of Baselines…
Essential in order to provide comparative capabilities
From established Baselines, we can normalize the influence of published works and present real metrics to reflect research performance.
Customer defined data sets providing article-
level source records and related detail. This is
most typically comprised of papers associated
with a particular Institution, but can also
be “topic” defined.
Summary information and metrics on published output and performance at the the institution and
country level.
Average citations specific to Category, year of article, and document type.
For Your Institution – Papers
Percentile position specific to field and year. -- The closer to zero, the more highly cited.
For Your Institution – Papers
Relative Performance
At-a-Glance
With a baseline of 1.0 for each, you immediately have a gauge of the level of influence of an author’s collective
works compared other published work in the field.
For Your Institution – Authors
For Your Institution – Authors
For Your Institution – Disciplines
The published intellectual output of a university presented by discipline.
Here too, gauge relative influence at a glance.
For Your Institution – Disciplines
The published intellectual output of a university presented by discipline.
Here too, gauge relative influence at a a glance.
For Your Institution – Peer Institution Comparisons
For Your Institution – Peer Institution Comparisons
For Your Institution – Peer Institution Comparisons
Country Level Analytics
Citation Analysis is Objective in nature -- a key piece of the overall Research Evaluation puzzle.
Citation Metrics
Awards/Honors
Funding data
Peer review
American Documentation, Vol. 14, No.3 , p. 195-201 1963
Eugene GarfieldEugene Garfield Derek J. de Solla PriceDerek J. de Solla Price
Price, DJDArchives Internationale d'histoire Des SciencesNo 14, p 85, 1951
Thomson Reuters Research Analytics Solutions
Gauging Research Output and Influence Using Traditional Citation Tools and Unique Analytical Solutions.
ALA 2010 Midwinter MeetingJan 15-19, Boston
Jeff DoughertyPaul Torpey