Holmes apr20-post
-
Upload
national-information-standards-organization-niso -
Category
Education
-
view
856 -
download
1
Transcript of Holmes apr20-post
A Library-Based Metrics & Impact Core
Kristi Holmes, PhD@kristiholmes
NISO Virtual Conference: Justifying the Library Using Assessment to Justify Library InvestmentsApril 20, 2016
Galter Library’s Metrics and Impact Core
• The Metrics and Impact Core (MIC), housed in Galter Library, has expertise in bibliometrics, data visualization, continuous improvement, information systems and alternative metrics. The core provides extensive advisory services for researchers, groups or departments on topics such as:
• developing successful publishing strategies• managing or tracking publications• maintaining an impactful online identity• measuring or assessing research impact by discipline• communicating research impact to audiences
Metrics and Impact Core websitehttp://galter.northwestern.edu/Request-Services-and-Materials/metrics-and-impact-core-mic
Northwestern University Clinical and Translational Sciences (NUCATS) Institute
Mission: Speeding transformative research discoveries to patients
and the community
http://nucats.northwestern.edu/
Evaluation Services for the campus
Studios – lead to training grants, foundation awards, cores, etc.
Northwestern University Clinical and Translational Sciences (NUCATS) Institute Evaluation and Continuous Improvement Program
Mission: Speeding transformative research discoveries to patients and the community
http://nucats.northwestern.edu/
Some sample metrics…
OUTPUT Metrics
Time to Publication or other output
Number of technology transfer products
ROI of pilot awards
ROI of TL1, T32, KL2 scholars
Time from publication to research synthesis
IMPACT Metrics
Influence of a research output
Researcher and institutional collaborations
Career development and path/trajectory
PROCESS Metrics
Time from IRB submission to approval
Time from grant award to start of study
Volume of investigators who use services, take training, and other activities
Writing About Your Impact on the New NIH Biosketchhttp://galter.northwestern.edu/news/wr iting-about-your-impact-in-the-new-nih-biosketch
Matchmaker, Make Me a Match: Choosing a Journalhttp://galter.northwestern.edu/news/matchmaker-make-me-a-match-choosing-a-journal
Sharing, Publishing, and Archiving Your Workhttp://galter.northwestern.edu/news/shar ing-publishing-and-archiving-your-work
Visualizing Science at Feinberg School of Medicinehttp://galter.northwestern.edu/news/visualizing-science-at-feinberg-school-of-medicine
Recent News Items
Communication
Frameworks and Resources
Becker Model for Assessing Research Impact (C Sarli)-https://becker.wustl.edu/impact-assessment/how-to-use
Academic Careers Understood through Measurement and Norms (ACUMEN)-http://research-acumen.eu/portfolio
Research Excellence Framework (REF) Impact Case Studies-http://impact.ref.ac.uk/CaseStudies/
Canadian Academy of Health Sciences (CAHS) Framework-http://www.cahs-acss.ca/wp-content/uploads/2011/09/ROI_FullReport.pdf
And more…
Tools and data sources
Bibliographic databases: Scopus (Elsevier)NU Scholars (Elsevier)PubMed (NLM)Web of Science (Thomson Reuters)Google Scholar
Other databases:Scholarly DatabaseNIH RePORTEREssential Science Indicators (Thomson Reuters)
Tools: Sci2TableauTagxedoExcelIllustrator
Recognition of Faculty and Alumni
Visualizations for recognition
Department of Preventive Medicine, NU FSMDevelopment and Alumni Relations, NU FSM
Global Influence of Jeremiah Stamler, MD
Network of top 50 co-author relationships with Jeremiah Stamler, MD
Data from Elsevier’s Scopus. Data span from 1949-2014.
Visualization created using Sci2 tool (cns.iu.edu).
Top 20 Journal Titles for Jeremiah Stamler, MD
Titles of publications for Jeremiah Stamler, MD
Data from Elsevier’s Scopus.Data span from 1949-2014.
Visualization created using Tagxedo.
Publication Summaries
• Productivity: how much research was produced and who produced it- # of researchers in group- # of articles published by members- Average articles per year- # of unique source (journal) titles
• Collaboration: who worked together to make the research happen- # of country affiliations of co-authors- # of top institutional affiliations of co-authors- Listing of funding organizations from 2014 to present
• Research Topics: what the research was about- Document types for published articles- Top key words used in articles- Top subject areas of source (journal) titles
Departmental Publication Summaries continued…
Citation Impact for the Group: the impact it had on subsequent scientific research
- Total citations- Average citations per year- Average citations per publication- Citations by year of publication- Citations cumulative- Citations by year of publication per publication- Most highly cited publication- # of country affiliations of citing authors- # of languages of citing articles- # of unique source (journal titles) from citing articles- # of unique country affiliations of citing authors- # of unique institutional affiliations of citing authors- h- index of departmental documents- # of documents with no citations- Hot or Highly Cited publications
Citation Impact for Individuals: the impact he/she had on subsequent scientific research
Total published articles (career span and report timespan) Total citations (career span and report timespan) h-index m-index # of co-authors
High Impact Research
http://www.feinberg.northwestern.edu/research/about/high-impact/index.html
Office of the Dean, NU FSM
Other services…
https://galter.northwestern.edu/news/writing-about-your-impact-in-the-new-nih-biosketch
We offer: u Galter classu Individual consultationsu Online guide
It’s a team effort!u Pamela Shawu Karen Gutzman
NIH biosketch review
Other services…
Assistance with grant proposal and submission
u Award nominationsu Visa applicationsu Progress reports
Custom reports
The library offers expertise in bibliometrics, data visualization, continuous improvement, information systems and alternative metrics through the Metrics and Impact Core. 18
Research Impact and Metrics Services and Support
VisualizationsPublication Summaries
Indicator and Measurement OverviewProductivity: how much research was produced and who produced it
# of researchers in department# of artic les published by facultyAverage artic les per year# of unique source (journal) titles
Collaboration: who worked together to make the research happen
# of country affiliations of co-authors# of top institutional affiliations of co-authorsListing of funding organizations from 2014 to present
Research Topics: what the research was aboutDocument types for published artic lesTop key words used in artic lesTop subject areas of source (journal) titles
Citation Impact for Department: the impact it had on subsequent scientific research
Total c itationsAverage citations per yearAverage citations per publicationCitations by year of publicationCitations cumulativeCitations by year of publication per publicationMost highly c ited publication# of country affiliations of c iting authors# of languages of c iting artic les# of unique source (journal titles) from citing artic les# of unique country affiliations of c iting authors# of unique institutional affiliations of c iting authorsh- index of departmental documents# of documents with no citationsHot or Highly Cited publications
Citation Impact for Individuals: the impact he/she had on subsequent scientific research
Total published artic les (career span and report timespan)Total c itations (career span and report timespan)h-indexm-index# of co-authors
Custom Reports
Karen Gutzman is our Impact and Evaluation Librarian. Contact her directly or through your liaison librarian. Visit the Metrics and Impact Core online.
A few future directions
Galter Classes:-Enhancing the Impact of Your Research-Bibliometrics for Researchers
Galter Guides-Enhancing the Impact of Your Research-Methods and Processes for Individual/Group Publication
Summaries-Evaluation Resources at Northwestern
Building out the Service Core
Acknowledgements
Teams:• Karen Gutzman & Pamela Shaw• The amazing team at Galter Library
• NUCATS
Questions/Follow-up:• [email protected]• Twitter: @kristiholmes
Thank you!Kristi [email protected]@northwestern.eduorcid.org/0000-0001-8420-5254