Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK)...
Transcript of Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK)...
![Page 1: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/1.jpg)
Open Access & Open Metrics Best practices for Social Sciences
Isidro F. Aguillo
![Page 2: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/2.jpg)
AGENDA
Open Science Integrating and opening the whole research cycle for
everyone
Open access to papers is not enough
Open Metrics Altmetrics “revolution”
Bibliometricians strike back: DORA, Leiden Manifesto & Metrics 2.0
Best practices “Original Sin”: Books, Social Sciences and Humanities,
if covered, are highly cited
Promoting your brand and your output
2 2
![Page 3: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/3.jpg)
Accountability Metrics 2.0 New Stakeholders
Citizen Science
Blurring the lines Formal & Informal
Communication
INTEGRATING the whole research
cycle and its stakeholders
OPENING the whole set of data,
tools, results and metrics
Open Data Big Data = ∑Open Data
SCIENCE 2.0
Data-intensive Big Open Data
‘Globalization’ Sharing everything with
everybody Digital natives scientists
Transparency Open Access
3
![Page 4: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/4.jpg)
4
Evolving from Bibliometrics: Current scenario
SWOT Analysis
STRENGTHS WEAKNESSES
THREATS OPPORTUNITIES
OPEN ACCESS Big Data
Social Networks
BIBLIOMETRICS Tested tools and
indicators
Easy BIBLIOMETRICS
DORA Declaration
ALTMETRICS Trusteness, Meaning
Interpretation
![Page 5: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/5.jpg)
5
I-Metrics
WEBOMETRICS Number of times the URL of a document/author webpage
is linked from another webpage
ALTMETRICS Number of times the
elements are mentioned (shared) in websites, wikis,
blogs, social bookmarks and networks (incl. Twitter)
or search engines
USAGEMETRICS Number of times the
document is read/visited/downloaded from
its publishing place (incl. websites)
BIBLIOMETRICS Number of times the bibliographic record
(identifier) of a paper/book is cited in another similar
formally published paper
Document-level metrics Title Source:Journal/Book/Patent Publication Year Citations Identifier: URL/DOI/Handle Subject/Tags
Author-level metrics
Author(s) Institution (Affiliation)
Publication Year Discipline/Tags
Web profiles Web 2.0 profiles
![Page 6: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/6.jpg)
6
Is Metrics 2.0 an extended set of Altmetrics indicators?
![Page 7: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/7.jpg)
7
Is Metrics 2.0 a composite ‘Altmetric’ indicator?
WEIGHTS
https://bmj.altmetric.com/details/7133536
![Page 8: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/8.jpg)
8
A new paradigm
PUBLISH
SHARING
Data
Preprint OA Paper
Papers (a lot of)
Methods Tools OA Journal
OPEN PEER REVIEW
IMPACT High IF Journals
Data Repositories
Repositories
Social Networks
Cooperation
Citations
Visibility Usage
Replication Reuse
IMPACT
![Page 9: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/9.jpg)
9
Bibliometrics issues: (Incomplete) Diagnostics
![Page 10: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/10.jpg)
10
Bibliometricians strike back
Leiden Manifesto • Quantitative evaluation should support expert assessment • Measure performance in accordance with the research mission • Protect excellence in locally relevant research • Keep data collection and analytical processes open, transparent
and simple. • Allow for data verification • Account for variation by field in publication and citation practices • Data should be interpreted taking into account the difficulty of
credit assignment in the case of multi-authored publications • Base assessment of individual researchers on qualitative
judgment. • False precision should be avoided (eg. the JIF). • Systemic effects of the assessment and the indicators should be
taken into account and indicators should be updated regularly
http://www.leidenmanifesto.org/
![Page 11: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/11.jpg)
11
Evaluators ask for Responsible Metrics
The Metric Tide • Robustness: basing metrics on the best possible data in terms
of accuracy and scope • Humility: recognizing that quantitative evaluation should support
– but not supplant – qualitative, expert assessment • Transparency: keeping data collection and analytical processes
open and transparent, so that those being evaluated can test and verify the results
• Diversity: accounting for variation by field, using a variety of indicators to reflect and support a plurality of research & researcher career paths
• Reflexivity: recognizing the potential & systemic effects of indicators and updating them in response
https://responsiblemetrics.org/the-metric-tide/
![Page 12: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/12.jpg)
Translating into practical quantitative-based assessments
Multi- source New bibliometric sources, specially from developing countries
Non-bibliometric sources too!
Multi- dimension Involving all aspects of the research cycle
Involving all facets of communication and impact
Better attribution Of authors roles and contributions
Of resources, funding and policies involved
Excellence-guided More relative indicators and ranks
From quartiles journal-based to top cited papers (1%, 5%, 10%)
12
![Page 13: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/13.jpg)
13
Journal-Level METRICS
Infamous IF SJR, SNIP
Article-level METRICS
CPP, MNCS PLoS ALM
University RANKINGS
Leiden, Scimago
NTU, URAP
Author PROFILES
GS Citations
ResearcherID ResearchGate
Changing the focus
![Page 14: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/14.jpg)
14
Profiles (Mendeley)
![Page 15: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/15.jpg)
15
Bibliometrics issues: The (lack of) Context
PAPERS CITATIONS PATENTS
ALT
DISCIPLINE BIASES
GEOPOLITICAL BIASES
Hint: Check the ACUMEN EU-project proposal for a Personal Portfolio
![Page 16: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/16.jpg)
16
A few options
IDENTIFIER
YES!
Proprietary
Not really
Not relevant
I hate handles
COVERAGE
Who cares?
Incomplete
Large
Huge
Not the aim, OA first
METRICS
NO
Expensive Biased
Unreliable Easy to
Manipulate
YES ….
What they are waiting for?
PROFILES
More or less
Poor
Rich
Missed Opportunity?
CRIS?
![Page 17: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/17.jpg)
17
But, are reliable the academic networks indicators?
![Page 18: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/18.jpg)
18
Original Sin: The Coverage
![Page 19: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/19.jpg)
19
In fact, both Books and Social Sciences are highly cited
![Page 20: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/20.jpg)
20
Relative Indicators (by discipline, country)
Isidro F. Aguillo 56 432 7.71 1 (>59) Author/Discipline/Country 1.4% 1.6% 115% 1.7%
![Page 21: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/21.jpg)
21
Rankings: “Stick and carrot”: But only ¼ registered!
124
![Page 22: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/22.jpg)
Promoting visibility for Social Sciences community
Build a brand Profile yourself!
Rich local and external contents
Publish in Open Access Several models: Gold (with and without APCs), Green (Repositories)
Everything: Formal (papers, books); Informal (reports, blogs, …)
Disseminate your output Short impact: General social tools
Long-term impact: Academic networks, Wikipedia, YouTube
22
![Page 23: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/23.jpg)
23
Proposing a successful strategy
Branding Institutional * Personal page * Repository / CRIS External * Social Networks * Subject, data and other repositories
Publish Formal * Papers * Books Informal * Reports * Blogs * Portals, directories, wikis (Wikipedia)
Disseminate Alerts (Email, Forums, Websites) Twitter Notes for the Press General social Academic social
Monitor Metrics * Analyze * Customize * Make public Track and engage with visitors
![Page 24: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/24.jpg)
24
Brand: You need an identifier
![Page 25: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/25.jpg)
25
A personal page too!
INSTITUTIONAL
Signature Affiliation
Narratives
Documents for download
Other
University web domain University email address
Standard full length name Complete affiliation (University, City, Country)
Free text description with key aspects about current, previous positions & experience
Full and short CVs Papers, Reports, Chapters (Books), Syllabi, Data, Photos, Videos
Dynamic contents: News, Blog Twitter Portal of external resources Metrics
![Page 26: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/26.jpg)
26
Personal pages at EUI
![Page 27: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/27.jpg)
27
For example: A “3200 pages” personal website
https://gking.harvard.edu/
![Page 28: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/28.jpg)
28
CRIS & Institutional Repository
IR
CRIS
![Page 29: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/29.jpg)
29
Not any CRIS (PURE by Elsevier)
![Page 30: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/30.jpg)
30
Social: Choose your poison
GENERAL
Google+
Others (VK)
ACADEMIC
Google Scholar
ResearchGate
Academia
Mendeley
WIKIPEDIA
Local Language
English
DEPOSITS
SlideShare
GitHub
FigShare
ScriBD
BLOGGING
YouTube
![Page 31: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/31.jpg)
31
A few tricks: Followers & Following
![Page 32: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/32.jpg)
32
Web is rich: Exploiting other sources
![Page 33: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/33.jpg)
33
But Open Access is needed too…
![Page 34: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/34.jpg)
34
7 6 4 2
A good version in English (no automatic translation) or even better as master language text
International First option, your institutional repository. If not available the closest option and as soon as possible
Deposit Check the results in Google and apply SEO techniques for improving the position for your preferred keywords
Positioning New contents every day, updating texts, adding documents or answering requests
Update
As much as possible, in an open access fashion, using the standards (and popular) formats
Publish Link rich texts, preferably including both internal and external outlinks
Connect Use forums, lists, blogs and any other way to inform third-parties of your activities and results
Market Review your visitors, their origin, activities and their reasons for visiting your profile
Follow
Summarizing
![Page 35: Open Access & Open Metrics Best practices for Social Sciences · LinkedIn . Google+ Others (VK) ACADEMIC . Google Scholar ResearchGate Academia Mendeley . WIKIPEDIA . Local Language](https://reader034.fdocuments.in/reader034/viewer/2022042219/5ec5616836fb713fcc38fecf/html5/thumbnails/35.jpg)
35
Thank you!
Questions?
SaCSbeoAAAAJ 124106
isidro-f-aguillo
A-7280-2008
0000-0001-8927-4873
IsidroAguillo
3481717
@isidroaguillo
6507380175