Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as...
Transcript of Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as...
![Page 1: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/1.jpg)
BibliometricResearchAssessmentasProfessionalJurisdiction?InsightsfromtheHistoryoftheLeidenCentreforScienceand
TechnologyStudies(CWTS),1980–2016
SabrinaPetersohn&ThomasHeinze,UniversityofWuppertalScience,TechnologyandInnovationIndicatorsConference2017,Paris
Sept82017
BibPro: ResearchEvaluationinTransition:TheInstitutionalizationofBibliometricsasaResearchFieldandProfessionalizationasanExpertField
![Page 2: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/2.jpg)
Professionaljurisdiction (Abbott1988)
Professionals:Diagnosis,inference,treatment
Commodities:Knowledgestored inartefacts
Academicsector:Abstractknowledge system
Clients:Complex individualcases
Professionaljurisdiction
![Page 3: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/3.jpg)
Expertorganizationsinevaluativebibliometrics
Contract research institutesand consultancies
Databaseproviders (i.e.Clarivate,Elsevier)
EvaluativeBibliometricsas academic field
Researchorganizations,funding organizations
Professionaljurisdiction
![Page 4: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/4.jpg)
Dataset
Interviewmaterial•12expertinterviewswithcurrentandformerCWTSmembersandsciencepolicyexpertsfromKNAW,VSNU,RathenauInstituteandQANUArchivalmaterial•492CWTScontractresearchprojectreports•CWTSAnnualReports1986-2010•FacultyReportsLeidenUniversity1995,2000•295evaluationreportsissuedduringtheVSNUprotocolevaluations(1994,1998)andSEP(2003,2009)•Evaluationprotocols(VSNU1993,1994,1998,SEP2003,2009,2015)•Legislativeandpolicydocuments
![Page 5: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/5.jpg)
Emergenceofquantitativeresearchassessmentasajurisdiction
• Technologicalchange:ScienceCitationIndex
• Sciencepolicydemands:Fundingdecisions,prioritiesandaccountability
– Netherlands:expertiseinpolicy-relevantsciencestudieswasbuiltupinaministerialdepartment,anadvisorycouncilandinsciencestudiesgroupatLeidenUniversity
– MinistryofEducationandScienceandResearchCouncilNWOfundlong-termresearchprogramsinScienceandTechnologyindicators
![Page 6: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/6.jpg)
ProfessionalclaimofCWTSasanexpertorganization
ProfessionalclaimofCWTS– Bibliometricsasadiagnostictool:
„Theessenceisthatwecameupwithatoolthatenabledexpertsinthefieldtoidentifyemerginggroups.Thatwaswhatitwasallabout- emergingordeclining.“ (InterviewHenkMoed)
Bibliometricsas„quantitativecoreofpeerreview“ (vanRaan1996):“Thereforethesupportofpeerreviewbybibliometricsisa(sic!)indispensablepartoftheevaluationprocedure.“ (vanRaan1999:418)
![Page 7: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/7.jpg)
CognitivebasisofCWTSclaimtoexpertise
Cognitiveclaimbasedon
•Meticulouscollectionandcarefulprocessingofpublicationandcitationdata•methodoffieldnormalization•thecreationofamodifiedin-houseversionoftheISI-databasesspecificallyadaptedtopurposesofresearchevaluation(Moedetal.1995)
![Page 8: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/8.jpg)
CommunicationofCWTScognitiveclaimintheacademicfield
1985 1990 1995 2000
![Page 9: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/9.jpg)
CWTSsocialclaimtoexpertise
1985 1990 1995 2000
![Page 10: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/10.jpg)
AcceptanceofCWTSsocialclaims–clientstructure
N=492CWTScontractresearchreports
![Page 11: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/11.jpg)
Formativephase1986-1993
![Page 12: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/12.jpg)
Expansionphase1994-2007
![Page 13: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/13.jpg)
Consolidationanddiversificationphase2008-2015
![Page 14: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/14.jpg)
ThreatstoCWTSpositionintheexpertfieldofevaluativebibliometrics
N=295EvaluationreportsfromVSNUProtocolandSEPevaluations
![Page 15: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/15.jpg)
CWTScognitiveclaimstoconsolidateitspositionintheexpertfield
2005 2010 2015 2020
![Page 16: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/16.jpg)
CWTSsocialclaimstoconsolidateitspositionintheexpertfield
2005 2010 2015 2020
![Page 18: Bibliometric Research Assessment as Professional … · Bibliometric Research Assessment as Professional Jurisdiction? Insights from the History of the Leiden Centre for Science and](https://reader031.fdocuments.in/reader031/viewer/2022030601/5acefc3c7f8b9a71028c1911/html5/thumbnails/18.jpg)
Petersohn,S.(2016):Professionalcompetenciesandjurisdictionalclaimsinevaluativebibliometrics:Theeducationalmandateofacademiclibrarians.EducationforInformation,32(2),165-193.
Jappe,A.;Heinze,T.;Pithan,D.(underreview):ReputationalControlandtheProfessionalizationofEvaluativeCitationAnalysis.
Petersohn,S.;Heinze,T.(underreview):ProfessionalizingBibliometricResearchAssessment?InsightsfromtheLeidenCentreforScienceandTechnologyStudies(CWTS).(1980-2016).
Projectpublications