WORKSHOP 

Investigação e Ensino na NOVA – da análise bibliométrica da produção científica à caracterização dos estudantes e 

dos diplomados

Bibliometric analysis and its contribution for university 

governanceCarlos .V. Costa, FEUP 

Universidade Nova de Lisboa, 29th June 2012Rectorate, Campus de Campolide

Bibliometric analysis and its contribution for university governance

Context, in short…Research Productivity (??) & Measurement

Resources Allocation ManagementBibliometrics

Conclusions, some…

Bibliometric analysis and its contribution for university governance

Governance of HEIs

Economic relevance: direct and indirectResources effective use: increase productivityMulti–services, joint production: undergraduate,

professional and graduate education, R&D …, other services

Bibliometric analysis and its contribution for university governance

ResearchImportance: knowledge supply and value chain,

teachers scientific and technical continuous education, satisfaction of teaching & research staff

Outcomes: papers, patents, reportsInputs: labour and non-labour (buildings,

equipment, research projects, materials, energy, sponsors, etc.)

Bibliometric analysis and its contribution for university governance

Research Productivity (1)

Can we use the current definition?How to calculate the monetary value of

outcomes?What is usually done ?: select a set of criteria

and characterize quantitavelly and qualitativelly with indicators (proxis)

Bibliometric analysis and its contribution for university governance

Research Productivity (2)

Scientific publications (type, number, impact)Coordination and participation in research

projects (type, number, impact)PhD Students supervision (number)Other

Bibliometric analysis and its contribution for university governance

Measuring Research Productivity

Construct a model using other metrics, with:criteria (variables)indicators (parameters)index (combined indicators)

Bibliometric analysis and its contribution for university governance

Resources Allocation Management

MeasureCompare with objectivesTake actions on the resources allocation Set new objectives

Bibliometric analysis and its contribution for university governance

Bibliometrics (1)

Measure the only “true” direct research outcome

Research staff values itVery important externally (research projects,

rankings, image, etc.)

Bibliometric analysis and its contribution for university governance

Bibliometrics (2)

Difficult to measure (complexity)Difficult to normalizeDifficult to represent by an indicatorDifficult to manipulate??Better likelyhood to represent authentic success

Bibliometric analysis and its contribution for university governance

Conclusions

Bibliometrics should be considered as important information to HEIs governance

Still a lot to be done: reliable models for performance assessment

(scientific basis, staff acceptance and stakeholders understanding)real consideration in resources allocation decision making