Skip to main content
Log in

On bibliometrics in academic promotions: a case study in computer science and engineering in Italy

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Due to its quantitative nature, bibliometrics is becoming increasingly popular among policy makers for academic hiring and career promotions. In this article, we quantitatively assess the impact that the granularity level in the classification of scientific areas would entail on research evaluation based on bibliometric indicators. We use as a case study the Italian national habilitation system (ASN), which classifies faculty members according to their academic discipline and relies on journal counts, citations, and h-indices as a basis for promoting tenure track researchers to associate professors and associate to full professors. The assessment checks whether the individual indicators of a researcher are above a certain threshold, e.g., the median over the population of researchers working in the same discipline. Our investigation focuses on two related, rather broad disciplines: computer science and computer engineering. We show that the ASN practice of using the same thresholds for all members of a scientific discipline can favor certain sub-communities that are characterized by higher bibliometric indicators, and disfavor others. We report evidence that up to 30% of Italian faculty members of certain sub-communities would see their indicators drop below the threshold, thus becoming not eligible for promotion, if the ASN were conducted on a more accurate, fine-grained classification. Conversely, in the same scenario, up to 11% of faculty members, in different sub-communities, would see their indicators rise above the threshold, granting them eligibility. Our data set includes 1685 authors, 89,185 distinct publications, and 262,286 author-publication pairs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://abilitazione.miur.it/public/documenti/2018/Tabelle_Valori_Soglia_ALLEGATI_DM_589_2018.pdf.

  2. We refer to the Web page https://www.anvur.it/attivita/asn/asn-2012-2013/indicatori-e-relative-mediane/ and to the document https://www.anvur.it/wp-content/uploads/2012/08/documento_accompagnamento_all_2.pdf (both in Italian) for details.

References

Download references

Acknowledgements

Work partially supported by MIUR, the Italian Ministry of Education, University and Research, under PRIN Project n. 20174LF3T8 AHeAD (Efficient Algorithms for HArnessing Networked Data).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Camil Demetrescu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Demetrescu, C., Finocchi, I., Ribichini, A. et al. On bibliometrics in academic promotions: a case study in computer science and engineering in Italy. Scientometrics 124, 2207–2228 (2020). https://doi.org/10.1007/s11192-020-03548-9

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-020-03548-9

Keywords

Navigation