Big fish and small ponds: why the departmental h-index should not be used to rank universities

Olesya Mryglod, Yurij Holovatch, Ralph Kenna

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
18 Downloads (Pure)

Abstract

The size-dependent nature of the so-called group or departmental h-index is reconsidered in this paper. While the influence of unit size on such collective measures was already demonstrated a decade ago, institutional ratings based on this metric can still be found and still impact on the reputations and funding of many research institutions. The aim of this paper is to demonstrate the fallacy of this approach to collective research-quality assessment in a simple way, focusing on the h-index in its original form. We show that randomly reshuffling real scientometric data (varying numbers of citations) amongst institutions of varying size, while maintaining the volume of their research outputs, has little effect on their departmental h-index. This suggests that the relative position in ratings based on the collective h-index is determined not only by quality (impact) of particular research outputs but by their volume. Therefore, the application of the collective h-index in its original form is disputable as a basement for comparison at aggregated levels such as to research groups, institutions or journals. We suggest a possible remedy for this failing which is implementable in a manner that is as simple and understandable as the h-index itself.
Original languageEnglish
Pages (from-to)3279-3292
Number of pages14
JournalScientometrics
Volume127
Issue number6
Early online date27 Apr 2022
DOIs
Publication statusPublished - Jun 2022

Bibliographical note

Copyright © and Moral Rights are retained by the author(s) and/ or other copyright owners. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This item cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder(s). The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders.

This document is the author’s post-print version, incorporating any revisions agreed during the peer-review process. Some differences between the published version and this version may remain and you are advised to consult the published version if you wish to cite from it.

Funder

This work was supported in part by the National Academy of Sciences of Ukraine, Project KPKBK 6541230.

Keywords

  • Group h-index
  • Hirsch index
  • Size effects

ASJC Scopus subject areas

  • Social Sciences(all)
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Big fish and small ponds: why the departmental h-index should not be used to rank universities'. Together they form a unique fingerprint.

Cite this