A scientists' view of scientometrics: Not everything that counts can be counted

R. Kenna, O. Mryglod, B. Berche

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities.Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and prestige. However, there is sometimes a failure to appreciate that scientometrics are, at best, very blunt instruments and their incorrect usage can be misleading. Rather than accepting the rise and fall of individuals and institutions on the basis of such imprecise measures, calls have been made for indicators be regularly scrutinised and for improvements to the evidence base in this area. It is thus incumbent upon the scientific community, especially the physics, complexity-science and scientometrics communities, to scrutinisemetric indicators. Here, we review recent attempts to do this and show that some metrics in widespread use cannot be used as reliable indicators research quality.

Original languageEnglish
Article number13803
Pages (from-to)13803-1 - 13803-10
Number of pages10
JournalCondensed Matter Physics
Volume20
Issue number1
DOIs
Publication statusPublished - 2017

Fingerprint

physical exercise
physics

Keywords

  • Research evaluation
  • Scientometrics

ASJC Scopus subject areas

  • Condensed Matter Physics
  • Physics and Astronomy (miscellaneous)

Cite this

A scientists' view of scientometrics : Not everything that counts can be counted. / Kenna, R.; Mryglod, O.; Berche, B.

In: Condensed Matter Physics, Vol. 20, No. 1, 13803, 2017, p. 13803-1 - 13803-10.

Research output: Contribution to journalArticle

Kenna, R. ; Mryglod, O. ; Berche, B. / A scientists' view of scientometrics : Not everything that counts can be counted. In: Condensed Matter Physics. 2017 ; Vol. 20, No. 1. pp. 13803-1 - 13803-10.
@article{42096cc7265746bab938da30dcd87ea3,
title = "A scientists' view of scientometrics: Not everything that counts can be counted",
abstract = "Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities.Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and prestige. However, there is sometimes a failure to appreciate that scientometrics are, at best, very blunt instruments and their incorrect usage can be misleading. Rather than accepting the rise and fall of individuals and institutions on the basis of such imprecise measures, calls have been made for indicators be regularly scrutinised and for improvements to the evidence base in this area. It is thus incumbent upon the scientific community, especially the physics, complexity-science and scientometrics communities, to scrutinisemetric indicators. Here, we review recent attempts to do this and show that some metrics in widespread use cannot be used as reliable indicators research quality.",
keywords = "Research evaluation, Scientometrics",
author = "R. Kenna and O. Mryglod and B. Berche",
year = "2017",
doi = "10.5488/CMP.20.13803",
language = "English",
volume = "20",
pages = "13803--1 -- 13803--10",
journal = "Condensed Matter Physics",
issn = "1607-324X",
publisher = "Human Kinetics",
number = "1",

}

TY - JOUR

T1 - A scientists' view of scientometrics

T2 - Not everything that counts can be counted

AU - Kenna, R.

AU - Mryglod, O.

AU - Berche, B.

PY - 2017

Y1 - 2017

N2 - Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities.Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and prestige. However, there is sometimes a failure to appreciate that scientometrics are, at best, very blunt instruments and their incorrect usage can be misleading. Rather than accepting the rise and fall of individuals and institutions on the basis of such imprecise measures, calls have been made for indicators be regularly scrutinised and for improvements to the evidence base in this area. It is thus incumbent upon the scientific community, especially the physics, complexity-science and scientometrics communities, to scrutinisemetric indicators. Here, we review recent attempts to do this and show that some metrics in widespread use cannot be used as reliable indicators research quality.

AB - Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities.Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and prestige. However, there is sometimes a failure to appreciate that scientometrics are, at best, very blunt instruments and their incorrect usage can be misleading. Rather than accepting the rise and fall of individuals and institutions on the basis of such imprecise measures, calls have been made for indicators be regularly scrutinised and for improvements to the evidence base in this area. It is thus incumbent upon the scientific community, especially the physics, complexity-science and scientometrics communities, to scrutinisemetric indicators. Here, we review recent attempts to do this and show that some metrics in widespread use cannot be used as reliable indicators research quality.

KW - Research evaluation

KW - Scientometrics

UR - http://www.scopus.com/inward/record.url?scp=85016762142&partnerID=8YFLogxK

U2 - 10.5488/CMP.20.13803

DO - 10.5488/CMP.20.13803

M3 - Article

VL - 20

SP - 13803-1 - 13803-10

JO - Condensed Matter Physics

JF - Condensed Matter Physics

SN - 1607-324X

IS - 1

M1 - 13803

ER -