Predicting results of the Research Excellence Framework using departmental h-index

O. Mryglod, Ralph Kenna, Yu Holovatch, B. Berche

    Research output: Contribution to journalArticle

    15 Citations (Scopus)

    Abstract

    We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK’s Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. We then determine the corresponding h-indices for 2008–2013, the period examined in the UK’s Research Excellence Framework (REF) 2014. We place herewith the resulting predictions on the arXiv in advance of the REF results being published (December 2014). These may be considered as unbiased predictions of relative performances in that exercise. We will revisit this paper after the REF results are available and comment on the reliability or otherwise of these bibliometrics as compared with peer review.
    Original languageEnglish
    Pages (from-to)1013-1017
    JournalScientometrics
    Volume104
    Issue number3
    DOIs
    Publication statusPublished - Dec 2014

    Fingerprint

    peer review
    performance

    Keywords

    • Peer review
    • Hirsch index
    • Normalised citation-based indicator
    • Research Assessment Exercise (RAE)
    • Research Excellence Framework (REF)

    Cite this

    Predicting results of the Research Excellence Framework using departmental h-index. / Mryglod, O.; Kenna, Ralph; Holovatch, Yu; Berche, B.

    In: Scientometrics, Vol. 104, No. 3, 12.2014, p. 1013-1017.

    Research output: Contribution to journalArticle

    Mryglod, O. ; Kenna, Ralph ; Holovatch, Yu ; Berche, B. / Predicting results of the Research Excellence Framework using departmental h-index. In: Scientometrics. 2014 ; Vol. 104, No. 3. pp. 1013-1017.
    @article{f6dee426f37943439eac879c9b072886,
    title = "Predicting results of the Research Excellence Framework using departmental h-index",
    abstract = "We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK’s Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. We then determine the corresponding h-indices for 2008–2013, the period examined in the UK’s Research Excellence Framework (REF) 2014. We place herewith the resulting predictions on the arXiv in advance of the REF results being published (December 2014). These may be considered as unbiased predictions of relative performances in that exercise. We will revisit this paper after the REF results are available and comment on the reliability or otherwise of these bibliometrics as compared with peer review.",
    keywords = "Peer review, Hirsch index, Normalised citation-based indicator, Research Assessment Exercise (RAE), Research Excellence Framework (REF)",
    author = "O. Mryglod and Ralph Kenna and Yu Holovatch and B. Berche",
    year = "2014",
    month = "12",
    doi = "10.1007/s11192-014-1512-3",
    language = "English",
    volume = "104",
    pages = "1013--1017",
    journal = "Scientometrics",
    issn = "0138-9130",
    publisher = "Springer Verlag",
    number = "3",

    }

    TY - JOUR

    T1 - Predicting results of the Research Excellence Framework using departmental h-index

    AU - Mryglod, O.

    AU - Kenna, Ralph

    AU - Holovatch, Yu

    AU - Berche, B.

    PY - 2014/12

    Y1 - 2014/12

    N2 - We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK’s Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. We then determine the corresponding h-indices for 2008–2013, the period examined in the UK’s Research Excellence Framework (REF) 2014. We place herewith the resulting predictions on the arXiv in advance of the REF results being published (December 2014). These may be considered as unbiased predictions of relative performances in that exercise. We will revisit this paper after the REF results are available and comment on the reliability or otherwise of these bibliometrics as compared with peer review.

    AB - We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK’s Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. We then determine the corresponding h-indices for 2008–2013, the period examined in the UK’s Research Excellence Framework (REF) 2014. We place herewith the resulting predictions on the arXiv in advance of the REF results being published (December 2014). These may be considered as unbiased predictions of relative performances in that exercise. We will revisit this paper after the REF results are available and comment on the reliability or otherwise of these bibliometrics as compared with peer review.

    KW - Peer review

    KW - Hirsch index

    KW - Normalised citation-based indicator

    KW - Research Assessment Exercise (RAE)

    KW - Research Excellence Framework (REF)

    U2 - 10.1007/s11192-014-1512-3

    DO - 10.1007/s11192-014-1512-3

    M3 - Article

    VL - 104

    SP - 1013

    EP - 1017

    JO - Scientometrics

    JF - Scientometrics

    SN - 0138-9130

    IS - 3

    ER -