Weight watchers: NASA-TLX weights revisited

Kai Virtanen, Heikki Petteri Mansikka, Helmiina Kontio, Don Harris

    Research output: Contribution to journalArticlepeer-review

    13 Citations (Scopus)
    101 Downloads (Pure)

    Abstract

    National Aeronautics and Space Administration Task Load Index (NASA-TLX) is a popular method to evaluate mental workload. NASA-TLX assesses mental workload across six load dimensions. When the dimensions are not assumed to be approximately equally important, they are weighted by conducting a pairwise comparison for every dimension pair, followed by the normalisation of weights reflecting the importance of the dimensions. This original NASA-TLX weighting method creates some challenges that are difficult to identify when the weights are being assigned. First, the original NASA-TLX weighting does not allow directly expressing two or more dimensions as equally important. Second, if pairwise comparisons are conducted consistently, there exists only one possible importance order for the dimensions. Third, with consistently conducted pairwise comparisons, a weight of 0.33 is artificially forced on the most important dimension. Swing and Analytic Hierarchy Process weighting methods for eliciting the weights of the dimensions are proposed as a solution to these challenges. The advantages of applying these methods in NASA-TLX are introduced theoretically and demonstrated empirically using data from virtual air combat simulations. The objective of this paper is to help scholars and practitioners to use NASA-TLX in mental workload assessments such that the discussed weighting issues are avoided.
    Original languageEnglish
    Pages (from-to)725-748
    Number of pages24
    JournalTheoretical Issues in Ergonomics Science
    Volume23
    Issue number6
    Early online date17 Nov 2021
    DOIs
    Publication statusPublished - 2022

    Bibliographical note

    © 2021 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.

    This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.

    Keywords

    • Analytic hierarchy process weighting method
    • NASA-TLX
    • Swing weighting method
    • mental workload
    • virtual air combat simulation

    ASJC Scopus subject areas

    • Human Factors and Ergonomics

    Fingerprint

    Dive into the research topics of 'Weight watchers: NASA-TLX weights revisited'. Together they form a unique fingerprint.

    Cite this