A visual interpretation rating scale for validation of numerical models

D. E. Coleby, A. P. Duffy

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Purpose – The comparison of large volumes of complex data resulting from numerical modelling in computational electromagnetics is a demanding task, especially when validating the performance of numerical models against experimental results and testing experimental repeatability. “Byeye” comparisons can lead to inconsistencies and inherent subjectivity. This paper establishes a “visual” benchmark by which comparisons can be made and therefore used to assist in the development of an algorithmic approach to data comparison. Design/methodology/approach – This new method presented here is based on the CooperHarper Rating Scale, which is a test pilot's evaluationrating instrument. This has been modified through qualitative research. The assertion that the rating scale will leave the group mean response unaltered but will reduce the variance has been statistically tested. Findings – The proposed rating scale provides a calibration technique by which to benchmark comparisons. The scale also reduces subjectivity by producing an overall quantitative measure of similarity. The paper concludes with an application of the rating scale to assessment of a candidate algorithmic approach against correlation. Research limitations/implications – The research findings are based on small data sets, which is a limit imposed by the industrial environment in which this scale will be used. Practical implications – This paper provides a tool to overcome some of the key substantial difficulties in communicating similarity or difference, namely that “similarity” and “difference” have no standalone definition, there is a lack of a shared language for the comparisons and little commonality for a decisionmaking framework. Originality/value – This paper provides modellers and experimentalists in computational electromagnetics (particularly electromagnetic compatibility) with a structured approach to quantifying the quality of comparative results.

Original languageEnglish
Pages (from-to)1078-1092
Number of pages15
JournalCOMPEL - The International Journal for Computation and Mathematics in Electrical and Electronic Engineering
Volume24
Issue number4
DOIs
Publication statusPublished - 1 Dec 2005
Externally publishedYes

Keywords

  • Electromagnetism
  • Numerical analysis
  • Simulation

ASJC Scopus subject areas

  • Computer Science Applications
  • Computational Theory and Mathematics
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'A visual interpretation rating scale for validation of numerical models'. Together they form a unique fingerprint.

Cite this