Assessing agreement between two measurement systems: An alternative to the limits of agreement approach

Nathaniel T Stevens,Stefan H Steiner,R Jock MacKay
DOI: https://doi.org/10.1177/0962280215601133
IF: 2.494
2015-09-02
Statistical Methods in Medical Research
Abstract:The comparison of two measurement systems is important in medical and other contexts. A common goal is to decide if a new measurement system agrees suitably with an existing one, and hence whether the two can be used interchangeably. Various methods for assessing interchangeability are available, the most popular being the limits of agreement approach due to Bland and Altman. In this article, we review the challenges of this technique and propose a model-based framework for comparing measurement systems that overcomes those challenges. The proposal is based on a simple metric, the probability of agreement, and a corresponding plot which can be used to summarize the agreement between two measurement systems. We also make recommendations for a study design that facilitates accurate and precise estimation of the probability of agreement.
health care sciences & services,medical informatics,mathematical & computational biology,statistics & probability
What problem does this paper attempt to address?