Pitfalls in the external validation of FRAX

J. A. Kanis,A. Oden,H. Johansson,E. McCloskey
DOI: https://doi.org/10.1007/s00198-011-1846-0
2011-11-26
Osteoporosis International
Abstract:Recent studies have evaluated the performance of FRAX® in independent cohorts. The interpretation of most is problematic for reasons summarised in this perspective.IntroductionFRAX is an extensively validated assessment tool for the prediction of fracture in men and women. The aim of this study was to review the methods used since the launch of FRAX to further evaluate this instrument.MethodsThis covers a critical review of studies investigating the calibration of FRAX or assessing its performance characteristics in external cohorts.ResultsMost studies used inappropriate methodologies to compare the performance characteristics of FRAX with other models. These included discordant parameters of risk (comparing incidence with probabilities), comparison with internally derived predictors and inappropriate use and interpretation of receiver operating characteristic curves. These deficits markedly impair interpretation of these studies.ConclusionCohort studies that have evaluated the performance of FRAX need to be interpreted with caution and preferably re-evaluated.
endocrinology & metabolism
What problem does this paper attempt to address?