Abstract:Purpose: To improve the precision of multicenter clinical trials, several efforts are underway to determine scanner-specific parameters for harmonization using standardized phantom measurements. The goal of this study was to test the correspondence between quantification in phantom and patient images and validate the use of phantoms for harmonization of patient images. Methods: The National Electrical Manufacturers' Association image quality phantom with hot spheres was scanned on two time-of-flight PET scanners. Whole-body [18 F]-fluorodeoxyglucose (FDG)-PET scans were acquired of subjects on the same systems. List-mode events from spheres (diam.: 10-28 mm) measured in air on each scanner were embedded into the phantom and subject list-mode data from each scanner to create lesions with known uptake with respect to the local background in the phantom and each subject's liver and lung regions, as a proxy to characterize true lesion quantification. Images were analyzed using the contrast recovery coefficient (CRC) typically used in phantom studies and serving as a surrogate for the standardized uptake value used clinically. Postreconstruction filtering (resolution recovery and Gaussian smoothing) was applied to determine if the effect on the phantom images translates equivalently to subject images. Three postfiltering strategies were selected to harmonize the CRCmean or CRCmax values between the two scanners based on the phantom measurements and then applied to the subject images. Results: Both the average CRCmean and CRCmax values for lesions embedded in the lung and liver in four subjects (BMI range 25-38) agreed to within 5% with the CRC values for lesions embedded in the phantom for all lesion sizes. In addition, the relative changes in CRCmean and CRCmax resulting from the application of the postfilters on the subject and phantom images were consistent within measurement uncertainty. Further, the root mean squared percent difference (RMSpd ) between CRC values on the two scanners calculated over the three sphere sizes was significantly reduced in the subjects using postfiltering strategies chosen to harmonize CRCmean or CRCmax based on phantom measurements: RMSpd of the CRCmean values in subjects was reduced from 36% to < 8% after harmonizing CRCmean , while RMSpd for CRCmax was reduced from ~33% to < 6% after harmonizing CRCmax with a different strategy. However, with this strategy designed to harmonize CRCmax , the RMSpd for CRCmean only improved to ~14% in subjects. Conclusions: The consistency of the CRC measurements between the phantom and subject data demonstrates that harmonization strategies defined with phantom studies track well to patient images. However, quantitative agreement between different scanners as represented by the RMSpd depends on the metric chosen for harmonization.

Quantitative Metrics for Benchmarking Medical Image Harmonization

Harmonization Benchmarking Tool for Neuroimaging Datasets

All you need is Data Preparation: A Systematic Review of Image Harmonization Techniques in Multi-center/device Studies for Medical Support Systems

Quantitative imaging biomarkers: A review of statistical methods for technical performance assessment

Beyond MR Image Harmonization: Resolution Matters Too

Agreement of Image Quality Metrics with Radiological Evaluation in the Presence of Motion Artifacts

Rethinking Perceptual Metrics for Medical Image Translation

Data harmonisation for information fusion in digital healthcare: A state-of-the-art systematic review, meta-analysis and future research directions

Similarity and Quality Metrics for MR Image-To-Image Translation

Metrics to Quantify Global Consistency in Synthetic Medical Images

The Use of Quantitative Metrics and Machine Learning to Predict Radiologist Interpretations of MRI Image Quality and Artifacts

Deep learning for the harmonization of structural MRI scans: a survey

Validation of phantom-based harmonization for patient harmonization

Multicenter quantitative 18F-fluorodeoxyglucose positron emission tomography performance harmonization: use of hottest voxels towards more robust quantification

Call for Data Standardization: Lessons Learned and Recommendations in an Imaging Study

Intensity warping for multisite MRI harmonization

Roughness Index and Roughness Distance for Benchmarking Medical Segmentation

MR Image Harmonization with Transformer

Image Quality Assessment: A Review to Full Reference Indexes

Evaluation of Spatial and Transform Fusion methods for Medical Images using Normalized Non-Reference Quality Metrics

Five Pitfalls When Assessing Synthetic Medical Images with Reference Metrics