Exon-intron structure of the LY6G6D gene

I. Beliakov,T. A. Karakasheva,N. Mazurenko

DOI: https://doi.org/10.1134/S0026893309040025

2009-08-26

Molecular Biology

Abstract:

What problem does this paper attempt to address?

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Max Westphal,Antonia Zapf

DOI: https://doi.org/10.1177/09622802241236933

IF: 2.494

2024-03-16

Statistical Methods in Medical Research

Abstract:Statistical Methods in Medical Research, Ahead of Print. Diagnostic accuracy studies assess the sensitivity and specificity of a new index test in relation to an established comparator or the reference standard. The development and selection of the index test are usually assumed to be conducted prior to the accuracy study. In practice, this is often violated, for instance, if the choice of the (apparently) best biomarker, model or cutpoint is based on the same data that is used later for validation purposes. In this work, we investigate several multiple comparison procedures which provide family-wise error rate control for the emerging multiple testing problem. Due to the nature of the co-primary hypothesis problem, conventional approaches for multiplicity adjustment are too conservative for the specific problem and thus need to be adapted. In an extensive simulation study, five multiple comparison procedures are compared with regard to statistical error rates in least-favourable and realistic scenarios. This covers parametric and non-parametric methods and one Bayesian approach. All methods have been implemented in the new open-source R package cases which allows us to reproduce all simulation results. Based on our numerical results, we conclude that the parametric approaches (maxT and Bonferroni) are easy to apply but can have inflated type I error rates for small sample sizes. The two investigated Bootstrap procedures, in particular the so-called pairs Bootstrap, allow for a family-wise error rate control in finite samples and in addition have a competitive statistical power.

health care sciences & services,medical informatics,mathematical & computational biology,statistics & probability
A Patient-Similarity-based Model for Diagnostic Prediction

Zheng Jia,Xian Zeng,Huilong Duan,Xudong Lu,Haomin Li

DOI: https://doi.org/10.1016/j.ijmedinf.2019.104073

IF: 4.73

2020-01-01

International Journal of Medical Informatics

Abstract:Objective: To simulate the clinical reasoning of doctors, retrieve analogous patients of an index patient automatically and predict diagnoses by the similar/dissimilar patients. Methods: We proposed a novel patient-similarity-based framework for diagnostic prediction, which is inspired by the structure-mapping theory about analogy reasoning in psychology. Patient similarly is defined as the similarly between two patients' diagnoses sets rather than a dichotomous (absence/presence of just one disease). The multilabel classification problem is converted to a single-value regression problem by integrating the pairwise patients' clinical features into a vector and taking the vector as the input and the patient similarly as the output. In contrast to the common k-NN method which only considering the nearest neighbors, we not only utilize similar patients (positive analogy) to generate diagnostic hypotheses, but also utilize dissimilar patients (negative analogy) are used to reject diagnostic hypotheses. Results: The patient-similarly-based models perform better than the one-vs-all baseline and traditional k-NN methods. The f-1 score of positive-analogy-based prediction is 0.698, significantly higher than the scores of baselines ranging from 0.368 to 0.661. It increases to 0.703 when the negative analogy method is applied to modify the prediction results of positive analogy. The performance of this method is highly promising for larger datasets. Conclusion: The patient-similarly-based model provides diagnostic decision support that is more accurate, generalizable, and interpretable than those of previous methods and is based on heterogeneous and incomplete data. The model also serves as a new application for the use of clinical big data through artificial intelligence technology.
Aggregating multiple test results to improve medical decision-making

Lucas Böttcher,Maria R. D'Orsogna,Tom Chou

2024-09-25

Abstract:Gathering observational data for medical decision-making often involves uncertainties arising from both type I (false positive)and type II (false negative) errors. In this work, we develop a statistical model to study how medical decision-making can be improved by repeating diagnostic and screening tests, and aggregating their results. This approach is relevant not only in clinical settings, such as medical imaging, but also in public health, as highlighted by the need for rapid, cost-effective testing methods during the SARS-CoV-2pandemic. Our model enables the development of testing protocols with an arbitrary number of tests, which can be customized to meet requirements for type I and type II errors. This allows us to adjust sensitivity and specificity according to application-specific needs. Additionally, we derive generalized Rogan--Gladen estimates for estimating disease prevalence, accounting for an arbitrary number of tests with potentially different type I and type II errors. We also provide the corresponding uncertainty quantification.

Applications,Quantitative Methods
Construction and evaluation of optimal diagnostic tests with application to hepatocellular carcinoma diagnosis

Ainesh Sewak,Sandra Siegfried,Torsten Hothorn

DOI: https://doi.org/10.48550/arXiv.2402.03004

2024-02-05

Methodology

Abstract:Accurate diagnostic tests are crucial to ensure effective treatment, screening, and surveillance of diseases. However, the limited accuracy of individual biomarkers often hinders comprehensive screening. The heterogeneity of many diseases, particularly cancer, calls for the use of several biomarkers together into a composite diagnostic test. In this paper, we present a novel multivariate model that optimally combines multiple biomarkers using the likelihood ratio function. The model's parameters directly translate into computationally simple diagnostic accuracy measures. Additionally, our method allows for reliable predictions even in scenarios where specific biomarker measurements are unavailable and can guide the selection of biomarker combinations under resource constraints. We conduct simulation studies to compare the performance to popular classification and discriminant analysis methods. We utilize the approach to construct an optimal diagnostic test for hepatocellular carcinoma, a cancer type known for the absence of a single ideal marker. An accompanying R implementation is made available for reproducing all results.
Meta‐Analysis of Diagnostic Accuracy Studies With Multiple Thresholds: Comparison of Approaches in a Simulation Study

Antonia Zapf,Cornelia Frömke,Juliane Hardt,Gerta Rücker,Dina Voeltz,Annika Hoyer

DOI: https://doi.org/10.1002/bimj.202300101

IF: 1.715

2024-09-29

Biometrical Journal

Abstract:The development of methods for the meta‐analysis of diagnostic test accuracy (DTA) studies is still an active area of research. While methods for the standard case where each study reports a single pair of sensitivity and specificity are nearly routinely applied nowadays, methods to meta‐analyze receiver operating characteristic (ROC) curves are not widely used. This situation is more complex, as each primary DTA study may report on several pairs of sensitivity and specificity, each corresponding to a different threshold. In a case study published earlier, we applied a number of methods for meta‐analyzing DTA studies with multiple thresholds to a real‐world data example (Zapf et al., Biometrical Journal. 2021; 63(4): 699–711). To date, no simulation study exists that systematically compares different approaches with respect to their performance in various scenarios when the truth is known. In this article, we aim to fill this gap and present the results of a simulation study that compares three frequentist approaches for the meta‐analysis of ROC curves. We performed a systematic simulation study, motivated by an example from medical research. In the simulations, all three approaches worked partially well. The approach by Hoyer and colleagues was slightly superior in most scenarios and is recommended in practice.

mathematical & computational biology,statistics & probability
Hybrid Design Evaluating New Biomarkers when There is an Existing Screening Test

Yeonhee Park,Ying Yuan,Jing Ning,Suyu Liu,Ziding Feng

DOI: https://doi.org/10.1002/sim.8890

2021-01-01

Statistics in Medicine

Abstract:Development of cancer screening biomarkers usually follows the Early Detection Research Network 5-Phase guideline in Pepe et al. A key feature of this guide is that the phased development follows a sequential order, moving to the next phase only when the current phase study is complete and has met its target performance. Motivated by a newly funded Newly onset Diabetes cohort study, we propose a design evaluating new biomarkers to discriminate between cases and controls in the presence of an existing screening test. The proposed design achieves two goals: (1) avoiding bias in estimating sensitivity or specificity in predicting cancer at a given time period prior to clinical diagnosis, using data from both screening detected cancers in Phase IV study and clinically diagnosed cancers in Phase III study; and (2) building a panel with biomarkers for Phase III and IV studies based on all data. A simulation study shows that the proposed design outperforms both a conventional method using data in Phase III arm only and a naive method using data in Phase III and IV arms ignoring the difference between the time of screening the detected cancer and the time of clinical diagnosis. The proposed design yields a smaller standard error of the estimation and increases the statistical power to confirm biomarker performance. This proposed method has the potential to shorten the cancer screening biomarker development process, use resources more effectively, and bring benefits to patients quickly.
Optimal exact tests for multiple binary endpoints

Robin Ristl,Dong Xi,Ekkehard Glimm,Martin Posch

DOI: https://doi.org/10.1016/j.csda.2018.01.001

2016-12-22

Abstract:In confirmatory clinical trials with small sample sizes, hypothesis tests based on asymptotic distributions are often not valid and exact non-parametric procedures are applied instead. However, the latter are based on discrete test statistics and can become very conservative, even more so, if adjustments for multiple testing as the Bonferroni correction are applied. We propose improved exact multiple testing procedures for the setting where two parallel groups are compared in multiple binary endpoints. Based on the joint conditional distribution of test statistics of Fisher's exact tests, optimal rejection regions for intersection hypotheses tests are constructed. To efficiently search the large space of possible rejection regions, we propose an optimization algorithm based on constrained optimization and integer linear programming. Depending on the optimization objective, the optimal test yields maximal power under a specific alternative, maximal exhaustion of the nominal type I error rate, or the largest possible rejection region controlling the type I error rate. Applying the closed testing principle, we construct optimized multiple testing procedures with strong familywise error rate control. Furthermore, we propose a greedy algorithm for nearly optimal tests, which is computationally more efficient. We numerically compare the unconditional power of the optimized procedure with alternative approaches and illustrate the optimal tests with a clinical trial example in a rare disease.

Methodology
An one-factor copula mixed model for joint meta-analysis of multiple diagnostic tests

Aristidis K. Nikoloulopoulos

DOI: https://doi.org/10.48550/arXiv.2006.09278

2021-05-10

Abstract:As the meta-analysis of more than one diagnostic tests can impact clinical decision making and patient health, there is an increasing body of research in models and methods for meta-analysis of studies comparing multiple diagnostic tests. The application of the existing models to compare the accuracy of three or more tests suffers from the curse of multi-dimensionality, i.e., either the number of model parameters increase rapidly or high dimensional integration is required. To overcome these issues in joint meta-analysis of studies comparing $T >2$ diagnostic tests in a multiple tests design with a gold standard, we propose a model that assumes the true positives and true negatives for each test are conditionally independent and binomially distributed given the $2T$-variate latent vector of sensitivities and specificities. For the random effects distribution, we employ an one-factor copula that provides tail dependence or tail asymmetry. Maximum likelihood estimation of the model is straightforward as the derivation of the likelihood requires bi-dimensional instead of $2T$-dimensional integration. Our methodology is demonstrated with an extensive simulation study and an application example that determines which is the best test for the diagnosis of rheumatoid arthritis.

Methodology,Applications
Medical diagnostic accuracy measures: an innovative approach based on the area under predictive values curves

Hani Samawi,Jing Kersey,Jingjing Yin,Haresh Rochani

DOI: https://doi.org/10.1080/10543406.2024.2341663

2024-04-15

Journal of Biopharmaceutical Statistics

Abstract:Positive and negative estimates are commonly used by clinicians to evaluate the likelihood of a disease stage being present based on test results. The predicted values are dependent on the prevalence of the underlying illness. However, for certain diseases or clinical conditions, the prevalence is unknown or different from one region to another or from one population to another, leading to an erroneous diagnosis. This article introduces innovative post-test diagnostic precision measures for continuous tests or biomarkers based on the combined areas under the predictive value curves for all possible prevalence values. The proposed measures do not vary as a function of the prevalence of the disease. They can be used to compare different diagnostic tests and/or biomarkers' abilities for rule-in, rule-out, and overall accuracy based on the combined areas under the predictive value curves. The relationship of the proposed measures to other diagnostic accuracy measures is discussed. We illustrate the proposed measures numerically and use a real data example on breast cancer.

pharmacology & pharmacy,statistics & probability
Diagnosis of Multiple Faults: A Sensitivity Analysis

David Heckerman,Michael Shwe

DOI: https://doi.org/10.48550/arXiv.1303.1463

IF: 14.4

2013-03-06

Artificial Intelligence

Abstract:We compare the diagnostic accuracy of three diagnostic inference models: the simple Bayes model, the multimembership Bayes model, which is isomorphic to the parallel combination function in the certainty-factor model, and a model that incorporates the noisy OR-gate interaction. The comparison is done on 20 clinicopathological conference (CPC) cases from the American Journal of Medicine-challenging cases describing actual patients often with multiple disorders. We find that the distributions produced by the noisy OR model agree most closely with the gold-standard diagnoses, although substantial differences exist between the distributions and the diagnoses. In addition, we find that the multimembership Bayes model tends to significantly overestimate the posterior probabilities of diseases, whereas the simple Bayes model tends to significantly underestimate the posterior probabilities. Our results suggest that additional work to refine the noisy OR model for internal medicine will be worthwhile.
Clinical decision-making framework against over-testing based on modeling implicit evaluation criteria

Yang Yang,Hongxing Huo,Jingchi Jiang,Xuemei Sun,Yi Guan,Xitong Guo,Xiang Wan,Shengping Liu

DOI: https://doi.org/10.1016/j.jbi.2021.103823

IF: 8

2021-07-01

Journal of Biomedical Informatics

Abstract:Different statistical methods include various subjective criteria that can prevent over-testing. However, no unified framework that defines generalized objective criteria for various diseases is available to determine the appropriateness of diagnostic tests recommended by doctors. We present the clinical decision-making framework against over-testing based on modeling the implicit evaluation criteria (CDFO-MIEC). The CDFO-MIEC quantifies the subjective evaluation process using statistics-based methods to identify over-testing. Furthermore, it determines the test's appropriateness with extracted entities obtained via named entity recognition and entity alignment. More specifically, implicit evaluation criteria are defined—namely, the correlation among the diagnostic tests, symptoms, and diseases, confirmation function, and exclusion function. Additionally, four evaluation strategies are implemented by applying statistical methods, including the multi-label k-nearest neighbor and the conditional probability algorithms, to model the implicit evaluation criteria. Finally, they are combined into a classification and regression tree to make the final decision. The CDFO-MIEC also provides interpretability by decision conditions for supporting each clinical decision of over-testing. We tested the CDFO-MIEC on 2,860 clinical texts obtained from a single respiratory medicine department in China with the appropriate confirmation by physicians. The dataset was supplemented with random inappropriate tests. The proposed framework excelled against the best competing text classification methods with a Mean_F1 of 0.9167. This determined whether the appropriate and inappropriate tests were properly classified. The four evaluation strategies captured the features effectively, and they were imperative. Therefore, the proposed CDFO-MIEC is feasible because it exhibits high performance and can prevent over-testing.

medical informatics,computer science, interdisciplinary applications
A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes

Thomas PA Debray,Johanna AAG Damen,Richard D Riley,Kym Snell,Johannes B Reitsma,Lotty Hooft,Gary S Collins,Karel GM Moons

DOI: https://doi.org/10.1177/0962280218785504

IF: 2.494

2018-07-23

Statistical Methods in Medical Research

Abstract:It is widely recommended that any developed—diagnostic or prognostic—prediction model is externally validated in terms of its predictive performance measured by calibration and discrimination. When multiple validations have been performed, a systematic review followed by a formal meta-analysis helps to summarize overall performance across multiple settings, and reveals under which circumstances the model performs suboptimal (alternative poorer) and may need adjustment. We discuss how to undertake meta-analysis of the performance of prediction models with either a binary or a time-to-event outcome. We address how to deal with incomplete availability of study-specific results (performance estimates and their precision), and how to produce summary estimates of the c-statistic, the observed:expected ratio and the calibration slope. Furthermore, we discuss the implementation of frequentist and Bayesian meta-analysis methods, and propose novel empirically-based prior distributions to improve estimation of between-study heterogeneity in small samples. Finally, we illustrate all methods using two examples: meta-analysis of the predictive performance of EuroSCORE II and of the Framingham Risk Score. All examples and meta-analysis models have been implemented in our newly developed R package “metamisc”.

health care sciences & services,medical informatics,mathematical & computational biology,statistics & probability
Bayesian Multivariate Probability of Success Using Historical Data with Strict Control of Family-wise Error Rate

Ethan M. Alt,Matthew A. Psioda,Joseph G. Ibrahim

DOI: https://doi.org/10.48550/arXiv.2010.13774

2020-10-27

Abstract:Given the cost and duration of phase III and phase IV clinical trials, the development of statistical methods for go/no-go decisions is vital. In this paper, we introduce a Bayesian methodology to compute the probability of success based on the current data of a treatment regimen for the multivariate linear model. Our approach utilizes a Bayesian seemingly unrelated regression model, which allows for multiple endpoints to be modeled jointly even if the covariates between the endpoints are different. Correlations between endpoints are explicitly modeled. This Bayesian joint modeling approach unifies single and multiple testing procedures under a single framework. We develop an approach to multiple testing that asymptotically guarantees strict family-wise error rate control, and is more powerful than frequentist approaches to multiplicity. The method effectively yields those of Ibrahim et al. and Chuang-Stein as special cases, and, to our knowledge, is the only method that allows for robust sample size determination for multiple endpoints and/or hypotheses and the only method that provides strict family-wise type I error control in the presence of multiplicity.

Methodology
Diagnosis Prevalence vs. Efficacy in Machine-learning Based Diagnostic Decision Support

Gil Alon,Elizabeth Chen,Guergana Savova,Carsten Eickhoff

DOI: https://doi.org/10.48550/arXiv.2006.13737

2020-06-24

Abstract:Many recent studies use machine learning to predict a small number of ICD-9-CM codes. In practice, on the other hand, physicians have to consider a broader range of diagnoses. This study aims to put these previously incongruent evaluation settings on a more equal footing by predicting ICD-9-CM codes based on electronic health record properties and demonstrating the relationship between diagnosis prevalence and system performance. We extracted patient features from the MIMIC-III dataset for each admission. We trained and evaluated 43 different machine learning classifiers. Among this pool, the most successful classifier was a Multi-Layer Perceptron. In accordance with general machine learning expectation, we observed all classifiers' F1 scores to drop as disease prevalence decreased. Scores fell from 0.28 for the 50 most prevalent ICD-9-CM codes to 0.03 for the 1000 most prevalent ICD-9-CM codes. Statistical analyses showed a moderate positive correlation between disease prevalence and efficacy (0.5866).

Applications,Information Retrieval,Machine Learning
Extending Hui-Walter Framework to Correlated Outcomes with Application to Diagnosis Tests of an Eye Disease among Premature Infants.

Yu-Lun Liu,Gui-Shuang Ying,Graham E. Quinn,Xiao-Hua Zhou,Yong Chen

DOI: https://doi.org/10.1002/sim.9269

2021-01-01

Statistics in Medicine

Abstract:Diagnostic accuracy, a measure of diagnostic tests for correctly identifying patients with or without a target disease, plays an important role in evidence-based medicine. Diagnostic accuracy of a new test ideally should be evaluated by comparing to a gold standard; however, in many medical applications it may be invasive, costly, or even unethical to obtain a gold standard for particular diseases. When the accuracy of a new candidate test under evaluation is assessed by comparison to an imperfect reference test, bias is expected to occur and result in either overestimates or underestimates of its true accuracy. In addition, diagnostic test studies often involve repeated measurements of the same patient, such as the paired eyes or multiple teeth, and generally lead to correlated and clustered data. Using the conventional statistical methods to estimate diagnostic accuracy can be biased by ignoring the within-cluster correlations. Despite numerous statistical approaches have been proposed to tackle this problem, the methodology to deal with correlated and clustered data in the absence of a gold standard is limited. In this article, we propose a method based on the composite likelihood function to derive simple and intuitive closed-form solutions for estimates of diagnostic accuracy, in terms of sensitivity and specificity. Through simulation studies, we illustrate the relative advantages of the proposed method over the existing methods that simply treat an imperfect reference test as a gold standard in correlated and clustered data. Compared with the existing methods, the proposed method can reduce not only substantial bias, but also the computational burden. Moreover, to demonstrate the utility of this approach, we apply the proposed method to the study of National-Eye-Institute-funded Telemedicine Approaches to Evaluating of Acute-Phase Retinopathy of Prematurity (e-ROP), for estimating accuracies of both the ophthalmologist examination and the image evaluation.
Multivariate Rank-Based Analysis of Multiple Endpoints in Clinical Trials: A Global Test Approach

Kexuan Li,Lingli Yang,Shaofei Zhao,Susie Sinks,Luan Lin,Peng Sun

DOI: https://doi.org/10.48550/arXiv.2306.15380

2023-06-28

Abstract:Clinical trials often involve the assessment of multiple endpoints to comprehensively evaluate the efficacy and safety of interventions. In the work, we consider a global nonparametric testing procedure based on multivariate rank for the analysis of multiple endpoints in clinical trials. Unlike other existing approaches that rely on pairwise comparisons for each individual endpoint, the proposed method directly incorporates the multivariate ranks of the observations. By considering the joint ranking of all endpoints, the proposed approach provides robustness against diverse data distributions and censoring mechanisms commonly encountered in clinical trials. Through extensive simulations, we demonstrate the superior performance of the multivariate rank-based approach in controlling type I error and achieving higher power compared to existing rank-based methods. The simulations illustrate the advantages of leveraging multivariate ranks and highlight the robustness of the approach in various settings. The proposed method offers an effective tool for the analysis of multiple endpoints in clinical trials, enhancing the reliability and efficiency of outcome evaluations.

Methodology,Other Statistics
A Fast Algorithm Based on SRFFT for Length N = q × 2 m DFTs

Weihua Zheng,Kenli Li,Keqin Li

Abstract:In this brief, we present a fast algorithm for computing length-q × 2 discrete Fourier transforms (DFT). The algorithm divides a DFT of size-N = q × 2 decimation in frequency into one length-N/2 DFT and two length-N/4 DFTs. The length-N/2 sub-DFT is recursively decomposed decimation in frequency, and the two size-N/4 sub-DFTs are transformed into two dimension and the terms with the same rotating factor are arranged in a column. Thus, the scaled DFTs (SDFTs) are obtained, simplifying the real multiplications of the proposed algorithm. A further improvement can be achieved by the application of radix-2/8, modified split-radix FFT (MSRFFT), and Wang’s algorithm for computing its length-2 and length-q sub-DFTs. Compared with the related algorithms, a substantial reduction of arithmetic complexity and more accurate precision are obtained.
Comparisons of methods for multiple hypothesis testing in neuropsychological research.

Richard E. Blakesley,Sati Mazumdar,Mary Amanda Dew,Patricia R. Houck,Gong Tang,Charles F. Reynolds,Meryl A. Butters

DOI: https://doi.org/10.1037/a0012850

IF: 3.424

2009-03-01

Neuropsychology

Abstract:Hypothesis testing with multiple outcomes requires adjustments to control Type I error inflation, which reduces power to detect significant differences. Maintaining the prechosen Type I error level is challenging when outcomes are correlated. This problem concerns many research areas, including neuropsychological research in which multiple, interrelated assessment measures are common. Standard p value adjustment methods include Bonferroni-, Sidak-, and resampling-class methods. In this report, the authors aimed to develop a multiple hypothesis testing strategy to maximize power while controlling Type I error. The authors conducted a sensitivity analysis, using a neuropsychological dataset, to offer a relative comparison of the methods and a simulation study to compare the robustness of the methods with respect to varying patterns and magnitudes of correlation between outcomes. The results lead them to recommend the Hochberg and Hommel methods (step-up modifications of the Bonferroni method) for mildly correlated outcomes and the step-down minP method (a resampling-based method) for highly correlated outcomes. The authors note caveats regarding the implementation of these methods using available software.

psychology, clinical,neurosciences
Optimality of testing procedures for survival data

Andrea Arfé,Brian Alexander,Lorenzo Trippa

DOI: https://doi.org/10.48550/arXiv.1902.00161

2020-05-27

Abstract:Most statistical tests for treatment effects used in randomized clinical trials with survival outcomes are based on the proportional hazards assumption, which often fails in practice. Data from early exploratory studies may provide evidence of non-proportional hazards which can guide the choice of alternative tests in the design of practice-changing confirmatory trials. We study a test to detect treatment effects in a late-stage trial which accounts for the deviations from proportional hazards suggested by early-stage data. Conditional on early-stage data, among all tests which control the frequentist Type I error rate at a fixed $\alpha$ level, our testing procedure maximizes the Bayesian prediction of the finite-sample power. Hence, the proposed test provides a useful benchmark for other tests commonly used in presence of non-proportional hazards, for example weighted log-rank tests. We illustrate the approach in a simulations based on data from a published cancer immunotherapy phase III trial.

Statistics Theory,Methodology
Statistical Methods for Comparing Predictive Values in Medical Diagnosis

Chanrim Park,Seo Young Park,Hwa Jung Kim,Hee Jung Shin

DOI: https://doi.org/10.3348/kjr.2024.0049

Abstract:Evaluating the performance of a binary diagnostic test, including artificial intelligence classification algorithms, involves measuring sensitivity, specificity, positive predictive value, and negative predictive value. Particularly when comparing the performance of two diagnostic tests applied on the same set of patients, these metrics are crucial for identifying the more accurate test. However, comparing predictive values presents statistical challenges because their denominators depend on the test outcomes, unlike the comparison of sensitivities and specificities. This paper reviews existing methods for comparing predictive values and proposes using the permutation test. The permutation test is an intuitive, non-parametric method suitable for datasets with small sample sizes. We demonstrate each method using a dataset from MRI and combined modality of mammography and ultrasound in diagnosing breast cancer.

Exon-intron structure of the LY6G6D gene

Statistical inference for diagnostic test accuracy studies with multiple comparisons

A Patient-Similarity-based Model for Diagnostic Prediction

Aggregating multiple test results to improve medical decision-making

Construction and evaluation of optimal diagnostic tests with application to hepatocellular carcinoma diagnosis

Meta‐Analysis of Diagnostic Accuracy Studies With Multiple Thresholds: Comparison of Approaches in a Simulation Study

Hybrid Design Evaluating New Biomarkers when There is an Existing Screening Test

Optimal exact tests for multiple binary endpoints

An one-factor copula mixed model for joint meta-analysis of multiple diagnostic tests

Medical diagnostic accuracy measures: an innovative approach based on the area under predictive values curves

Diagnosis of Multiple Faults: A Sensitivity Analysis

Clinical decision-making framework against over-testing based on modeling implicit evaluation criteria

A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes

Bayesian Multivariate Probability of Success Using Historical Data with Strict Control of Family-wise Error Rate

Diagnosis Prevalence vs. Efficacy in Machine-learning Based Diagnostic Decision Support

Extending Hui-Walter Framework to Correlated Outcomes with Application to Diagnosis Tests of an Eye Disease among Premature Infants.

Multivariate Rank-Based Analysis of Multiple Endpoints in Clinical Trials: A Global Test Approach

A Fast Algorithm Based on SRFFT for Length N = q × 2 m DFTs

Comparisons of methods for multiple hypothesis testing in neuropsychological research.

Optimality of testing procedures for survival data

Statistical Methods for Comparing Predictive Values in Medical Diagnosis