Abstract:Medical Decision Making, Ahead of Print. BackgroundGeneral practitioners (GPs) work in an ill-defined environment where diagnostic errors are prevalent. Previous research indicates that aggregating independent diagnoses can improve diagnostic accuracy in a range of settings. We examined whether aggregating independent diagnoses can also improve diagnostic accuracy for GP decision making. In addition, we investigated the potential benefit of such an approach in combination with a decision support system (DSS).MethodsWe simulated virtual groups using data sets from 2 previously published studies. In study 1, 260 GPs independently diagnosed 9 patient cases in a vignette-based study. In study 2, 30 GPs independently diagnosed 12 patient actors in a patient-facing study. In both data sets, GPs provided diagnoses in a control condition and/or DSS condition(s). Each GP's diagnosis, confidence rating, and years of experience were entered into a computer simulation. Virtual groups of varying sizes (range: 3–9) were created, and different collective intelligence rules (plurality, confidence, and seniority) were applied to determine each group's final diagnosis. Diagnostic accuracy was used as the performance measure.ResultsAggregating independent diagnoses by weighing them equally (i.e., the plurality rule) substantially outperformed average individual accuracy, and this effect increased with increasing group size. Selecting diagnoses based on confidence only led to marginal improvements, while selecting based on seniority reduced accuracy. Combining the plurality rule with a DSS further boosted performance.DiscussionCombining independent diagnoses may substantially improve a GP's diagnostic accuracy and subsequent patient outcomes. This approach did, however, not improve accuracy in all patient cases. Therefore, future work should focus on uncovering the conditions under which collective intelligence is most beneficial in general practice.HighlightsWe examined whether aggregating independent diagnoses of GPs can improve diagnostic accuracy.Using data sets of 2 previously published studies, we composed virtual groups of GPs and combined their independent diagnoses using 3 collective intelligence rules (plurality, confidence, and seniority).Aggregating independent diagnoses by weighing them equally substantially outperformed average individual GP accuracy, and this effect increased with increasing group size.Combining independent diagnoses may substantially improve GP's diagnostic accuracy and subsequent patient outcomes.

Aggregating multiple test results to improve medical decision-making

Bayesian Updating and Sequential Testing: Overcoming Inferential Limitations of Screening Tests

A statistical model of COVID-19 testing in populations: effects of sampling bias and testing errors

A multiple testing framework for diagnostic accuracy studies with co-primary endpoints

Group Testing for SARS-CoV-2 Allows for Up to 10-Fold Efficiency Increase Across Realistic Scenarios and Testing Strategies

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Computing SARS-CoV-2 Infection Risk From Symptoms, Imaging, and Test Data: Diagnostic Model Development

Medical diagnostic accuracy measures: an innovative approach based on the area under predictive values curves

Using multiple imputation to classify potential outcomes subgroups

Examining the effect of evaluation sample size on the sensitivity and specificity of COVID-19 diagnostic tests in practice: a simulation study

A Bayesian method for synthesizing multiple diagnostic outcomes of COVID-19 tests

A Generalizable Decision-Making Framework for Selecting Onsite versus Send-out Clinical Laboratory Testing

Machine learning for optimal test admission in the presence of resource constraints

The impact of inaccurate assumptions about antibody test accuracy on the parametrisation and results of infectious disease models of epidemics

Adjusting Incidence Estimates with Laboratory Test Performances: A Pragmatic Maximum Likelihood Estimation-Based Approach

Optimal Decision Theory for Diagnostic Testing: Minimizing Indeterminate Classes with Applications to Saliva-Based SARS-CoV-2 Antibody Assays

Enhancing diagnostic accuracy in symptom-based health checkers: a comprehensive machine learning approach with clinical vignettes and benchmarking

Collective Intelligence Increases Diagnostic Accuracy in a General Practice Setting

Online algorithm for assignment of specimens to pooled or individual testing using risk models provides a practical way to increase testing capacity

Combining Biomarkers to Improve Diagnostic Accuracy in Detecting Diseases With Group‐Tested Data

Modeling and Computation of High Efficiency and Efficacy Multi-Step Batch Testing for Infectious Diseases