Hierarchical Neyman-Pearson Classification for Prioritizing Severe Disease Categories in COVID-19 Patient Data

Lijia Wang,Y. X. Rachel Wang,Jingyi Jessica Li,Xin Tong

2023-09-29

Abstract:COVID-19 has a spectrum of disease severity, ranging from asymptomatic to requiring hospitalization. Understanding the mechanisms driving disease severity is crucial for developing effective treatments and reducing mortality rates. One way to gain such understanding is using a multi-class classification framework, in which patients' biological features are used to predict patients' severity classes. In this severity classification problem, it is beneficial to prioritize the identification of more severe classes and control the "under-classification" errors, in which patients are misclassified into less severe categories. The Neyman-Pearson (NP) classification paradigm has been developed to prioritize the designated type of error. However, current NP procedures are either for binary classification or do not provide high probability controls on the prioritized errors in multi-class classification. Here, we propose a hierarchical NP (H-NP) framework and an umbrella algorithm that generally adapts to popular classification methods and controls the under-classification errors with high probability. On an integrated collection of single-cell RNA-seq (scRNA-seq) datasets for 864 patients, we explore ways of featurization and demonstrate the efficacy of the H-NP algorithm in controlling the under-classification errors regardless of featurization. Beyond COVID-19 severity classification, the H-NP algorithm generally applies to multi-class classification problems, where classes have a priority order.

Machine Learning,Applications

What problem does this paper attempt to address?

The paper attempts to address the issue of prioritizing the identification of severe categories in multi-class classification problems within COVID-19 patient data, while controlling for "underestimation errors" (i.e., misclassifying severe patients as mild or healthy). Specifically:

- **Research Background**: The severity of COVID-19 ranges from asymptomatic to requiring hospitalization. Understanding the mechanisms that lead to disease severity is crucial for developing effective treatment plans and reducing mortality rates. One approach is to use a multi-class classification framework to predict the severity category based on patients' biological characteristics.

- **Limitations of Existing Methods**: Existing Neyman-Pearson (NP) classification paradigms are primarily used for binary classification problems or fail to provide high-probability error control in multi-class classification.

- **Proposed New Method**: The paper proposes a hierarchical Neyman-Pearson (H-NP) framework and an umbrella algorithm that can adapt to various popular classification methods and control "underestimation errors" with high probability. This method is not only applicable to COVID-19 severity classification but can also be applied to other multi-class classification problems with priority order.

- **Data Processing and Feature Extraction**: The paper uses single-cell RNA sequencing (scRNA-seq) datasets and explores four different feature extraction methods. These datasets include peripheral blood mononuclear cell (PBMC) expression matrices from 864 patients. The paper demonstrates the effectiveness of the H-NP algorithm under different feature extraction methods.

Through the above methods, the paper aims to address the issue of insufficient identification of severe patients in existing classification algorithms for multi-class classification and provides a new framework to improve classification accuracy.