Abstract:Metabolomic data often present challenges due to high dimensionality, collinearity, and variability in metabolite concentrations. Machine learning (ML) application in metabolomic analyses is enabling the extraction of meaningful information from complex data. Bringing together domain-specific knowledge from metabolomics with explainable ML methods can refine the predictive performance and interpretability of models used in atherosclerosis research. In this work, we aimed to identify the most impactful metabolites associated with the presence of atherosclerotic cardiovascular disease (ASCVD) in cross-sectional case–control studies using explainable ML methods integrated with metabolomics domain knowledge. For this, a subset from the FLEMENGHO cohort with metabolomic data available was used as the training cohort, including 63 patients with a history of ASCVD and 52 non-smoking controls matched by age, sex, and body mass index from the same population. First, Partial Least Squares Discriminant Analysis (PLS-DA) was applied for dimensionality reduction. The selected metabolites' correlations were analyzed by considering their chemical categorization. Then, eXtreme Gradient Boosting (XGBoost) was used to identify metabolites that characterize ASCVD. Next, the selected metabolites were evaluated in an external cohort to determine their effectiveness in distinguishing between cases and controls. A total of 56 metabolites were selected for ASCVD discrimination using PLS-DA. The primary identified metabolites' superclasses included lipids, organic acids, and organic oxygen compounds. Upon integrating these metabolites with the XGBoost model, the classification yielded a test area under the curve (AUC) of 0.75. SHAP analyses ranked cholesterol, 3-methylhistidine, and glucuronic acid among the most impactful features and showed the diversity of metabolites considered for building the ASCVD discriminator. Also using XGBoost, the selected metabolites achieved an AUC of 0.93 in an independent external validation cohort. In conclusion, the combination of different metabolites has the potential to build classifiers for ASCVD. Integrating metabolite categorization within the SHAP analysis further enhanced the interpretability of the model, offering insights into metabolite-specific contributions to ASCVD risk.

Assessment of PLSDA cross validation

Gaining Confidence on Molecular Classification Through Consensus Modeling and Validation

Cross-validation in high-dimensional spaces: a lifeline for least-squares models and multi-class LDA

Shrunken centroids regularized discriminant analysis as a promising strategy for metabolomics data exploration

Cross-validation and permutations in MVPA: Validity of permutation strategies and power of cross-validation schemes

Validation of an LC-HRMS-based untargeted metabolomics analytical platform for a long-term clinical metabolomics study

Assessing Model Fit by Cross-Validation

Step Forward Cross Validation for Bioactivity Prediction: Out of Distribution Validation in Drug Discovery

External validation: a simulation study to compare cross-validation versus holdout or external testing to assess the performance of clinical prediction models using PET data from DLBCL patients

A comparative evaluation of the generalised predictive ability of eight machine learning algorithms across ten clinical metabolomics data sets for binary classification

Cross-Validation Approach to Evaluate Clustering Algorithms: An Experimental Study Using Multi-Label Datasets

External validation of machine learning models - registered models and adaptive sample splitting

A strategy for validation of variables derived from large-scale electronic health record data

Single sample pathway analysis in metabolomics: performance evaluation and application

Methods for analytical validation of novel digital clinical measures: A simulation study

Practical approaches in evaluating validation and biases of machine learning applied to mobile health studies

Classification and adaptive behavior prediction of children with autism spectrum disorder based upon multivariate data analysis of markers of oxidative stress and DNA methylation

Statistical Development and Validation of Clinical Prediction Models

Integrating Metabolomics Domain Knowledge with Explainable Machine Learning in Atherosclerotic Cardiovascular Disease Classification

Cross-Validation: A Method Every Psychologist Should Know