Abstract:Incorporating data with multimodal attributes such as numerical, category and text together into decision-making information can effectively improve decision-making accuracy. The ways of construct a decision-making information system through multimodal data and its application in practice is a cutting-edge scientific problem. Based on the multimodal data decision-making information system (MDIS), neighborhood rough set (NRS), clique percolation method (CPM) and ensemble learning model, this paper proposed a general theoretical framework for solving the decision-making problems under uncertainty with the characteristics of data multimodality, nonlinearity and sample imbalance. First, MDIS was constructed based on the multimodal data consisting of numerical, category and textual attributes. Furthermore, the NRS model on MDIS was constructed by defining the distance metric method and the neighborhood object set construction method. In order to effectively obtain the valuable information in MDIS, the basic theory of NRS was systematically studied and attribute reduction was performed at the same time. For further analyzing the correlation between the objects in MDIS, CPM was used to classify the attribute-reduced objects into communities. Namely, the objects were clustered. Finally, seven machine learning classifiers and soft voting ensemble learning models were constructed based on support vector machines, K -nearest neighbors, decision trees and naive bayes, so as to make decisions about the objects in different communities. In this paper, the scientific validity and superiority of the proposed methodology was verified. Specifically, the data of 5632 dampness syndrome patients, 151 colorectal cancer patients, and 32 rheumatoid arthritis patients in The Second Affiliated Hospital of Guangzhou University of Chinese Medicine and Guangzhou No. 11 People's Hospital were used as examples to conduct the empirical study and give consistent explanations with the real clinical practice. The main contribution of this paper is twofold. First, it proposes a theoretical framework for general decision-making problems under uncertainty characterized by data multimodality, nonlinearity, and sample imbalance. Second, it provides a reference for the general clinical decision-making problems to formulate a combined integrative medicine intervention decision.

A decision-making approach under uncertainty based on ensemble learning model with multimodal data and its application in medical diagnosis

Multi-modal Incomplete Label Information Three-Way Bidirectional Decision-Making: Applications of Disease Assessment

Double-quantitative multi-granularity kernel fuzzy rough sets model and its application in rheumatoid arthritis risk assessment

A multiperiod hybrid decision support model for medical diagnosis and treatment based on similarities and three‐way decision theory

An Approach Based on Serial Fuzzy Rough Set Based Graph Model to Solving Traditional Chinese Medicine Clinical Diagnosis Decision-Making Problem

Multi-modal and Multi-Criteria Conflict Analysis Model Based on Deep Learning and Dominance-Based Rough Sets: Application to Clinical Non-Parallel Decision Problems

Group Decision-Making Method with Incomplete Intuitionistic Fuzzy Soft Information for Medical Diagnosis Model

A hybrid diversited attribute group decision-making method based on non-additive measure entropy weight and multi-granularity generalized fuzzy rough set with application in medical diagnosis

A Novel Ensemble Learning Paradigm For Medical Diagnosis With Imbalanced Data

Data-driven intelligent decision for multimedia medical management

Medical diagnosis based on artificial intelligence and decision support system in the management of health development

A novel group decision making model based on neutrosophic sets for heart disease diagnosis

A Clinical Decision Support Framework for Heterogeneous Data Sources

An Ensemble Learning Based Framework for Traditional Chinese Medicine Data Analysis with ICD-10 Labels

A Decision Support System with Intelligent Recommendation for Multi-disciplinary Medical Treatment

Probabilistic double hierarchy linguistic Maclaurin symmetric mean-MultiCriteria Border Approximation area Comparison method for multi-criteria group decision making and its application in a selection of traditional Chinese medicine prescriptions

A Novel TODIM Method-Based Three-Way Decision Model for Medical Treatment Selection

A Novel Diversified Attribute Group Decision-Making Method over Multisource Heterogeneous Fuzzy Decision Systems with Its Application to Gout Diagnosis

Edge computing-based ensemble learning model for health care decision systems

A Preference-Approval Structure-Based Non-Additive Three-Way Group Consensus Decision-Making Approach for Medical Diagnosis

A Survey on Multimodal Data-Driven Smart Healthcare Systems: Approaches and Applications