Abstract:BACKGROUND Artificial intelligence–based assistive diagnostic systems imitate the deductive reasoning process of a human physician in biomedical disease diagnosis and treatment decision making. While impressive progress in this area has been reported, most of the reported successes are applications of artificial intelligence in Western medicine. The application of artificial intelligence in traditional Chinese medicine has lagged mainly because traditional Chinese medicine practitioners need to perform syndrome differentiation as well as biomedical disease diagnosis before a treatment decision can be made. Syndrome, a concept unique to traditional Chinese medicine, is an abstraction of a variety of signs and symptoms. The fact that the relationship between diseases and syndromes is not one-to-one but rather many-to-many makes it very challenging for a machine to perform syndrome predictions. So far, only a handful of artificial intelligence–based assistive traditional Chinese medicine diagnostic models have been reported, and they are limited in application to a single disease-type. OBJECTIVE The objective was to develop an artificial intelligence–based assistive diagnostic system capable of diagnosing multiple types of diseases that are common in traditional Chinese medicine, given a patient’s electronic health record notes. The system was designed to simultaneously diagnose the disease and produce a list of corresponding syndromes. METHODS Unstructured freestyle electronic health record notes were processed by natural language processing techniques to extract clinical information such as signs and symptoms which were represented by named entities. Natural language processing used a recurrent neural network model called bidirectional long short-term memory network–conditional random forest. A convolutional neural network was then used to predict the disease-type out of 187 diseases in traditional Chinese medicine. A novel traditional Chinese medicine syndrome prediction method—an integrated learning model—was used to produce a corresponding list of probable syndromes. By following a majority-rule voting method, the integrated learning model for syndrome prediction can take advantage of four existing prediction methods (back propagation, random forest, extreme gradient boosting, and support vector classifier) while avoiding their respective weaknesses which resulted in a consistently high prediction accuracy. RESULTS A data set consisting of 22,984 electronic health records from Guanganmen Hospital of the China Academy of Chinese Medical Sciences that were collected between January 1, 2017 and September 7, 2018 was used. The data set contained a total of 187 diseases that are commonly diagnosed in traditional Chinese medicine. The diagnostic system was designed to be able to detect any one of the 187 disease-types. The data set was partitioned into a training set, a validation set, and a testing set in a ratio of 8:1:1. Test results suggested that the proposed system had a good diagnostic accuracy and a strong capability for generalization. The disease-type prediction accuracies of the top one, top three, and top five were 80.5%, 91.6%, and 94.2%, respectively. CONCLUSIONS The main contributions of the artificial intelligence–based traditional Chinese medicine assistive diagnostic system proposed in this paper are that 187 commonly known traditional Chinese medicine diseases can be diagnosed and a novel prediction method called an integrated learning model is demonstrated. This new prediction method outperformed all four existing methods in our preliminary experimental results. With further improvement of the algorithms and the availability of additional electronic health record data, it is expected that a wider range of traditional Chinese medicine disease-types could be diagnosed and that better diagnostic accuracies could be achieved.

[An Overview of Validation Methods Based on the Medical Claims Database].

Application and Exploration of Big Data Mining in Clinical Medicine

Big Data and Clinical Research: Focusing on the Area of Critical Care Medicine in Mainland China.

Clinical Prediction Models: Model Validation

Using 'big data' to validate claims made in the pharmaceutical approval process

PCV147 DATA QUALITY EVALUATION OF 5 MUNICIPAL AND PROVINCIAL CLAIMS DATABASES OF FUJIAN PROVINCE IN CHINA

Validation of self-reported medical condition in the Taiwan Biobank

Research on the application of statistical methods based on big data in the medical and health field

[Progress of researches on medical big data analytics technology].

Data mining in clinical big data: the frequently used databases, steps, and methodological models

Understanding traditional Chinese medicine via statistical learning of expert-specific Electronic Medical Records

Brief introduction of medical database and data mining technology in big data era

Randomized Controlled Trial Based on Big Data

Validation of an algorithm to evaluate the appropriateness of outpatient antibiotic prescribing using big data of Chinese diagnosis text

Research on Medical Big Data Mining and Intelligent Analysis for Smart Healthcare

Comparative analysis of weka-based classification algorithms on medical diagnosis datasets

Validation of algorithms in studies based on routinely collected health data: general principles

From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database

Research on an integrated community-based chronic disease management model driven by massive databases

Diabetes Risk Data Mining Method Based on Electronic Medical Record Analysis

Artificial Intelligence–Based Traditional Chinese Medicine Assistive Diagnostic System: Validation Study (Preprint)