Abstract:BACKGROUND: The use of electronic medical records (EMRs) offers opportunity for clinical epidemiological research. With large EMR databases, automated analysis processes are necessary but require thorough validation before they can be routinely used.OBJECTIVE: The aim of this study was to validate a computer-assisted technique using commercially available content analysis software (SimStat-WordStat v.6 (SS/WS), Provalis Research) for mining free-text EMRs.METHODS: The dataset used for the validation process included life-long EMRs from 335 patients (17,563 rows of data), selected at random from a larger dataset (141,543 patients, ~2.6 million rows of data) and obtained from 10 equine veterinary practices in the United Kingdom. The ability of the computer-assisted technique to detect rows of data (cases) of colic, renal failure, right dorsal colitis, and non-steroidal anti-inflammatory drug (NSAID) use in the population was compared with manual classification. The first step of the computer-assisted analysis process was the definition of inclusion dictionaries to identify cases, including terms identifying a condition of interest. Words in inclusion dictionaries were selected from the list of all words in the dataset obtained in SS/WS. The second step consisted of defining an exclusion dictionary, including combinations of words to remove cases erroneously classified by the inclusion dictionary alone. The third step was the definition of a reinclusion dictionary to reinclude cases that had been erroneously classified by the exclusion dictionary. Finally, cases obtained by the exclusion dictionary were removed from cases obtained by the inclusion dictionary, and cases from the reinclusion dictionary were subsequently reincluded using Rv3.0.2 (R Foundation for Statistical Computing, Vienna, Austria). Manual analysis was performed as a separate process by a single experienced clinician reading through the dataset once and classifying each row of data based on the interpretation of the free-text notes. Validation was performed by comparison of the computer-assisted method with manual analysis, which was used as the gold standard. Sensitivity, specificity, negative predictive values (NPVs), positive predictive values (PPVs), and F values of the computer-assisted process were calculated by comparing them with the manual classification.RESULTS: Lowest sensitivity, specificity, PPVs, NPVs, and F values were 99.82% (1128/1130), 99.88% (16410/16429), 94.6% (223/239), 100.00% (16410/16412), and 99.0% (100×2×0.983×0.998/[0.983+0.998]), respectively. The computer-assisted process required few seconds to run, although an estimated 30 h were required for dictionary creation. Manual classification required approximately 80 man-hours.CONCLUSIONS: The critical step in this work is the creation of accurate and inclusive dictionaries to ensure that no potential cases are missed. It is significantly easier to remove false positive terms from a SS/WS selected subset of a large database than search that original database for potential false negatives. The benefits of using this method are proportional to the size of the dataset to be analyzed.

Development of a text mining algorithm for identifying adverse drug reactions in electronic health records

Identification of Adverse Drug Events in Chinese Clinical Narrative Text

Study of Serious Adverse Drug Reactions Using FDA-approved Drug Labeling and MedDRA

Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

Detecting Adverse Drug Event Signals from a Clinical CaseBase.

A method for systematic discovery of adverse drug events from clinical notes.

A Machine-Learning Algorithm to Optimise Automated Adverse Drug Reaction Detection from Clinical Coding

Mining Real-World Big Data to Characterize Adverse Drug Reaction Quantitatively: Mixed Methods Study

ADEPt, a semantically-enriched pipeline for extracting adverse drug events from free-text electronic health records

Language-agnostic pharmacovigilant text mining to elicit side effects from clinical notes and hospital medication records

A Comparative Study of Different Methods for Automatic Identification of Clopidogrel-Induced Bleedings in Electronic Health Records

Leveraging Food and Drug Administration Adverse Event Reports for the Automated Monitoring of Electronic Health Records in a Pediatric Hospital.

Mining Adverse Drug Reactions from Unstructured Mediums at Scale

Validation of an Improved Computer-Assisted Technique for Mining Free-Text Electronic Medical Records

Identification of risk factors for adverse drug reactions in a pharmacovigilance database

Discovering adverse drug events combining spontaneous reports with electronic medical records: a case study of conventional DMARDs and biologics for rheumatoid arthritis

Detecting Potential Serious Adverse Drug Reactions Using Sequential Pattern Mining Method

Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol

Electronic health record-based prediction models for in-hospital adverse drug event diagnosis or prognosis: a systematic review

Development and evaluation of a text analytics algorithm for automated application of national COVID-19 shielding criteria in rheumatology patients

Application of Association Rules Analysis in Mining Adverse Drug Reaction Signals