Abstract:Significance: Analyzing narratives in patients' medical records using a framework that combines natural language processing (NLP) and machine learning may help uncover the underlying patterns of patients' visual capabilities and challenges that they are facing and could be useful in analyzing big data in optometric research. Purpose: The primary goal of this study was to demonstrate the feasibility of applying a framework that combines NLP and machine learning to analyze narratives in patients' medical records. To test and validate our framework, we applied it to analyze records of low vision patients and to address two questions: Was there association between patients' narratives related to activities of daily living and the quality of their vision? Was there association between patients' narratives related to activities of daily living and their sentiments toward certain "assistive items"? Methods: Our dataset consisted of 616 records of low vision patients. From patients' complaint history, we selected multiple keywords that were related to common activities of daily living. Sentences related to each keyword were converted to numerical data using NLP techniques. Machine learning was then applied to classify the narratives related to each keyword into two categories, labeled based on different "factors of interest" (acuity, contrast sensitivity, and sentiments of patients toward certain "assistive items"). Results: Using our proposed framework, when patients' narratives related to specific keywords were used as input, our model effectively predicted the categories of different factors of interest with promising performance. For example, we found strong associations between patients' narratives and their acuity or contrast sensitivity for certain activities of daily living (e.g., "drive" in association with acuity and contrast sensitivity). Conclusions: Despite our limited dataset, our results show that the proposed framework was able to extract the semantic patterns stored in medical narratives and to predict patients' sentiments and quality of vision.

Humane Visual AI: Telling the Stories Behind a Medical Condition

Bringing Modern Machine Learning into Clinical Practice Through the Use of Intuitive Visualization and Human–Computer Interaction

Seeing Your Stories: Visualization for Narrative Medicine

Diseaseatlas: Multi-Facet Visual Analytics for Online Disease Articles

Visualizing Mental Health Insights: A Pipeline from Social Media to Chernoff Faces

Multifaceted Visual Analytics for Healthcare Applications

Towards Narrative Medical Visualization

A Visualization Tool for Navigation of Online Disease Literature

Narrative Visualization to Communicate Neurological Diseases

Medical social media analytics via ranking and big learning: An image-based disease prediction study

Data visualization in healthcare and medicine: a survey

Using natural language processing to link patients' narratives to visual capabilities and sentiments

A Two-Phase Visualization System for Continuous Human-AI Collaboration in Sequelae Analysis and Modeling

Visual Analytics of Multidimensional Oral Health Surveys: Data Mining Study

Probabilistic neural network based visual data mining for the healthcare sector

Visualization and Analysis of Wearable Health Data From COVID-19 Patients

Visualising Medical Research: Exploring the Influence of Infographics on Professional Dissemination

Do Disease Stories Need a Hero? Effects of Human Protagonists on a Narrative Visualization about Cerebral Small Vessel Disease

Leveraging Historical Medical Records as a Proxy via Multimodal Modeling and Visualization to Enrich Medical Diagnostic Learning

Situation Awareness-Oriented Patient Monitoring with Visual Patient Technology: A Qualitative Review of the Primary Research