Abstract:Structural magnetic resonance imaging (sMRI) has shown great clinical value and has been widely used in deep learning (DL) based computer-aided brain disease diagnosis. Previous approaches focused on local shapes and textures in sMRI that may be significant only within a particular domain. The learned representations are likely to contain spurious information and have a poor generalization ability in other diseases and datasets. To facilitate capturing meaningful and robust features, it is necessary to first comprehensively understand the intrinsic pattern of the brain that is not restricted within a single data/task domain. Considering that the brain is a complex connectome of interlinked neurons, the connectional properties in the brain have strong biological significance, which is shared across multiple domains and covers most pathological information. In this work, we propose a connectional style contextual representation learning model (CS-CRL) to capture the intrinsic pattern of the brain, used for multiple brain disease diagnosis. Specifically, it has a vision transformer (ViT) encoder and leverages mask reconstruction as the proxy task and Gram matrices to guide the representation of connectional information. It facilitates the capture of global context and the aggregation of features with biological plausibility. The results indicate that CS-CRL achieves superior accuracy in multiple brain disease diagnosis tasks across six datasets and three diseases and outperforms state-of-the-art models. Furthermore, we demonstrate that CS-CRL captures more brain-network-like properties, better aggregates features, is easier to optimize and is more robust to noise, which explains its superiority in theory. Our source code will be released soon.

ContextCare: Incorporating Contextual Information Networks to Representation Learning on Medical Forum Data.

Co-occurrence ( regularization ) Evolution ( regularization ) Diagnosis ( main term ) Sparse ! Latent Feature Latent Feature = regularization regularization

Structural and Textual Information Fusion for Symptom and Disease Representation Learning

ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context

Modeling Context-aware Features for Cognitive Diagnosis in Student Learning

Learning contextual representations with copula function for medical image segmentation

Connectional-Style-Guided Contextual Representation Learning for Brain Disease Diagnosis

An Improved Heterogeneous Graph Convolutional Network for Inter-Relational Medicine Representation Learning

Distributed learning from multiple EHR databases: Contextual embedding models for medical events

Context-Aware Health Event Prediction via Transition Functions on Dynamic Disease Graphs

MedFACT: Modeling Medical Feature Correlations in Patient Health Representation Learning via Feature Clustering

Learning Representations from Local to Global for Fine-grained Patient Similarity Measuring in Intensive Care Unit.

Disease Inference from Health-Related Questions via Sparse Deep Learning

Multi-relational EHR representation learning with infusing information of Diagnosis and Medication

Context-aware and Time-aware Attention-based Model for Disease Risk Prediction with Interpretability

Online Disease Self-diagnosis with Inductive Heterogeneous Graph Convolutional Networks

VecoCare: Visit Sequences-Clinical Notes Joint Learning for Diagnosis Prediction in Healthcare Data

Recognition of Hotspot Words for Disease Symptoms Incorporating Contextual Weight and Co-Occurrence Degree

AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibration

Combining Context and Knowledge Representations for Chemical-Disease Relation Extraction