Abstract:BACKGROUND:Imaging examinations, such as ultrasonography, magnetic resonance imaging and computed tomography scans, play key roles in healthcare settings. To assess and improve the quality of imaging diagnosis, we need to manually find and compare the pre-existing reports of imaging and pathology examinations which contain overlapping exam body sites from electrical medical records (EMRs). The process of retrieving those reports is time-consuming. In this paper, we propose a convolutional neural network (CNN) based method which can better utilize semantic information contained in report texts to accelerate the retrieving process.METHODS:We included 16,354 imaging and pathology report-pairs from 1926 patients who admitted to Shanghai Tongren Hospital and had ultrasonic examinations between 1st May 2017 and 31st July 2017. We adapted the CNN model to calculate the similarities among the report-pairs to identify target report-pairs with overlapping body sites, and compared the performance with other six conventional models, including keyword mapping, latent semantic analysis (LSA), latent Dirichlet allocation (LDA), Doc2Vec, Siamese long short term memory (LSTM) and a model based on named entity recognition (NER). We also utilized graph embedding method to enhance the word representation by capturing the semantic relations information from medical ontologies. Additionally, we used LIME algorithm to identify which features (or words) are decisive for the prediction results and improved the model interpretability.RESULTS:Experiment results showed that our CNN model gained significant improvement compared to all other conventional models on area under the receiver operating characteristic (AUROC), precision, recall and F1-score in our test dataset. The AUROC of our CNN models gained approximately 3-7% improvement. The AUROC of CNN model with graph-embedding and ontology based medical concept vectors was 0.8% higher than the model with randomly initialized vectors and 1.5% higher than the one with pre-trained word vectors.CONCLUSION:Our study demonstrates that CNN model with pre-trained medical concept vectors could accurately identify target report-pairs with overlapping body sites and potentially accelerate the retrieving process for imaging diagnosis quality measurement.

Proposal of a similarity measure for unified modeling language class diagram images using convolutional neural network

3D model similarity measurement with geometric feature map based on phase-encoded range image

A Novel Approach to Automated Behavioral Diagram Assessment using Label Similarity and Subgraph Edit Distance

Automatically recognizing the semantic elements from UML class diagram images

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Learning similarity for semantic images classification

The image annotation algorithm using convolutional features from intermediate layer of deep learning

High Similarity Image Recognition and Classification Algorithm Based on Convolutional Neural Network

Similarity of Neural Network Models: A Survey of Functional and Representational Measures

From Image to UML: First Results of Image Based UML Diagram Generation Using LLMs

Deep Unsupervised Learning of Visual Similarities

A New Algorithm for Context-Based Biomedical Diagram Similarity Estimation

Detection of Medical Text Semantic Similarity Based on Convolutional Neural Network.

Quality-Oriented Feature Regression for Robust Image Similarity Metric

DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration

Visualizing Deep Similarity Networks

A New Proposed Hybrid Learning Approach with Features for Extraction of Image Classification

Image-similarity-based Convolutional Neural Network for Robot Visual Relocalization

What Makes Objects Similar: A Unified Multi-Metric Learning Approach.

Similarity Measurement of Neuronal Morphology Based on Convolutional Auto-Encoder and Spatial Registration

Attributable Visual Similarity Learning