Abstract:Abstract Background Clinical notes are unstructured text documents generated by clinicians during patient encounters, generally are annotated with International Classification of Diseases (ICD) codes, which give formatted information about the diagnosis and treatment. ICD code has shown its potentials in many fields, but manual coding is labor-intensive and error-prone, lead to researches of automatic coding. Two specific challenges of this task are (1) given an annotated clinical notes, the reasons behind specific diagnoses and treatments are implicit; (2) explainability is important for practical automatic coding method, the method should not only explain its prediction output but also have explainable internal mechanics. This study aims to develop an explainable CNN approach to address these two challenges. Method Our key idea is that for the automatic ICD coding task, the presence of informative snippets in the clinical text that correlated with each code plays an important role in the prediction of codes, and an informative snippet can be considered as a local and low-level feature. We infer that there exists a correspondence between a convolution filter and a local and low-level feature. Base on the inference, we come up with the Shallow and Wide Attention convolutional Mechanism (SWAM) to improve the CNN-based models’ ability to learn local and low-level features for each label. Results We evaluate our approach on MIMIC-III, an open-access dataset of ICU medical records. Our approach substantially outperforms previous results on top-50 medical code prediction on MIMIC-III dataset, the precision of the worst-performing 10% labels in previous works is increased from 0% to 53% on average. We attribute this improvement to SWAM, by which the wide architecture with attention mechanism gives the model ability to more extensively learn the unique features of different codes, and we prove it by an ablation experiment. Besides, we perform manual analysis of the performance imbalance between different codes, and preliminary conclude the characteristics that determine the difficulty of learning specific codes. Conclusions Our main contributions can be summarized into the following three: (1) We present local and low-level features, a.k.a. informative snippets play an important role in the automatic ICD coding task, and the informative snippets extracted from the clinical text provide explanations for each code. (2) We propose that there exists a correspondence between a convolution filter and a local and low-level feature. A combination of wide and shallow convolutional layer and attention layer can help the CNN-based models better learn local and low-level features. (3) We improved the precision of the worst-performing 10% labels from 0 to 53% on average.

SoCodeCNN: Program Source Code for Visual CNN Classification Using Computer Vision Methodology

Accurately Predicting the Location of Code Fragments in Programming Video Tutorials Using Deep Learning

Code2Image: Intelligent Code Analysis by Computer Vision Techniques and Application to Vulnerability Prediction

psc2code: Denoising Code Extraction from Programming Screencasts

Embedded Computer Vision for Object Recognition in Smart Devices for the Blind

VulCNN

VulCNN: An Image-inspired Scalable Vulnerability Detection System

Malicious Code Detection based on Image Processing Using Deep Learning

VuICNN: An Image-inspired Scalable Vulnerability Detection System

D-CNN: A New model for Generating Image Captions with Text Extraction Using Deep Learning for Visually Challenged Individuals

A hybrid data fusion approach with twin CNN architecture for enhancing image source identification in IoT environment

Learning Semantic Vector Representations of Source Code via a Siamese Neural Network

Genetic CNN

Handcrafted vs. non-handcrafted features for computer vision classification

An explainable CNN approach for medical codes prediction from clinical text

A novel approach for software vulnerability detection based on intelligent cognitive computing

Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)

A Novel Source Code Representation Approach Based on Multi-Head Attention

PIXEL TO PLATE: GENERATING RECIPES FROM FOOD IMAGES USING CNN

Feature CAM: Interpretable AI in Image Classification

DCT-CompCNN: A Novel Image Classification Network Using JPEG Compressed DCT Coefficients