Abstract:Objective: To automatically create large labeled training datasets and reduce the efforts of feature engineering for training accurate machine learning models for clinical information extraction. Materials and Methods: We propose a distant supervision paradigm empowered by deep representation for extracting information from clinical text. In this paradigm, the rule-based NLP algorithms are utilized to generate weak labels and create large training datasets automatically. Additionally, we use pre-trained word embeddings as deep representation to eliminate the need of task-specific feature engineering for machine learning. We evaluated the effectiveness of the proposed paradigm on two clinical information extraction tasks: smoking status extraction and proximal femur (hip) fracture extraction. We tested three prevalent machine learning models, namely, Convolutional Neural Networks (CNN), Support Vector Machine (SVM), and Random Forrest (RF). Results: The results indicate that CNN is the best fit to the proposed distant supervision paradigm. It outperforms the rule-based NLP algorithms given large datasets by capturing additional extraction patterns. We also verified the advantage of word embedding feature representation in the paradigm over term frequency-inverse document frequency (tf-idf) and topic modeling representations. Discussion: In the clinical domain, the limited amount of labeled data is always a bottleneck for applying machine learning. Additionally, the performance of machine learning approaches highly depends on task-specific feature engineering. The proposed paradigm could alleviate those problems by leveraging rule-based NLP algorithms to automatically assign weak labels and eliminating the need of task-specific feature engineering using word embedding feature representation.

Leveraging Large Data with Weak Supervision for Joint Feature and Opinion Word Extraction

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Weakly Supervised User Profile Extraction from Twitter.

Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding.

Large-scale Opinion Relation Extraction with Distantly Supervised Neural Network.

Sentiment Extraction by Leveraging Aspect-Opinion Association Structure

Representation Learning for Weakly Supervised Relation Extraction

Relation Extraction Using Supervision from Topic Knowledge of Relation Labels

A Joint Model for Sentiment Classification and Opinion Words Extraction

AOPSS: A Joint Learning Framework for Aspect-Opinion Pair Extraction As Semantic Segmentation.

A Hybrid Unsupervised Method for Aspect Term and Opinion Target Extraction

Leveraging Just a Few Keywords for Fine-Grained Aspect Detection Through Weakly Supervised Co-Training

Weakly-Supervised Deep Embedding for Product Review Sentiment Analysis

Weakly- and Semi-supervised Evidence Extraction

Robust Neural Relation Extraction Via Multi-Granularity Noises Reduction

A Deep Representation Empowered Distant Supervision Paradigm for Clinical Information Extraction

Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised

Distantly-Supervised Joint Extraction with Noise-Robust Learning

Using distant supervision to augment manually annotated data for relation extraction

Improving Distantly-Supervised Relation Extraction with Joint Label Embedding.

Opinion Extraction by Distinguishing Term Dependencies and Digging Deep Text Features