Abstract:Objective: To automatically create large labeled training datasets and reduce the efforts of feature engineering for training accurate machine learning models for clinical information extraction. Materials and Methods: We propose a distant supervision paradigm empowered by deep representation for extracting information from clinical text. In this paradigm, the rule-based NLP algorithms are utilized to generate weak labels and create large training datasets automatically. Additionally, we use pre-trained word embeddings as deep representation to eliminate the need of task-specific feature engineering for machine learning. We evaluated the effectiveness of the proposed paradigm on two clinical information extraction tasks: smoking status extraction and proximal femur (hip) fracture extraction. We tested three prevalent machine learning models, namely, Convolutional Neural Networks (CNN), Support Vector Machine (SVM), and Random Forrest (RF). Results: The results indicate that CNN is the best fit to the proposed distant supervision paradigm. It outperforms the rule-based NLP algorithms given large datasets by capturing additional extraction patterns. We also verified the advantage of word embedding feature representation in the paradigm over term frequency-inverse document frequency (tf-idf) and topic modeling representations. Discussion: In the clinical domain, the limited amount of labeled data is always a bottleneck for applying machine learning. Additionally, the performance of machine learning approaches highly depends on task-specific feature engineering. The proposed paradigm could alleviate those problems by leveraging rule-based NLP algorithms to automatically assign weak labels and eliminating the need of task-specific feature engineering using word embedding feature representation.

Using distant supervision to augment manually annotated data for relation extraction

Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding.

Distant supervision for treatment relation extraction by leveraging MeSH subheadings

Overview of Distant Supervised Relation Extraction

Augmenting Document-level Relation Extraction with Efficient Multi-Supervision

A Noise Adaptive Model for Distantly Supervised Relation Extraction

Exploring Long Tail Data in Distantly Supervised Relation Extraction

Distantly Supervised Relation Extraction Based on Residual Attention and Self Learning

A Deep Representation Empowered Distant Supervision Paradigm for Clinical Information Extraction

Extending Training Set in Distant Supervision by Ontology for Relation Extraction

Transfer Learning for Relation Extraction Via Relation-Gated Adversarial Learning

GAN Driven Semi-distant Supervision for Relation Extraction

Empower Distantly Supervised Relation Extraction with Collaborative Adversarial Training

Biomedical Relation Extraction Using Distant Supervision.

A Data-driven Approach for Noise Reduction in Distantly Supervised Biomedical Relation Extraction

Distant Supervision for Relation Extraction beyond the Sentence Boundary

From Bag of Sentences to Document: Distantly Supervised Relation Extraction via Machine Reading Comprehension

Distant Supervision for Relation Extraction with Ranking-Based Methods

Distant Supervision for Relation Extraction with Linear Attenuation Simulation and Non-IID Relevance Embedding.

EZLearn: Exploiting Organic Supervision in Large-Scale Data Annotation

Revisiting Distant Supervision for Relation Extraction