Abstract:Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model's performance. We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets -- BioASQ-7b, BioASQ-8b, and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability: BioADAPT-MRC is freely available as an open-source project at \url{<a class="link-external link-https" href="https://github.com/mmahbub/BioADAPT-MRC" rel="external noopener nofollow">this https URL</a>}.

BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task

BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

Adversarial Domain Adaptation for Machine Reading Comprehension

Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehension

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss

Adapting Large Language Models to Domains via Reading Comprehension

Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources

Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks

C-MADA: Unsupervised Cross-Modality Adversarial Domain Adaptation framework for medical Image Segmentation

Neural Domain Adaptation for Biomedical Question Answering

Adversarial Transfer Learning for Biomedical Named Entity Recognition

A novel multi-domain machine reading comprehension model with domain interference mitigation

Continual Domain Adaptation for Machine Reading Comprehension

Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT

Domain Adaptation for Semantic Role Labeling of Clinical Text.

Towards Medical Machine Reading Comprehension with Structural Knowledge and Plain Text.

A Robust Adversarial Training Approach to Machine Reading Comprehension

ELMo+Gated Self-attention Network Based on BiDAF for Machine Reading Comprehension

Automatic Multi-Class Cardiovascular Magnetic Resonance Image Quality Assessment using Unsupervised Domain Adaptation in Spatial and Frequency Domains