DomBERT: Domain-oriented Language Model for Aspect-based Sentiment Analysis

Hu Xu,Bing Liu,Lei Shu,Philip S. Yu
DOI: https://doi.org/10.48550/arXiv.2004.13816
2020-04-28
Computation and Language
Abstract:This paper focuses on learning domain-oriented language models driven by end tasks, which aims to combine the worlds of both general-purpose language models (such as ELMo and BERT) and domain-specific language understanding. We propose DomBERT, an extension of BERT to learn from both in-domain corpus and relevant domain corpora. This helps in learning domain language models with low-resources. Experiments are conducted on an assortment of tasks in aspect-based sentiment analysis, demonstrating promising results.
What problem does this paper attempt to address?