Abstract:Document embeddings and similarity measures underpin content-based recommender systems, whereby a document is commonly represented as a single generic embedding. However, similarity computed on single vector representations provides only one perspective on document similarity that ignores which aspects make two documents alike. To address this limitation, aspect-based similarity measures have been developed using document segmentation or pairwise multi-class document classification. While segmentation harms the document coherence, the pairwise classification approach scales poorly to large scale corpora. In this paper, we treat aspect-based similarity as a classical vector similarity problem in aspect-specific embedding spaces. We represent a document not as a single generic embedding but as multiple specialized embeddings. Our approach avoids document segmentation and scales linearly <a class="link-external link-http" href="http://w.r.t.the" rel="external noopener nofollow">this http URL</a> corpus size. In an empirical study, we use the Papers with Code corpus containing 157,606 research papers and consider the task, method, and dataset of the respective research papers as their aspects. We compare and analyze three generic document embeddings, six specialized document embeddings and a pairwise classification baseline in the context of research paper recommendations. As generic document embeddings, we consider FastText, SciBERT, and SPECTER. To compute the specialized document embeddings, we compare three alternative methods inspired by retrofitting, fine-tuning, and Siamese networks. In our experiments, Siamese SciBERT achieved the highest scores. Additional analyses indicate an implicit bias of the generic document embeddings towards the dataset aspect and against the method aspect of each research paper. Our approach of aspect-based document embeddings mitigates potential risks arising from implicit biases by making them explicit.

Comprehensive analysis of aspect term extraction methods using various text embeddings

Dual Edge-embedding Graph Convolutional Network for Unified Aspect-based Sentiment Analysis

Aspect-based Sentiment Analysis with Enhanced Aspect-Sensitive Word Embeddings

A span-based model for aspect terms extraction and aspect sentiment classification

Method for Aspect-Based Sentiment Annotation Using Rhetorical Analysis

Research on Aspect-Level Sentiment Analysis Based on Adversarial Training and Dependency Parsing

ATE-SPD: simultaneous extraction of aspect-term and aspect sentiment polarity using Bi-LSTM-CRF neural network

Context-aware Embedding for Targeted Aspect-based Sentiment Analysis

Aspect Term Extraction Based on BiLSTM-CRF Model

Ensemble BiLSTM: A Novel Approach for Aspect Extraction From Online Text

Aspect-Pair Supervised Contrastive Learning for aspect-based sentiment analysis

Aspect-Level Sentiment Analysis Based on Lite Bidirectional Encoder Representations From Transformers and Graph Attention Networks

Simple Unsupervised Similarity-Based Aspect Extraction

Aspect Term Extraction with History Attention and Selective Transformation

Learning Latent Opinions for Aspect-level Sentiment Classification

Aspect-based Sentiment Analysis Model Based on Multi-hop Information

A Novel Aspect-Guided Deep Transition Model for Aspect Based Sentiment Analysis

Aspect term extraction via adaptive fusion of sequential and hierarchical representation

Specialized Document Embeddings for Aspect-based Similarity of Research Papers

Enhancing aspect and opinion terms semantic relation for aspect sentiment triplet extraction

An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis