Abstract:Document embeddings and similarity measures underpin content-based recommender systems, whereby a document is commonly represented as a single generic embedding. However, similarity computed on single vector representations provides only one perspective on document similarity that ignores which aspects make two documents alike. To address this limitation, aspect-based similarity measures have been developed using document segmentation or pairwise multi-class document classification. While segmentation harms the document coherence, the pairwise classification approach scales poorly to large scale corpora. In this paper, we treat aspect-based similarity as a classical vector similarity problem in aspect-specific embedding spaces. We represent a document not as a single generic embedding but as multiple specialized embeddings. Our approach avoids document segmentation and scales linearly <a class="link-external link-http" href="http://w.r.t.the" rel="external noopener nofollow">this http URL</a> corpus size. In an empirical study, we use the Papers with Code corpus containing 157,606 research papers and consider the task, method, and dataset of the respective research papers as their aspects. We compare and analyze three generic document embeddings, six specialized document embeddings and a pairwise classification baseline in the context of research paper recommendations. As generic document embeddings, we consider FastText, SciBERT, and SPECTER. To compute the specialized document embeddings, we compare three alternative methods inspired by retrofitting, fine-tuning, and Siamese networks. In our experiments, Siamese SciBERT achieved the highest scores. Additional analyses indicate an implicit bias of the generic document embeddings towards the dataset aspect and against the method aspect of each research paper. Our approach of aspect-based document embeddings mitigates potential risks arising from implicit biases by making them explicit.

Simbanex: Similarity-based Exploration of IEEE VIS Publications

EmbeddingVis: A Visual Analytics Approach to Comparative Network Embedding Inspection

CollaborationViz: Interactive Visual Exploration of Biomedical Research Collaboration Networks

Sim2vec: Node Similarity Preserving Network Embedding.

Biclusters Based Visual Exploration of Multivariate Scientific Data

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Supporting the Exploration of Semantic Features in Academic Literature using Graph-based Visualizations

Visual Exploration and Comparison of Word Embeddings.

Interactive optimization of embedding-based text similarity calculations

Multivariate Network Exploration and Presentations

Specialized Document Embeddings for Aspect-based Similarity of Research Papers

MultiVis: Content-Based Social Network Exploration through Multi-way Visual Analysis.

A Text-Embedding-based Approach to Measure Patent-to-Patent Technological Similarity -- Workflow, Code, and Applications

Network Embedding in Biomedical Data Science

Interactive Visualization of Spatial Omics Neighborhoods

A Hybrid VAE Based Network Embedding Method for Biomedical Relation Mining

VITALITY: Promoting Serendipitous Discovery of Academic Literature with Transformers & Visual Analytics

Exploring Scholarly Data by Semantic Query on Knowledge Graph Embedding Space

Bio-inspired Methods for Dynamic Network Analysis in Science Mapping

Statistical embedding: Beyond principal components

IMVis: Visual analytics for influence maximization algorithm evaluation in hypergraphs