Abstract:Based on an exponentially increasing number of academic articles, discovering and citing comprehensive and appropriate resources have become non-trivial tasks. Conventional citation recommendation methods suffer from severe information losses. For example, they do not consider the section header of the paper that the author is writing and for which they need to find a citation, the relatedness between the words in the local context (the text span that describes a citation), or the importance of each word from the local context. These shortcomings make such methods insufficient for recommending adequate citations to academic manuscripts. In this study, we propose a novel embedding-based neural network called dual attention model for citation recommendation (DACR) to recommend citations during manuscript preparation. Our method adapts the embedding of three semantic pieces of information: words in the local context, structural contexts,1 and the section on which the author is working. A neural network model is designed to maximize the similarity between the embedding of the three inputs (local context words, section headers, and structural contexts) and the target citation appearing in the context. The core of the neural network model comprises self-attention and additive attention; the former aims to capture the relatedness between the contextual words and structural context, and the latter aims to learn their importance. Recommendation experiments on real-world datasets demonstrate the effectiveness of the proposed approach. To seek explainability on DACR, particularly the two attention mechanisms, the learned weights from them are investigated to determine how the attention mechanisms interpret “relatedness” and “importance” through the learned weights. In addition, qualitative analyses were conducted to testify that DACR could find necessary citations that were not noticed by the authors in the past due to the limitations of the keyword-based searching.

Citation Forecasting with Multi-Context Attention-Aided Dependency Modeling

Patent Citation Dynamics Modeling via Multi-Attention Recurrent Networks

Citation Metadata Extraction Via Deep Neural Network-based Segment Sequence Labeling

Dynamic Topic/Citation Influence Modeling for Chronological Citation Recommendation.

Modeling Scholarly Collaboration and Temporal Dynamics in Citation Networks for Impact Prediction

Joint Model Feature Regression and Topic Learning for Global Citation Recommendation.

Citation Prediction via Influence Representation Using Temporal Graphs

Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models

Citation Count Prediction Based on Neural Hawkes Model

Dual Attention Model for Citation Recommendation

Modeling and Predicting Citation Count via Recurrent Neural Network with Long Short-Term Memory

Fine-grained citation count prediction via a transformer-based model with among-attention mechanism

Multi-Task Time Series Forecasting With Shared Attention

A LSTM Based Model for Personalized Context-Aware Citation Recommendation.

Long-term Spatio-temporal Forecasting Via Dynamic Multiple-Graph Attention

Citation count prediction: learning to estimate future citations for literature

A deep-learning based citation count prediction model with paper metadata semantic features

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

An Attentional Multi-scale Co-evolving Model for Dynamic Link Prediction

Multiplicative Attention Mechanism for Multi-horizon Time Series Forecasting

Dual Attention Model for Citation Recommendation with Analyses on Explainability of Attention Mechanisms and Qualitative Experiments