Abstract:Scientist learn early on how to cite scientific sources to support their claims. Sometimes, however, scientists have challenges determining where a citation should be situated -- or, even worse, fail to cite a source altogether. Automatically detecting sentences that need a citation (i.e., citation worthiness) could solve both of these issues, leading to more robust and well-constructed scientific arguments. Previous researchers have applied machine learning to this task but have used small datasets and models that do not take advantage of recent algorithmic developments such as attention mechanisms in deep learning. We hypothesize that we can develop significantly accurate deep learning architectures that learn from large supervised datasets constructed from open access publications. In this work, we propose a Bidirectional Long Short-Term Memory (BiLSTM) network with attention mechanism and contextual information to detect sentences that need citations. We also produce a new, large dataset (PMOA-CITE) based on PubMed Open Access Subset, which is orders of magnitude larger than previous datasets. Our experiments show that our architecture achieves state of the art performance on the standard ACL-ARC dataset ($F_{1}=0.507$) and exhibits high performance ($F_{1}=0.856$) on the new PMOA-CITE. Moreover, we show that it can transfer learning across these datasets. We further use interpretable models to illuminate how specific language is used to promote and inhibit citations. We discover that sections and surrounding sentences are crucial for our improved predictions. We further examined purported mispredictions of the model, and uncovered systematic human mistakes in citation behavior and source data. This opens the door for our model to check documents during pre-submission and pre-archival procedures. We make this new dataset, the code, and a web-based tool available to the community.

Leveraging citation influences for Modeling scientific documents

Amplifying Scientific Paper's Abstract by Leveraging Data-Weighted Reconstruction

Dynamic Topic/Citation Influence Modeling for Chronological Citation Recommendation.

Modeling Scholarly Collaboration and Temporal Dynamics in Citation Networks for Impact Prediction

Joint Model Feature Regression and Topic Learning for Global Citation Recommendation.

Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models

Important citations identification by exploiting generative model into discriminative model

Factor Analysis on Citation, Using a Combined Latent and Logistic Regression Model

Position-Aligned translation model for citation recommendation

Important Citation Identification by Exploiting the Syntactic and Contextual Information of Citations

Scientific text citation analysis using CNN features and ensemble learning model

Hybrid Self-Optimized Clustering Model Based on Citation Links and Textual Features to Detect Research Topics.

Citation Recommendation Based on Citation Links Explanation

CitationIE: Leveraging the Citation Graph for Scientific Information Extraction

When Large Language Models Meet Citation: A Survey

Fusion of the Power from Citations: Enhance your Influence by Integrating Information from References

Modeling and Predicting Citation Count via Recurrent Neural Network with Long Short-Term Memory

CausalCite: A Causal Formulation of Paper Citations

Collaboratively Learning Latent Factors and Correlations for New Paper Influence Predication

A Weighted Method for Citation Network Community Detection

Mining and modeling linkage information from citation context for improving biomedical literature retrieval