Abstract:Scientist learn early on how to cite scientific sources to support their claims. Sometimes, however, scientists have challenges determining where a citation should be situated -- or, even worse, fail to cite a source altogether. Automatically detecting sentences that need a citation (i.e., citation worthiness) could solve both of these issues, leading to more robust and well-constructed scientific arguments. Previous researchers have applied machine learning to this task but have used small datasets and models that do not take advantage of recent algorithmic developments such as attention mechanisms in deep learning. We hypothesize that we can develop significantly accurate deep learning architectures that learn from large supervised datasets constructed from open access publications. In this work, we propose a Bidirectional Long Short-Term Memory (BiLSTM) network with attention mechanism and contextual information to detect sentences that need citations. We also produce a new, large dataset (PMOA-CITE) based on PubMed Open Access Subset, which is orders of magnitude larger than previous datasets. Our experiments show that our architecture achieves state of the art performance on the standard ACL-ARC dataset ($F_{1}=0.507$) and exhibits high performance ($F_{1}=0.856$) on the new PMOA-CITE. Moreover, we show that it can transfer learning across these datasets. We further use interpretable models to illuminate how specific language is used to promote and inhibit citations. We discover that sections and surrounding sentences are crucial for our improved predictions. We further examined purported mispredictions of the model, and uncovered systematic human mistakes in citation behavior and source data. This opens the door for our model to check documents during pre-submission and pre-archival procedures. We make this new dataset, the code, and a web-based tool available to the community.

Micropublications: a Semantic Model for Claims, Evidence, Arguments and Annotations in Biomedical Communications

A Unified Nanopublication Model for Effective and User-Friendly Access to the Elements of Scientific Publishing

Broadening the Scope of Nanopublications

Underspecified Scientific Claims in Nanopublications

Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments

Automatically Annotating Articles Towards Opening and Reusing Transparent Peer Reviews

microPublication Biology: An introduction to Publishing and Teaching with a Small-Format, Peer-Reviewed Journal

Assessing citation integrity in biomedical publications: corpus annotation and NLP models

Comparisonand analysis of enhanced publication models

Publishing Life Science Data as Linked Open Data: the Case Study of miRBase

A perspective on Microscopy Metadata: data provenance and quality control

The Representation of Argumentation in Scientific Papers: A Comparative Analysis of Two Research Areas

Argument Structure Mining in Scientific Articles: A Comparative Analysis

BibSonomy Meets ChatLLMs for Publication Management: From Chat to Publication Management: Organizing your related work using BibSonomy & LLMs

Encoding Models for Scholarly Literature

Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models

Rich Semantic Models and Knowledgebases for Highly-Structured Scientific Communication

Simplifying Scholarly Abstracts for Accessible Digital Libraries

Decoding Knowledge Claims: The Evaluation of Scientific Publication Contributions through Semantic Analysis

Argument ontology for describing scientific articles: A statistical study based on articles from two research areas

OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs