Abstract:With the emerging new technologies based on Artificial Intelligence (AI) for the generation of new and paraphrasing of existing text, the identification of genuinely written text has become an important research undertaking. Past approaches to address this issue, need a significant volume of human-labeled data. Most of the approaches used in literature are either for noisy text or for clean text. Conversations in chats, text in blogs, text messages on cell phones, text exchange on Messengers, etc., are examples of noisy text that may contain misspelled words or incomplete words. The second approach focuses on clean text, which is free from the mentioned characteristics in the noisy text. As research articles do not contain noisy data, we propose a model that focuses on clean text for the identification of paraphrases in research articles. To address the problem of paraphrase detection, this work presents a novel Bidirectional Encoder Representation from Transformers (BERT) based model with fine-tuning. For word representation, Global Vectors (Glove) embeddings and contextualized Embeddings From Language Models (ELMo) are employed in this work. Initially, the model is evaluated without performing preprocessing. Later, the preprocessing step is performed before evaluating the model. Extensive experimentations are performed to evaluate the proposed model utilizing two benchmark datasets, namely, Microsoft Research Paraphrase (MSRP) and Quora Question Pairs (Quora). A comparison of the proposed model is done with four closely related state-of-the-art works. The obtained results show that Fine-tuned BERT using ELMo embeddings with preprocessing produces promising outcomes. Paraphrase identification rates achieved on MSRP and Quora datasets are 86.51% and 94.32%, respectively, which are better than the other competing methods. The proposed solution enables the identification of paraphrased text with a higher accuracy having its application in multiple domains requiring genuinely written documents.

Bidirectional Long Short-Term Memory with Gated Relevance Network for Paraphrase Identification

Paraphrase Identification with External Memory and SRL Knowledge

A Deep Network Model for Paraphrase Detection in Short Text Messages

Document-level paraphrase generation base on attention enhanced graph LSTM

Paraphrase Generation Model Integrating Transformer Architecture, Part-of-Speech Features, and Pointer Generator Network

Chinese Semantic Role Labeling with Bidirectional Recurrent Neural Networks

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods

Integrating Linguistic Knowledge to Sentence Paraphrase Generation.

Neural Syntactic Preordering for Controlled Paraphrase Generation

Neural paraphrasing by automatically crawled and aligned sentence pairs

Implicit Discourse Relation Detection Via a Deep Architecture with Gated Relevance Network.

Identification of paraphrased text in research articles through improved embeddings and fine-tuned BERT model

Recurrent Neural Network-Based Sentence Encoder with Gated Attention for Natural Language Inference.

Cross-lingual paraphrase identification

Improving Large-scale Paraphrase Acquisition and Generation

A Chinese Text Paraphrase Detection Method Based on Dependency Tree.

Bi-LSTM Neural Networks for Chinese Grammatical Error Diagnosis.

On extended long short-term memory and dependent bidirectional recurrent neural network

RI-Match: Integrating Both Representations and Interactions for Deep Semantic Matching.

WORD EMBEDDING ATTENTION NETWORK: GENERATING WORDS BY QUERYING DISTRIBUTED WORD REPRESENTATIONS FOR PARAPHRASE GENERATION

RDR: the Recap, Deliberate, and Respond Method for Enhanced Language Understanding