Abstract:Automatic detection of concealed plagiarism in the form of paraphrases is a difficult task, and finding a successful unsupervised approach for paraphrase detection is necessary as a precondition to change that. This comparative study identified the most efficient methods for unsupervised paraphrased document detection using similarity measures alone or combined with Deep Learning (DL) models. It proved the hypothesis that some DL models are more successful than the best statistically‐based methods in that task. Many experiments were carried out, and their results were compared. The text similarities between documents are obtained from 60 different methods using five paraphrase corpora, including the new one made by authors, as an important original contribution. Some DL models achieved significantly better results than those obtained by the best statistical methods, especially pre‐trained transformer‐based language models with average values of Accuracy and F1 of 85.8% and 88.3%, respectively, with top values of 99.9% and 98.4% for Accuracy and F1 on some corpora. These results are even better than those of supervised and combined approaches. Therefore, here presented results prove that detecting concealed plagiarism becomes an attainable goal. This study highlighted those language models with the best overall results for paraphrase detection as best suited for further research. The study also discussed the choice of similarity/distance measure paired with embeddings produced by DL models and some advantages of using cosine similarity as the fastest measure. For 60 different methods, complexity has been defined in O notation. Times needed for their implementation have also been presented. The article's results and conclusions are a firm base for future semantic similarity, paraphrasing, and plagiarism detection studies, clearly marking state‐of‐the‐art tools and methods.

Paraphrase Identification Based on Weighted URAE, Unit Similarity and Context Correlation Feature.

Convolution Neural Network Based Syntactic and Semantic Aware Paraphrase Identification.

Paraphrase Identification Based on ResNeXt

Paraphrase Recognition Via Combination of Neural Classifier and Keywords

Paraphrase Detection with Dependency Embedding

A Deep Network Model for Paraphrase Detection in Short Text Messages

Character-Aware Convolutional Neural Networks for Paraphrase Identification.

A Chinese Text Paraphrase Detection Method Based on Dependency Tree.

Ercnn: Enhanced Recurrent Convolutional Neural Networks For Learning Sentence Similarity

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods

WORD EMBEDDING ATTENTION NETWORK: GENERATING WORDS BY QUERYING DISTRIBUTED WORD REPRESENTATIONS FOR PARAPHRASE GENERATION

ECNU: Leveraging Word Embeddings to Boost Performance for Paraphrase in Twitter.

Automatic Acquisition of Context-Specific Lexical Paraphrases

Enhanced-RCNN: an Efficient Method for Learning Sentence Similarity.

Towards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence Encoders

Intention-Aware Neural Networks for Question Paraphrase Identification

Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

Detecting Document-level Paraphrased Machine Generated Content: Mimicking Human Writing Style and Involving Discourse Features

Bidirectional Long Short-Term Memory with Gated Relevance Network for Paraphrase Identification

Identifying Machine-Paraphrased Plagiarism

Comparison study of unsupervised paraphrase detection: Deep learning—The key for semantic similarity detection