Abstract:The estimation of text coherence is one of the most actual tasks of computer linguistics. Analysis of text coherence is widely used for writing and selection of documents. It allows clearly conveying the idea of an author to a reader. The importance of this task can be confirmed by the availability of actual works that are dedicated to solving it. Different automated methods for the estimation of text coherence are based on the methodology of machine learning. Corresponding methods are based on of formal text representation and following detection of regularities for the generation of an output result. The purpose of this work is to perform the analytic review of different automated methods for the estimation of text coherence; to justify method selection and adapt it due to the features of the Ukrainian language; to perform the experimental verification of the effectiveness of the suggested method for a Ukrainian corpus. In this paper, the comparative analysis of the methods for the estimation of coherence of English texts basing on a machine learning methodology has been performed. The expediency of application of methods that are based on trained universal models for the formalized representation of text components has been justified. The following models using neural networks with different architecture can be considered: recurrent and convolutional networks. These types of networks are widely used for text processing because they allow processing input data with an unfixed structure like sentences or words. Despite the ability of recurrent neural networks to take into account previous data (this behavior is similar to text perception by the reader), the convolutional neural network for conducting experimental research has been chosen. Such choice has been made due to the ability of convolutional neural networks to detect relations between entities regardless of the distance between them. In this paper, the principle of the method basing on the convolutional neural network and the corresponding architecture has been described. Program application for the verification of the suggested method effectiveness has been created. Formalized representation of text elements has been performed using a previously trained model for the semantic representation of words; the training process of this model has been implemented on the corpus of Ukrainian scientific abstracts. The training of the formed networks using pre-trained model has been performed. Experimental verification of method effectiveness for solving of document discrimination task and insert task has been made on the set of scientific articles. The results obtained may indicate that the method using convolutional neural networks can be used for further estimation of coherence of Ukrainian texts.

Assessment of text coherence based on the cohesion estimation

Text Coherence Analysis Based on Deep Neural Network.

Semantic Coherence Analysis of English Texts Based on Sentence Semantic Graphs

The Cohesion and Coherence in Analysis of Russion Texts

LATENT SEMANTIC ANALYSIS BASED TEXT COHERENCE ANALYSIS

METHOD FOR COHERECE EVALUATION OF UKRAINIAN TEXTS USING CONVO-LUTIONAL NEURAL NETWORK

A Study on Application of Textual Cohesion and Coherence in Teaching and Learning Russian Writing

A Study on Text Cohesion in Senior High Students’ Continuation Writing Based on Coh-Metrix

A Novel Computational and Modeling Foundation for Automatic Coherence Assessment

BBScore: A Brownian Bridge Based Metric for Assessing Text Coherence

A Graph-based Readability Assessment Method Using Word Coupling.

Assessing Cohesion In Integrated Writing: An Interactive Alignment Perspective

Analysis of Cohesion and Coherence of Written Products by Reading Performance and Developmental Levels

The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion

On Textual Coherence from the View of Relevance Theory

Evaluating Text Coherence at Sentence and Paragraph Levels.

GRAW+: A Two‐view Graph Propagation Method with Word Coupling for Readability Assessment

On Improving Text Generation Via Integrating Text Coherence

Cohesion and Coherence for Poetry Interpretation and Translation

TextCohesion: Detecting Text for Arbitrary Shapes

A study on the cohesion of English text message