Abstract:Unsupervised readability assessment aims to evaluate the reading difficulty of text without any manually-labeled data for model training. This is a challenging task because the absence of labeled data makes it difficult for the model to understand what readability is. In this paper, we propose a novel framework to Learn a neural model from Weak Readability Signals (LWRS). Instead of relying on labeled data, LWRS utilizes a set of heuristic signals that specialize in describing text readability from different aspects to guide the model in outputting readability scores for ranking. Specifically, to effectively use multiple heuristic weak signals for model training, we build a multi-signal learning model that ranks the unlabeled texts from multiple readability-related aspects based on intra- and inter-signal learning. We also adopt the pairwise ranking paradigm to reduce the cascade coupling among partial-order pairs. Furthermore, we propose identifying the most representative signal based on the batch-level consensus distribution of all signals. This strategy helps identify the predicted signal that is most correlated with readability in the absence of ground-truth labels. We conduct experiments on three public readability assessment datasets. The experimental results demonstrate that our LWRS outperforms each heuristic signal and their combinations significantly, and can even perform comparably with some supervised methods. Additionally, our LWRS trained on one dataset can be effectively transferred to other datasets, including those in other languages, which indicates its good generalization and potential for wide application.

Enriching Word Embeddings with Domain Knowledge for Readability Assessment.

Joint Learning of Frequency and Word Embeddings for Multilingual Readability Assessment.

A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss

Examining the Effects of a Real-Time, Knowledge-Aware Tool for Academic Writing Assessment

Knowledge-Powered Deep Learning for Word Embedding

Knowledge-Guided Word Embedding Fine-Tuning Model

GRAW+: A Two‐view Graph Propagation Method with Word Coupling for Readability Assessment

From Word Embedding to Reading Embedding Using Large Language Model, EEG and Eye-tracking

KGWE: A Knowledge-guided Word Embedding Fine-tuning Model

Learning Word Embeddings for Paraphrase Scoring in Knowledge Base Based Question Answering

Unsupervised Readability Assessment Via Learning from Weak Readability Signals

An Extended Graph-Based Label Propagation Method For Readability Assessment

A Graph-based Readability Assessment Method Using Word Coupling.

Knowledge-Enhanced Ensemble Learning for Word Embeddings

An Empirical Evaluation on Word Embeddings Across Reading Comprehension

Learning Domain-Sensitive and Sentiment-Aware Word Embeddings.

Commonsense Knowledge Enhanced Embeddings for Solving Pronoun Disambiguation Problems in Winograd Schema Challenge

KNET: A General Framework for Learning Word Embedding using Morphological Knowledge

Evaluation method of word embedding by roots and affixes

Learning Chinese Word Embeddings from Character Structural Information

Fine-Grained Evaluation of Knowledge Graph Embedding Model in Knowledge Enhancement Downstream Tasks