Abstract:Implied semantics is a complex language act that can appear everywhere on the Cyberspace. The prevalence of implied spam texts, such as implied pornography, sarcasm, and abuse hidden within the novel, tweet, microblog, or review, can be extremely harmful to the physical and mental health of teenagers. The non-literal interpretation of the implied text is hard to be understood by machine models due to its high context-sensitivity and heavy usage of figurative language. In this study, inspired by human reading comprehension, we propose a novel, simple, and effective deep neural framework, called Skim and Intensive Reading Model (SIRM), for figuring out implied textual meaning. The proposed SIRM consists of three main components, namely the skim reading component, intensive reading component, and adversarial training component. N-gram features are quickly extracted from the skim reading component, which is a combination of several convolutional neural networks, as skim (entire) information. An intensive reading component enables a hierarchical investigation for both sentence-level and paragraph-level representation, which encapsulates the current (local) embedding and the contextual information (context) with a dense connection. More specifically, the contextual information includes the near-neighbor information and the skim information mentioned above. Finally, besides the common training loss function, we employ an adversarial loss function as a penalty over the skim reading component to eliminate noisy information (noise) arisen from special figurative words in the training data. To verify the effectiveness, robustness, and efficiency of the proposed architecture, we conduct extensive comparative experiments on an industrial novel dataset involving implied pornography and three sarcasm benchmarks. Experimental results indicate that (1) the proposed model, which benefits from context and local modeling and consideration of figurative language (noise), outperforms existing state-of-the-art solutions, with comparable parameter scale and running speed; (2) the SIRM yields superior robustness in terms of parameter size sensitivity; (3) compared with ablation and addition variants of the SIRM, the final framework is efficient enough.

Creating a Children-Friendly Reading Environment via Joint Learning of Content and Human Attention

Deep Neural Networks Evolve Human-like Attention Distribution during Goal-directed Reading Comprehension

Deep Neural Networks Evolve Human-like Attention Distribution during Reading Comprehension.

Think Beyond the Word: Understanding the Implied Textual Meaning by Digesting Context, Local, and Noise

Self-Attention Mechanism Enhanced User Interests Modeling for Personalized Recommendation Services in Cyber-Physical-Social Systems.

Variabletypography: artificial intelligence augmented reading experience

Human Behavior Inspired Machine Reading Comprehension

Investigating Human Reading Behavior During Sentiment Judgment

Measure Children’s Mindreading Ability with Machine Reading

Smarnet: Teaching Machines to Read and Comprehend Like Human.

Facilitating Pornographic Text Detection for Open-Domain Dialogue Systems via Knowledge Distillation of Large Language Models

Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics

CASES: A Cognition-Aware Smart Eyewear System for Understanding How People Read.

Using Behavioral Interactions from a Mobile Device to Classify the Reader's Prior Familiarity and Goal Conditions

A Lightweight Graph-based Method to Detect Pornographic and Gambling Websites with Imperfect Datasets

Optimizing Predictive Metrics for Human Reading Behavior

Attention-based Deep Learning Model for Text Readability Evaluation

An English video teaching classroom attention evaluation model incorporating multimodal information

Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education

Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classification

Cognitive Representation Learning of Self-Media Online Article Quality