Abstract:Implied semantics is a complex language act that can appear everywhere on the Cyberspace. The prevalence of implied spam texts, such as implied pornography, sarcasm, and abuse hidden within the novel, tweet, microblog, or review, can be extremely harmful to the physical and mental health of teenagers. The non-literal interpretation of the implied text is hard to be understood by machine models due to its high context-sensitivity and heavy usage of figurative language. In this study, inspired by human reading comprehension, we propose a novel, simple, and effective deep neural framework, called Skim and Intensive Reading Model (SIRM), for figuring out implied textual meaning. The proposed SIRM consists of three main components, namely the skim reading component, intensive reading component, and adversarial training component. N-gram features are quickly extracted from the skim reading component, which is a combination of several convolutional neural networks, as skim (entire) information. An intensive reading component enables a hierarchical investigation for both sentence-level and paragraph-level representation, which encapsulates the current (local) embedding and the contextual information (context) with a dense connection. More specifically, the contextual information includes the near-neighbor information and the skim information mentioned above. Finally, besides the common training loss function, we employ an adversarial loss function as a penalty over the skim reading component to eliminate noisy information (noise) arisen from special figurative words in the training data. To verify the effectiveness, robustness, and efficiency of the proposed architecture, we conduct extensive comparative experiments on an industrial novel dataset involving implied pornography and three sarcasm benchmarks. Experimental results indicate that (1) the proposed model, which benefits from context and local modeling and consideration of figurative language (noise), outperforms existing state-of-the-art solutions, with comparable parameter scale and running speed; (2) the SIRM yields superior robustness in terms of parameter size sensitivity; (3) compared with ablation and addition variants of the SIRM, the final framework is efficient enough.

A Semantic-Based Approach To Building Auxiliary System For Screen-Based Reading

Cross-Reading by Leveraging a Hybrid Index of Heterogeneous Information.

The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces

Scientific Information Understanding Via Open Educational Resources (OER).

Think Beyond the Word: Understanding the Implied Textual Meaning by Digesting Context, Local, and Noise

A Framework for Structured Semantic Representation Capable of Active Sensing and Interpretable Inference: A Cancer Prognostic Analysis Case Study

Read Beyond the Lines: Understanding the Implied Textual Meaning via a Skim and Intensive Reading Model

Academic Reading under a Semantic Enhancement Environment: an Empirical Study on Users' Cognitive Load and Reading Effect

Semantic Analysis For Enhanced Medical Retrieval

Understanding the Semantics in Reference Linkages: an Ontological Approach for Scientific Digital Libraries

Variabletypography: artificial intelligence augmented reading experience

Design and implementation of bilingual digital reader based on artificial intelligence and big data technology

Gaze-Based Annotations For Reading Comprehension

HiText: Text Reading with Dynamic Salience Marking.

Revealing the Importance of Semantic Retrieval for Machine Reading at Scale

A semantic analyzing method in the field of technological literature

A Semantics Enabled Intelligent Semi-structured Document Processor

A Rule-Based Information Extraction System for Human-Readable Semi-Structured Scientific Documents

Bridging Research and Readers: A Multi-Modal Automated Academic Papers Interpretation System

SemBRS: A Semantic Analysis Based Book Retrieval Approach.

Searching Semantic Web Documents Based on RDF Sentences