Abstract:The World Wide Web is a vast and rapidly growing repository of information. There are various kinds of objects, such as products, people, conferences, and so on, embedded in both statically and dynamically generated Web pages. Extracting the information about real-world objects is a key technique for Web mining systems. For example, the object-level search engines, such as Libra (http://libra.msra.cn) and Rexa (http://rexa.info), which help researchers find academic information like papers, conferences and researcher’s personal information, completely rely on structured Web object information. However, how to extract the object information from diverse Web pages is a challenging problem. Traditional methods are mainly template-dependent and thus not scalable to the huge number of Web pages. Furthermore, many methods are based on heuristic rules. So they are not robust enough. Recent developments in statistical machine learning make it possible to develop advanced statistical Web object extraction models. One key difference of Web object extraction from traditional information extraction from natural language text documents is that Web pages have plenty of structure information, such as two-dimensional spatial layouts and hierarchical vision tree representation. Statistical Web object extraction models can effectively leverage this information with properly designed statistical models. Another challenge of Web object extraction is that many text contents on Web pages are not regular natural language sentences. They have some structures but are lack of natural language grammars. Thus, existing natural language processing (NLP) techniques are not directly applicable. Fortunately, statistical Web object extraction models can easily merge with statistical NLP methods which have been the theme in the field of natural language processing during the last decades. Thus, the structure information on Web pages can be leveraged to help process text contents, and traditional NLP methods can be used to extract more features. Finally, the Web object extraction from diverse and large-scale Web pages provides a valuable and challenging problem for machine learning researchers. To nicely solve the problem, new learning methodology and new models (Zhu et al., 2007b) have to be developed.

Network-theoretic information extraction quality assessment in the human trafficking domain

Information Extraction in Illicit Web Domains

Extracting Novel Features for E-Commerce Page Quality Classification.

Extracting Novel Features for E-Commerce Page Quality Classification

IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisements

Combatting Human Trafficking in the Cyberspace: A Natural Language Processing-Based Methodology to Analyze the Language in Online Advertisements

FlagIt: A System for Minimally Supervised Human Trafficking Indicator Mining

A Transdisciplinary Approach for Generating Synthetic but Realistic Domestic Sex Trafficking Networks

On the Challenges of Creating Datasets for Analyzing Commercial Sex Advertisements to Assess Human Trafficking Risk and Organized Activity

Natural Language-based Integration of Online Review Datasets for Identification of Sex Trafficking Businesses

Identifying kidney trade networks using web scraping data

Distilling Meta Knowledge on Heterogeneous Graph for Illicit Drug Trafficker Detection on Social Media

Always Lurking: Understanding and Mitigating Bias in Online Human Trafficking Detection

Statistical Web Object Extraction

Tracing the Unseen: Uncovering Human Trafficking Patterns in Job Listings

The one comparing narrative social network extraction techniques

Combating Human Trafficking with Deep Multimodal Models

Network Intell: Enabling the Non-Expert Analysis of Large Volumes of Intercepted Network Traffic

Sex Trafficking Detection with Ordinal Regression Neural Networks

Detecting problematic transactions in a consumer-to-consumer e-commerce network

Ethics and Efficacy of Unsolicited Anti-Trafficking SMS Outreach