Abstract:Profiling Web users is a fundamental issue for Web mining and social network analysis. Its basic tasks include extracting basic information, mining user preferences, and inferring user demographics (Tang et al. in ACM Trans Knowl Discov Data 5(1):2:1–2:44, 2010). Although methodologies for handling the three tasks are different, they all usually contain two stages: first identify relevant pages (data) of a user and then use machine learning models (e.g., SVM, CRFs, or DL) to extract/mine/infer profile attributes from each page. The methods were successful in the traditional Web, but are facing more and more challenges with the rapid evolution of the Web each persons information is distributed over the Web and is changing dynamically. As a result, available data for a user on the Web is redundant, and some sources may be out-of-date or incorrect. The traditional two-stage method suffers from data inconsistency and error propagation between the two stages. In this paper, we revisit the problem of Web user profiling in the big data era and propose a simple but very effective approach, referred to as MagicFG, for profiling Web users by leveraging the power of big data. To avoid error propagation, the approach processes all the extracting/mining/inferring subtasks in one unified framework. To improve the profiling performance, we present the concept of contextual credibility. The proposed framework also supports the incorporation of human knowledge. It defines human knowledge as Markov logics statements and formalizes them into a factor graph model. The MagicFG method has been deployed in an online system AMiner.org for profiling millions of researchers—e.g., extracting E-mail, inferring Gender, and mining research interests. Our empirical study in the real system shows that the proposed method offers significantly improved (+ 4–6%; \(p\ll 0.01\), t test) profiling performance in comparison with several baseline methods using rules, classification, and sequential labeling.

A Unified Approach to Researcher Profiling

A Combination Approach to Web User Profiling

Social Network Extraction of Academic Researchers

Weakly Supervised User Profile Extraction from Twitter.

Factor Graph Model Based User Profile Matching Across Social Networks

Profiling Web Users Using Big Data

Profiling Clinical Researchers Effectively using Embeddings and Clustering

Social User Profiling: A Social-Aware Topic Modeling Perspective

A study of user profile representation for personalized cross-language information retrieval

User Profiling Via Affinity-Aware Friendship Network

Web User Profiling Using Data Redundancy

Learning a Probabilistic Semantic Model from Heterogeneous Social Networks for Relationship Identification

Towards User Profiling From Multiple Online Social Networks

Impact-Oriented Contextual Scholar Profiling using Self-Citation Graphs

From community detection to community profiling

Expert Profile Identification From Community Detection on Author-Publication-Keyword Graph With Keyword Extraction

Real-time Filtering on Interest Profiles in Twitter Stream

Ontological user profiling in recommender systems

Keyword clustering for user interest profiling refinement within paper recommender systems

Prompt-based Personality Profiling: Reinforcement Learning for Relevance Filtering

User Profiling through Deep Multimodal Fusion.