Abstract:Profiling Web users is a fundamental issue for Web mining and social network analysis. Its basic tasks include extracting basic information, mining user preferences, and inferring user demographics (Tang et al. in ACM Trans Knowl Discov Data 5(1):2:1–2:44, 2010). Although methodologies for handling the three tasks are different, they all usually contain two stages: first identify relevant pages (data) of a user and then use machine learning models (e.g., SVM, CRFs, or DL) to extract/mine/infer profile attributes from each page. The methods were successful in the traditional Web, but are facing more and more challenges with the rapid evolution of the Web each persons information is distributed over the Web and is changing dynamically. As a result, available data for a user on the Web is redundant, and some sources may be out-of-date or incorrect. The traditional two-stage method suffers from data inconsistency and error propagation between the two stages. In this paper, we revisit the problem of Web user profiling in the big data era and propose a simple but very effective approach, referred to as MagicFG, for profiling Web users by leveraging the power of big data. To avoid error propagation, the approach processes all the extracting/mining/inferring subtasks in one unified framework. To improve the profiling performance, we present the concept of contextual credibility. The proposed framework also supports the incorporation of human knowledge. It defines human knowledge as Markov logics statements and formalizes them into a factor graph model. The MagicFG method has been deployed in an online system AMiner.org for profiling millions of researchers—e.g., extracting E-mail, inferring Gender, and mining research interests. Our empirical study in the real system shows that the proposed method offers significantly improved (+ 4–6%; \(p\ll 0.01\), t test) profiling performance in comparison with several baseline methods using rules, classification, and sequential labeling.

Profile Inference from Heterogeneous Data - Fundamentals and New Trends.

Analysis of User Interests Based on Integrated-Graph Model.

Brand Recommendation Leveraging Heterogeneous Implicit Feedbacks

A Novel Framework To Process The Quantity And Quality Of User Behavior Data In Recommender Systems

Exploring and Exploiting Data Heterogeneity in Recommendation

Dynamic Personalized Recommendation on Sparse Data

Personalized Recommendation Method of E-Commerce Products Based on In-Depth User Interest Portraits

A Comprehensive Survey of Recent Research on Profile Data Analysis

Learning User Preference from Heterogeneous Information for Store-Type Recommendation

Profiling Web Users Using Big Data

DRprofiling: Deep Reinforcement User Profiling for Recommendations in Heterogenous Information Networks

Family Profile Mining in Retailing

Graph Based Recommendations: From Data Representation to Feature Extraction and Application

User Profiling Trends, Techniques and Applications

Hybrid Interest Modeling for Long-tailed Users

Personalized Recommendation by Exploring Social Users' Behaviors

A Picture Tells a Thousand Words -- About You! User Interest Profiling from User Generated Visual Content

Adaptive User Profile Model and Collaborative Filtering for Personalized News.

Do we behave differently on Twitter and Facebook: Multi-view social network user personality profiling for content recommendation

Learning User's Intrinsic and Extrinsic Interests for Point-of-Interest Recommendation: A Unified Approach.

Bi-Preference Learning Heterogeneous Hypergraph Networks for Session-based Recommendation