Abstract:Advancing the utility of social media data for research applications requires methods for automatically detecting demographic information about social media study populations, including users' age. The objective of this study was to develop and evaluate a method that automatically identifies the exact age of users based on self-reports in their tweets. Our end-to-end automatic natural language processing (NLP) pipeline, ReportAGE, includes query patterns to retrieve tweets that potentially mention an age, a classifier to distinguish retrieved tweets that self-report the user's exact age ("age" tweets) and those that do not ("no age" tweets), and rule-based extraction to identify the age. To develop and evaluate ReportAGE, we manually annotated 11,000 tweets that matched the query patterns. Based on 1000 tweets that were annotated by all five annotators, inter-annotator agreement (Fleiss' kappa) was 0.80 for distinguishing "age" and "no age" tweets, and 0.95 for identifying the exact age among the "age" tweets on which the annotators agreed. A deep neural network classifier, based on a RoBERTa-Large pretrained transformer model, achieved the highest F1-score of 0.914 (precision = 0.905, recall = 0.942) for the "age" class. When the age extraction was evaluated using the classifier's predictions, it achieved an F1-score of 0.855 (precision = 0.805, recall = 0.914) for the "age" class. When it was evaluated directly on the held-out test set, it achieved an F1-score of 0.931 (precision = 0.873, recall = 0.998) for the "age" class. We deployed ReportAGE on a collection of more than 1.2 billion tweets, posted by 245,927 users, and predicted ages for 132,637 (54%) of them. Scaling the detection of exact age to this large number of users can advance the utility of social media data for research applications that do not align with the predefined age groupings of extant binary or multi-class classification approaches.

Detection And Analysis Of Weibo User'S Age

Age Detection For Chinese Users In Weibo

Predicting Microblog User's Age Based on Text Information

Predicting Users' Age Range In Micro-Blog Network

Predicting Users' Demographic Characteristics in a Chinese Social Media Network

Microblog Sentiment Orientation Detection Using User Interactive Relationship

Users Sleeping Time Analysis Based on Micro-Blogging Data

Dynamic detection of spammers in Weibo

A Data-Driven Approach for University Public Opinion Analysis and Its Applications

Spammer Detection on Weibo Social Network

ReportAGE: Automatically extracting the exact age of Twitter users based on self-reports in tweets

Detecting Spam on Sina Weibo

Discriminating gender on Chinese microblog: A study of online behaviour, writing style and preferred vocabulary

Characterizing User Behavior in Weibo

Automatic Rumors Identification On Sina Weibo

WeiboFinder: A Topic-Based Chinese Word Finding and Learning System.

What's my age?: Predicting Twitter User's Age using Influential Friend Network and DBpedia

Inferring User Demographics and Social Strategies in Mobile Social Networks

Generational Differences and Causes of Social Media Functional Applications in the Information Age Within Chinese Regions: A Case Study of WeChat

Lifetime Lexical Variation in Social Media

An Experimental Study of Spammer Detection on Chinese Microblogs.