Abstract:Background: The recent rise in popularity and scale of social networking services (SNSs) has resulted in an increasing need for SNS-based information extraction systems. A popular application of SNS data is health surveillance for predicting an outbreak of epidemics by detecting diseases from text messages posted on SNS platforms. Such applications share the following logic: they incorporate SNS users as social sensors. These social sensor-based approaches also share a common problem: SNS-based surveillance are much more reliable if sufficient numbers of users are active, and small or inactive populations produce inconsistent results. Objective: This study proposes a novel approach to estimate the trend of patient numbers using indirect information covering both urban areas and rural areas within the posts. Methods: We presented a TRAP model by embedding both direct information and indirect information. A collection of tweets spanning 3 years (7 million influenza-related tweets in Japanese) was used to evaluate the model. Both direct information and indirect information that mention other places were used. As indirect information is less reliable (too noisy or too old) than direct information, the indirect information data were not used directly and were considered as inhibiting direct information. For example, when indirect information appeared often, it was considered as signifying that everyone already had a known disease, leading to a small amount of direct information. Results: The estimation performance of our approach was evaluated using the correlation coefficient between the number of influenza cases as the gold standard values and the estimated values by the proposed models. The results revealed that the baseline model (BASELINE+NLP) shows .36 and that the proposed model (TRAP+NLP) improved the accuracy (.70, +.34 points). Conclusions: The proposed approach by which the indirect information inhibits direct information exhibited improved estimation performance not only in rural cities but also in urban cities, which demonstrated the effectiveness of the proposed method consisting of a TRAP model and natural language processing (NLP) classification.

Modeling Flu Trends With Real-Time Geo-Tagged Twitter Data Streams

Regional Level Influenza Study with Geo-Tagged Twitter Data

Early Stage Influenza Detection from Twitter

Regional Influenza Prediction with Sampling Twitter Data and PDE Model.

Trends Detection Of Flu Based On Ensemble Models With Emotional Factors From Social Networks

A Method for Tracking Flu Trends through Weibo

Detect And Analyze Flu Outlier Events Via Social Network

Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance

A Spatial-Temporal Method to Detect Global Influenza Epidemics Using Heterogeneous Data Collected from the Internet.

Detecting Influenza States Based on Hybrid Model with Personal Emotional Factors from Social Networks

Forecasting seasonal influenza fusing digital indicators and a mechanistic disease model

Twitter-Based Influenza Detection After Flu Peak via Tweets With Indirect Information: Text Mining Study

Real Time Early-stage Influenza Detection with Emotion Factors from Sina Microblog

Forecasting Influenza Based on Autoregressive Moving Average and Holt-Winters Exponential Smoothing Models

Influenza Forecasting with Google Flu Trends

Hybrid Model Based Influenza Detection with Sentiment Analysis from Social Networks.

Understanding the spatio-temporal characteristics of Twitter data with geotagged and non-geotagged content: two case studies with the topic of flu and Ted (movie)

Detecting Flu Transmission by Social Sensor in China

Nowcasting Influenza Incidence with CDC Web Traffic Data: A Demonstration Using a Novel Data Set

Enhancement of Epidemiological Models for Dengue Fever Based on Twitter Data

Influenza-Like Illness Patients Forecasting by Fusing Internet Public Opinion