Abstract:Exploratory analysis is an important way to gain understanding and find unknown relationships from various data sources, especially in the era of big data. Traditional paradigms of social science data analysis follow the steps of feature selection, modeling, and prediction. In this paper, we propose a new paradigm that does not require feature selection so that data can speak for itself without manually picking out features. Besides, we propose using the deep network as a methodology to explore previously unknown relationships and capture complexity and non-linearity between target variables and a large number of input features for big social data. The new paradigm tends to be a relatively generic approach that can be widely used in different scenarios. In order to validate the feasibility of the paradigm, we use country-level indicators forecasting as a case study. The process includes: 1) data collection and preparation and 2) modeling and experiment. The data collection and preparation part builds a data warehouse and conducts the extract-transform-load process to eliminate data format inconsistency. The modeling and experiment part includes model setup and model structures change to achieve relatively high accuracy on prediction results at both model level and case level. We find some patterns about network capacity modification and the influence of time interval difference on the test results, whereas both of them deserve further research.

Regression Analysis of Asymmetric Pairs in Large-Scale Network Data

A Sparse Beta Regression Model for Network Analysis

Least Squares Estimation of Spatial Autoregressive Models for Large-Scale Social Networks

Non-parametric regression for networks

Exploratory Analysis for Big Social Data Using Deep Network

Studying Determinants of Social Network Size:Comparison of different statistical models

Estimating Spatial Autocorrelation with Sampled Network Data

A NAIVE LEAST SQUARES METHOD FOR SPATIAL AUTOREGRESSION WITH COVARIATES

Network Regression with Graph Laplacians

Statistica Sinica Preprint No : SS-2017-0135 Title A Naive Least Squares Method for Spatial Autoregression with Covariates

Identification and Estimation of a Partially Linear Regression Model using Network Data: Inference and an Application to Network Peer Effects

A Latent Moving Average Model for Network Regression

Multivariate Spatial Autoregressive Model for Large Scale Social Networks

Confidence sets for network structure

Two-mode Network Autoregressive Model for Large-Scale Networks

Regression for Asymmetric Information Problem: The Comparison of Different Methods

Network-Assisted Estimation for Large-dimensional Factor Model with Guaranteed Convergence Rate Improvement

An Alternating-Direction-Method of Multipliers-Incorporated Approach to Symmetric Non-Negative Latent Factor Analysis

High-dimensional Factor Analysis for Network-linked Data

Shrinkage Estimation of Network Spillovers with Factor Structured Errors

Network Imputation for a Spatial Autoregression Model with Incomplete Data