Abstract:Longitudinal analysis is important in many disciplines, such as the study of behavioral transitions in social science. Only very recently, feature selection has drawn adequate attention in the context of longitudinal modeling. Standard techniques, such as generalized estimating equations, have been modified to select features by imposing sparsity-inducing regularizers. However, they do not explicitly model how a dependent variable relies on features measured at proximal time points. Recent graphical Granger modeling can select features in lagged time points but ignores the temporal correlations within an individual's repeated measurements. We propose an approach to automatically and simultaneously determine both the relevant features and the relevant temporal points that impact the current outcome of the dependent variable. Meanwhile, the proposed model takes into account the non-{\em i.i.d} nature of the data by estimating the within-individual correlations. This approach decomposes model parameters into a summation of two components and imposes separate block-wise LASSO penalties to each component when building a linear model in terms of the past $\tau$ measurements of features. One component is used to select features whereas the other is used to select temporal contingent points. An accelerated gradient descent algorithm is developed to efficiently solve the related optimization problem with detailed convergence analysis and asymptotic analysis. Computational results on both synthetic and real world problems demonstrate the superior performance of the proposed approach over existing techniques.

L-1 Regularized Projection Pursuit For Additive Model Learning

Sparsity Induced Locality Preserving Projection Approaches for Dimensionality Reduction

L0-Regularized Learning for High-Dimensional Additive Hazards Regression

Regularized Multinomial Regression Method for Hyperspectral Data Classification Via Pathwise Coordinate Optimization

Smoothing Proximal Gradient Method for General Structured Sparse Learning

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Fast Learning with Nonconvex L1-2 Regularization.

Asymptotically faster estimation of high‐dimensional additive models using subspace learning

Regularized Projection Matrix Approximation with Applications to Community Detection

Linear Programming-Based Sparse Kernel Regression with L1-Norm Minimization for Nonlinear System Modeling

A new large-scale learning algorithm for generalized additive models

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Spike-and-Slab LASSO Generalized Additive Models and Scalable Algorithms for High-Dimensional Data Analysis

Learnable Graph-Regularization for Matrix Decomposition

Learning Deep Sparse Regularizers with Applications to Multi-View Clustering and Semi-Supervised Classification

$L_{\alpha}$-Regularization-Based Sparse Semi-Supervised Learning for Data with Complex Distributions

Quadratic Approximation Greedy Pursuit for Cardinality-Constrained Sparse Learning

Tilted Sparse Additive Models.

Generalized Sparse Additive Model with Unknown Link Function

Longitudinal LASSO: Jointly Learning Features and Temporal Contingency for Outcome Prediction

Adaptive Noisy Data Augmentation for Regularized Estimation and Inference in Generalized Linear Models