Abstract:Longitudinal analysis is important in many disciplines, such as the study of behavioral transitions in social science. Only very recently, feature selection has drawn adequate attention in the context of longitudinal modeling. Standard techniques, such as generalized estimating equations, have been modified to select features by imposing sparsity-inducing regularizers. However, they do not explicitly model how a dependent variable relies on features measured at proximal time points. Recent graphical Granger modeling can select features in lagged time points but ignores the temporal correlations within an individual's repeated measurements. We propose an approach to automatically and simultaneously determine both the relevant features and the relevant temporal points that impact the current outcome of the dependent variable. Meanwhile, the proposed model takes into account the non-{\em i.i.d} nature of the data by estimating the within-individual correlations. This approach decomposes model parameters into a summation of two components and imposes separate block-wise LASSO penalties to each component when building a linear model in terms of the past $\tau$ measurements of features. One component is used to select features whereas the other is used to select temporal contingent points. An accelerated gradient descent algorithm is developed to efficiently solve the related optimization problem with detailed convergence analysis and asymptotic analysis. Computational results on both synthetic and real world problems demonstrate the superior performance of the proposed approach over existing techniques.

Output Feature Augmented Lasso.

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Longitudinal LASSO: Jointly Learning Features and Temporal Contingency for Outcome Prediction

Multi-output Regression on the Output Manifold

Manifold regularization in structured output space for semi-supervised structured output prediction

Development of a Novel Variable Selection Algorithm for LSTM with LASSO

Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

On LASSO for predictive regression

Robust Variable Selection Based on Relaxed Lad Lasso

Lassoed boosting and linear prediction in the equities market

Robust multi-outcome regression with correlated covariate blocks using fused LAD-lasso

Accelerating Multi-Block Constrained Optimization Through Learning to Optimize

LassoLayer: Nonlinear Feature Selection by Switching One-to-one Links

AN EXTENDED LINEARIZED ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR FUSED-LASSO PENALIZED LINEAR REGRESSION

Multi-task attributed graphical lasso and its application in fund classification

The spike-and-slab lasso and scalable algorithm to accommodate multinomial outcomes in variable selection problems

Extended Adaptive Lasso for Multi-Class and Multi-Label Feature Selection.

Multi-output least-squares support vector regression machines

Learning Output Embeddings in Structured Prediction

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

Exclusive Group Lasso for Structured Variable Selection