Abstract:We consider the statistical analysis of heterogeneous data for prediction in situations where the observations include functions, typically time series. We extend the modeling with Mixtures-of-Experts (ME), as a framework of choice in modeling heterogeneity in data for prediction with vectorial observations, to this functional data analysis context. We first present a new family of ME models, named functional ME (FME) in which the predictors are potentially noisy observations, from entire functions. Furthermore, the data generating process of the predictor and the real response, is governed by a hidden discrete variable representing an unknown partition. Second, by imposing sparsity on derivatives of the underlying functional parameters via Lasso-like regularizations, we provide sparse and interpretable functional representations of the FME models called iFME. We develop dedicated expectation--maximization algorithms for Lasso-like (EM-Lasso) regularized maximum-likelihood parameter estimation strategies to fit the models. The proposed models and algorithms are studied in simulated scenarios and in applications to two real data sets, and the obtained results demonstrate their performance in accurately capturing complex nonlinear relationships and in clustering the heterogeneous regression data.

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

Nonparametric M-estimation for Functional Stationary Ergodic Data

ROBUST ESTIMATION IN PARAMETRIC TIME SERIES MODELS UNDER LONG‐ AND SHORT‐RANGE‐DEPENDENT STRUCTURES

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

Local linear M-estimation for spatial processes in fixed-design models

Asymptotic expansion for nonparametric M-estimator in a nonlinear regression model with long-memory errors

Asymptotic Theory for Explosive Fractional Ornstein-Uhlenbeck Processes

Local Linear M‐estimation in Non‐parametric Spatial Regression

Bahadur Representation of Nonparametric M-Estimators for Spatial Processes

Spatial local M-estimation under association

Local M-Estimation for Jump-Diffusion Processes

Functional Mixtures-of-Experts

Nonparametric density estimation for stationary processes under multiplicative measurement errors

Asymptotic Normality of an M-estimator of regression function for truncated-censored data under alpha-mixing condition

Asymptotic Normality of the Recursive M-estimators of the Scale Parameters

The consistency of the estimators in semiparametric regression model based on m-asymptotic negatively associated errors

Asymptotic Behavior of Mean-Cvar Portfolio Selection Model under Nonparametric Framework

Strong Consistency of the Internal Estimator of Nonparametric Regression with Dependent Data

Asymptotic Convergence Properties of the EM Algorithm with Respect to the Overlap in the Mixture

Asymptotic normality of kernel density estimation for mixing high-frequency data