Abstract:Author(s): Li, Hanbo | Advisor(s): Bradic, Jelena | Abstract: Recent advances in technologies for cheaper and faster data acquisition and storage have led to an explosive growth of data complexity in a variety of scientific areas. As a result, noise accumulation, experimental variation, and data inhomogeneity have become substantial. However, many classical classification and regression methods in such settings are known to pose many statistical challenges and hence call for new methods and theories.This thesis is devoted to robust classification and regression algorithms with theoretical guarantee on important statistical properties. In Chapter 1, we present a classification framework – ArchBoost, which applies to a wide range of loss functions including nonconvex losses and is specifically designed to be robust and efficient whenever the labels are recorded with an error or whenever the data are contaminated with outliers. In Chapter 2, we introduce a forest-type framework for regression problems, and prove that many state-of-the art forest algorithms belong to this framework. We then propose robust forest-type regression methods by applying our proposed framework to robust loss functions. In Chapter 3, we design a novel estimating equation motivated by the framework in Chapter 2 to solve quantile regression problem on random censored data. In Chapter 4, we focus on high-dimensional left-censored quantile regression and study its inference problem. We modify the quantile loss to accommodate the left-censored nature of the problem, by extending the idea of redistribution of mass. For the inference part, asymptotic properties are carefully investigated. All the methods in aforementioned chapters are tested through extensive numerical experiments on both simulated and real data sets.

Robust Estimation in Regression and Classification Methods for Large Dimensional Data

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Robust-BD Estimation and Inference for Varying-Dimensional General Linear Models

Penalized Bregman divergence for large-dimensional regression and classification.

New Aspects of Bregman Divergence in Regression and Classification with Parametric and Nonparametric Estimation

Robust Inference under the Beta Regression Model with Application to Health Care Studies

Robust adaptive LASSO in high-dimensional logistic regression

Robustness Property of Robust-BD Wald-Type Test for Varying-Dimensional General Linear Models

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Universal Robust Regression via Maximum Mean Discrepancy

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Robust Estimation for Partially Linear Models with Large-Dimensional Covariates

Unified robust estimation

Robust Regularized Kernel Regression.

Robust Classification and Regression

A Robust Learning Approach for Regression Models Based on Distributionally Robust Optimization.

Robust Regression for Non-Randomly Distributed Big Data with Application to Nonconvex Penalized Learning

Robust small area estimation for unit level model with density power divergence

Robust Regression With Asymmetric Loss Functions

Outlier-Bias Removal with Alpha Divergence: A Robust Non-Convex Estimator for Linear Regression

Robust regression based on shrinkage estimators