Abstract:Despite their benefits in terms of simplicity, low computational cost and data requirement, parametric machine learning algorithms, such as linear discriminant analysis, quadratic discriminant analysis or logistic regression, suffer from serious drawbacks including linearity, poor fit of features to the usually imposed normal distribution and high dimensionality. Batch kernel-based nonparametric classifier, which overcomes the linearity and normality of features constraints, represent an interesting alternative for supervised classification problem. However, it suffers from the ``curse of dimension". The problem can be alleviated by the explosive sample size in the era of big data, while large-scale data size presents some challenges in the storage of data and the calculation of the classifier. These challenges make the classical batch nonparametric classifier no longer applicable. This motivates us to develop a fast algorithm adapted to the real-time calculation of the nonparametric classifier in massive as well as streaming data frameworks. This online classifier includes two steps. First, we consider an online principle components analysis to reduce the dimension of the features with a very low computation cost. Then, a stochastic approximation algorithm is deployed to obtain a real-time calculation of the nonparametric classifier. The proposed methods are evaluated and compared to some commonly used machine learning algorithms for real-time fetal well-being monitoring. The study revealed that, in terms of accuracy, the offline (or Batch), as well as, the online classifiers are good competitors to the random forest algorithm. Moreover, we show that the online classifier gives the best trade-off accuracy/computation cost compared to the offline classifier.

A fast divide-and-conquer strategy for single-index model with massive data

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Fast inference for quantile regression with tens of millions of observations

Robust and efficient subsampling algorithms for massive data logistic regression

A Sequential Addressing Subsampling Method for Massive Data Analysis under Memory Constraint

A new parallel framework algorithm for solving large-scale DEA models

A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

Optimal subsampling for functional composite quantile regression in massive data

Sample size determination for multidimensional parameters and the A-optimal subsampling in a big data linear regression model

An Efficient Data Analysis Method for Big Data using Multiple-Model Linear Regression

Estimation and testing of expectile regression with efficient subsampling for massive data

Optimal subsampling algorithms for composite quantile regression in massive data

Distributed quantile regression for massive heterogeneous data

SRDA: an Efficient Algorithm for Large-Scale Discriminant Analysis

A review of distributed statistical inference

Optimal subsampling algorithm for the marginal model with large longitudinal data

Divide-and-Conquer: A Distributed Hierarchical Factor Approach to Modeling Large-Scale Time Series Data

Optimal Subsampling Approaches for Large Sample Linear Regression

Direct Regression Modelling of High-Order Moments in Big Data

Subsampling and Jackknifing: A Practically Convenient Solution for Large Data Analysis with Limited Computational Resources

Online Nonparametric Supervised Learning for Massive Data