Abstract:When exploring the broad application prospects of large-scale Gaussian process regression (GPR), three core challenges significantly constrain its full effectiveness: firstly, the O(n3) time complexity of computing the inverse covariance matrix of n training points becomes an insurmountable performance bottleneck when processing large-scale datasets; Secondly, although traditional local approximation methods are widely used, they are often limited by the inconsistency of prediction results; The third issue is that many aggregation strategies lack discrimination when evaluating the importance of experts (i.e. local models), resulting in a loss of overall prediction accuracy. In response to the above challenges, this article innovatively proposes a comprehensive method that integrates third-degree stochastic fully symmetric interpolatory rules (TDSFSI), local approximation, and Tsallis mutual information (TDSFSIRLA), aiming to fundamentally break through existing limitations. Specifically, TDSFSIRLA first introduces an efficient third-degree stochastic fully symmetric interpolatory rules, which achieves accurate approximation of Gaussian kernel functions by generating adaptive dimensional feature maps. This innovation not only significantly reduces the number of required orthogonal nodes and effectively lowers computational costs, but also maintains extremely high approximation accuracy, providing a solid theoretical foundation for processing large-scale datasets. Furthermore, in order to overcome the inconsistency of local approximation methods, this paper adopts the Generalized Robust Bayesian Committee Machine (GRBCM) as the aggregation framework for local experts. GRBCM ensures the harmonious unity of the prediction results of each local model through its inherent consistency and robustness, significantly improving the stability and reliability of the overall prediction. More importantly, in response to the issue of uneven distribution of expert weights, this article creatively introduces Tsallis mutual information as a metric for weight allocation. Tsallis mutual information, with its sensitive ability to capture information complexity, assigns weights to different local experts that match their contribution, effectively solving the problem of prediction bias caused by uneven weight distribution and further improving prediction accuracy. In the experimental verification phase, this article conducted comprehensive testing on multiple synthetic datasets and seven representative real datasets. The results show that the TDSFSIRLA method not only achieves significant reduction in time complexity, but also demonstrates excellent performance in prediction accuracy, fully verifying its significant advantages and broad application prospects in the field of large-scale Gaussian process regression.

Generalized Local Aggregation for Large Scale Gaussian Process Regression

H-GPR: A HYBRID STRATEGY FOR LARGE-SCALE GAUSSIAN PROCESS REGRESSION

Jointly stochastic fully symmetric interpolatory rules and local approximation for scalable Gaussian process regression

Generalized Robust Bayesian Committee Machine for Large-scale Gaussian Process Regression.

Aggregation Models with Optimal Weights for Distributed Gaussian Processes

Understanding and comparing scalable Gaussian process regression for big data

Gaussian Graphical Models as an Ensemble Method for Distributed Gaussian Processes

Hierarchical Mixture-of-Experts Model for Large-Scale Gaussian Process Regression

Asynchronous Parallel Large-Scale Gaussian Process Regression

When Gaussian Process Meets Big Data: A Review of Scalable GPs

Large-Scale Heteroscedastic Regression via Gaussian Process

Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression

Efficient Learning Algorithms for Gaussian Processes

Optimal Composite Likelihood Estimation and Prediction for Distributed Gaussian Process Modeling.

Scalable Gaussian Process Using Inexact Admm For Big Data

Precision aggregated local models

Patchwork Kriging for Large-scale Gaussian Process Regression

Composite Inference for Gaussian Processes

Robust and Scalable Gaussian Process Regression and Its Applications

Scalable Variational Gaussian Process Regression Networks

Fast Transfer Gaussian Process Regression with Large-Scale Sources