Abstract:When exploring the broad application prospects of large-scale Gaussian process regression (GPR), three core challenges significantly constrain its full effectiveness: firstly, the O(n3) time complexity of computing the inverse covariance matrix of n training points becomes an insurmountable performance bottleneck when processing large-scale datasets; Secondly, although traditional local approximation methods are widely used, they are often limited by the inconsistency of prediction results; The third issue is that many aggregation strategies lack discrimination when evaluating the importance of experts (i.e. local models), resulting in a loss of overall prediction accuracy. In response to the above challenges, this article innovatively proposes a comprehensive method that integrates third-degree stochastic fully symmetric interpolatory rules (TDSFSI), local approximation, and Tsallis mutual information (TDSFSIRLA), aiming to fundamentally break through existing limitations. Specifically, TDSFSIRLA first introduces an efficient third-degree stochastic fully symmetric interpolatory rules, which achieves accurate approximation of Gaussian kernel functions by generating adaptive dimensional feature maps. This innovation not only significantly reduces the number of required orthogonal nodes and effectively lowers computational costs, but also maintains extremely high approximation accuracy, providing a solid theoretical foundation for processing large-scale datasets. Furthermore, in order to overcome the inconsistency of local approximation methods, this paper adopts the Generalized Robust Bayesian Committee Machine (GRBCM) as the aggregation framework for local experts. GRBCM ensures the harmonious unity of the prediction results of each local model through its inherent consistency and robustness, significantly improving the stability and reliability of the overall prediction. More importantly, in response to the issue of uneven distribution of expert weights, this article creatively introduces Tsallis mutual information as a metric for weight allocation. Tsallis mutual information, with its sensitive ability to capture information complexity, assigns weights to different local experts that match their contribution, effectively solving the problem of prediction bias caused by uneven weight distribution and further improving prediction accuracy. In the experimental verification phase, this article conducted comprehensive testing on multiple synthetic datasets and seven representative real datasets. The results show that the TDSFSIRLA method not only achieves significant reduction in time complexity, but also demonstrates excellent performance in prediction accuracy, fully verifying its significant advantages and broad application prospects in the field of large-scale Gaussian process regression.

Smoothed Full-Scale Approximation of Gaussian Process Models for Computation of Large Spatial Datasets

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

Patchwork Kriging for Large-scale Gaussian Process Regression

smashGP: Large-Scale Spatial Modeling via Matrix-Free Gaussian Processes

Block Vecchia Approximation for Scalable and Efficient Gaussian Process Computations

Remarks for Scaling Up a General Gaussian Process to Model Large Dataset with Sub-models

When Gaussian Process Meets Big Data: A Review of Scalable GPs

A Global-Local Approximation Framework for Large-Scale Gaussian Process Modeling

Understanding and comparing scalable Gaussian process regression for big data

Parallel cross-validation: A scalable fitting method for Gaussian process models

Solving High Frequency and Multi-Scale PDEs with Gaussian Processes

Stochastic Approximation with Gaussian Process Regression

Composite Gaussian Processes: Scalable Computation and Performance Analysis

Jointly stochastic fully symmetric interpolatory rules and local approximation for scalable Gaussian process regression

Normalizing Basis Functions: Approximate Stationary Models for Large Spatial Data

Towards Scalable Gaussian Process Modeling

Compactly-supported nonstationary kernels for computing exact Gaussian processes on big data

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

Scalable mixed-domain Gaussian process modeling and model reduction for longitudinal data

Modelling local and global phenomena with sparse Gaussian processes