Abstract:When exploring the broad application prospects of large-scale Gaussian process regression (GPR), three core challenges significantly constrain its full effectiveness: firstly, the O(n3) time complexity of computing the inverse covariance matrix of n training points becomes an insurmountable performance bottleneck when processing large-scale datasets; Secondly, although traditional local approximation methods are widely used, they are often limited by the inconsistency of prediction results; The third issue is that many aggregation strategies lack discrimination when evaluating the importance of experts (i.e. local models), resulting in a loss of overall prediction accuracy. In response to the above challenges, this article innovatively proposes a comprehensive method that integrates third-degree stochastic fully symmetric interpolatory rules (TDSFSI), local approximation, and Tsallis mutual information (TDSFSIRLA), aiming to fundamentally break through existing limitations. Specifically, TDSFSIRLA first introduces an efficient third-degree stochastic fully symmetric interpolatory rules, which achieves accurate approximation of Gaussian kernel functions by generating adaptive dimensional feature maps. This innovation not only significantly reduces the number of required orthogonal nodes and effectively lowers computational costs, but also maintains extremely high approximation accuracy, providing a solid theoretical foundation for processing large-scale datasets. Furthermore, in order to overcome the inconsistency of local approximation methods, this paper adopts the Generalized Robust Bayesian Committee Machine (GRBCM) as the aggregation framework for local experts. GRBCM ensures the harmonious unity of the prediction results of each local model through its inherent consistency and robustness, significantly improving the stability and reliability of the overall prediction. More importantly, in response to the issue of uneven distribution of expert weights, this article creatively introduces Tsallis mutual information as a metric for weight allocation. Tsallis mutual information, with its sensitive ability to capture information complexity, assigns weights to different local experts that match their contribution, effectively solving the problem of prediction bias caused by uneven weight distribution and further improving prediction accuracy. In the experimental verification phase, this article conducted comprehensive testing on multiple synthetic datasets and seven representative real datasets. The results show that the TDSFSIRLA method not only achieves significant reduction in time complexity, but also demonstrates excellent performance in prediction accuracy, fully verifying its significant advantages and broad application prospects in the field of large-scale Gaussian process regression.

Local Function Complexity for Active Learning via Mixture of Gaussian Processes

Efficient Graph Laplacian Estimation by Proximal Newton

Precision aggregated local models

Large Linear Multi-output Gaussian Process Learning

Active Learning Algorithm for Computational Physics

Bayesian Learning of Orthogonal Embeddings for Multi-Fidelity Gaussian Processes

Efficiently Computable Safety Bounds for Gaussian Processes in Active Learning

Sparsity-Aware Distributed Learning for Gaussian Processes with Linear Multiple Kernel

Local transfer learning Gaussian process modeling, with applications to surrogate modeling of expensive computer simulators

Disentangled Multi-Fidelity Deep Bayesian Active Learning

Hierarchical-Hyperplane Kernels for Actively Learning Gaussian Process Models of Nonstationary Systems

A New Reliable & Parsimonious Learning Strategy Comprising Two Layers of Gaussian Processes, to Address Inhomogeneous Empirical Correlation Structures

Fast multi-fidelity gaussian processes with derivatives for complex system modeling

Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics

Amortized Active Learning for Nonparametric Functions

Real-Time Transfer Active Learning for Functional Regression and Prediction Based on Multi-Output Gaussian Process

Joint Graph Learning and Model Fitting in Laplacian Regularized Stratified Models

Calculation of Layered Medium Green's Function Based on Machine Learning Methods

Scalable marginalization of correlated latent variables with applications to learning particle interaction kernels

Jointly stochastic fully symmetric interpolatory rules and local approximation for scalable Gaussian process regression

Laplace approximation for logistic Gaussian process density estimation and regression