Student-t Process Regression with Dependent Student-t Noise.

Qingtao Tang,Yisen Wang,Shu-Tao Xia
DOI: https://doi.org/10.3233/978-1-61499-672-9-82
2016-01-01
Abstract:Gaussian Process Regression (GPR) is a powerful non-parametric method. However, GPR may perform poorly if the data are contaminated by outliers. To address the issue, we replace the Gaussian process with a Student-t process and introduce dependent Student-t noise in this paper, leading to a Student-t Process Regression with Dependent Student-t noise model (TPRD). Closed form expressions for the marginal likelihood and predictive distribution of TPRD are derived. Besides, TPRD gives a probabilistic interpretation to the Student-t Process Regression with the noise incorporated into its Kernel (TPRK), which is a common approach for the Student-t process regression. Moreover, we analyze the influence of different kernels. If the kernel meets a condition, called beta-property here, the maximum marginal likelihood estimation of TPRD's hyperparameters is independent of the degrees of freedom nu of the Student-t process, which implies that GPR, TPRD and TPRK have exactly the same predictive mean. Empirically, the degrees of freedom nu could be regarded as a convergence accelerator, indicating that TPRD with a suitable nu performs faster than GPR. If the kernel does not have the beta-property, TPRD has better performances than GPR, without additional computational cost. On benchmark datasets, the proposed results are verified.
What problem does this paper attempt to address?