Online Kernel Selection with Local Regret
Xiao ZHANG,Shi-Zhong LIAO
DOI: https://doi.org/10.11897/SP.J.1016.2019.00061
2019-01-01
Abstract:Online kernel selection is critical to online kernel methods,which dynamically selects the optimal kernel for online kernel learning at each round.In contrast to offline kernel selection, online kernel selection requires a sublinear regret guarantee while selecting the kernel and updating the hypothesis in a one-pass over the input data.However,existing online kernel selection methods suffer from low efficiencies due to the quadratic overall time complexity and linear space complexity with respect to the square root rounds,and do not enjoy the optimal regret bound.To address these issues,we present a novel online kernel selection method with local regret,which is in a sublinear time complexity with respect to the logarithm of rounds and a constant space complexity and enjoys the optimal sublinear regret bound for a specific objective function.We first define the local regret on the buffer under a fixed budget,and propose the online kernel selection criterion using the local regret,called LRC,which bounds the expected risk of the hypothesis sequence. Then,we apply the proposed LRC to online kernel selection and formulate the new online kernel selection method including two steps at each round:budget maintenance and criterion computation. For the budget maintenance step,we define the coherence to measure the correlation between the new example and the arrived examples in the buffer,which is equivalent to measure the correlation between the newly arrived basis function and the existing basis functions in the reproducing kernel Hilbert space.To restrict the size of the buffer to a small and fixed budget,we design the novel inserting strategy using the newly defined coherence and the reservoir sampling strategy,and propose the removal strategy according to the weights of the hypothesis sequence.For the criterion computation step,we present the efficient incremental updating strategy of the proposed LRC by revising the cumulative loss of the hypothesis sequence at each round.Finally,we propose an efficient online kernel selection algorithm that updates the hypothesis using the online gradient descent method and compensates the weight corresponding to the surrogate instance,which is in a logarithmic overall time complexity with respect to the number of rounds and a linear maintenance time complexity with respect to the budget at each round.We prove that the proposed online kernel selection method enjoys a logarithmic regret bound with respect to the logarithm of rounds,which is optimal for strongly convex objective function,while the existing regret bounds for online kernel selection are the square root of the number of rounds.In contrast to the existing regret analysis for online kernel selection within the expert advice framework,our proof of the sublinear regret bound of online kernel selection is more general and concise using the averaged gradient error and the surrogate hypothesis space.Experimental results demonstrate that the proposed online kernel selection algorithm significantly improves the efficiency of online kernel selection while retaining comparable accuracy of online kernel learning to the state-of-the-art online kernel selection algorithms,and is robust to the initial optimal kernels.