Abstract:With the huge influx of various data nowadays, extracting knowledge from them has become an interesting but tedious task among data scientists, particularly when the data come in heterogeneous form and have missing information. Many data completion techniques had been introduced, especially in the advent of kernel methods. However, among the many data completion techniques available in the literature, studies about mutually completing several incomplete kernel matrices have not been given much attention yet. In this paper, we present a new method, called Mutual Kernel Matrix Completion (MKMC) algorithm, that tackles this problem of mutually inferring the missing entries of multiple kernel matrices by combining the notions of data fusion and kernel matrix completion, applied on biological data sets to be used for classification task. We first introduced an objective function that will be minimized by exploiting the EM algorithm, which in turn results to an estimate of the missing entries of the kernel matrices involved. The completed kernel matrices are then combined to produce a model matrix that can be used to further improve the obtained estimates. An interesting result of our study is that the E-step and the M-step are given in closed form, which makes our algorithm efficient in terms of time and memory. After completion, the (completed) kernel matrices are then used to train an SVM classifier to test how well the relationships among the entries are preserved. Our empirical results show that the proposed algorithm bested the traditional completion techniques in preserving the relationships among the data points, and in accurately recovering the missing kernel matrix entries. By far, MKMC offers a promising solution to the problem of mutual estimation of a number of relevant incomplete kernel matrices.

Kernel Machines With Missing Responses

Kernel machines for current status data

Multi-Layer Kernel Machines: Fast and Optimal Nonparametric Regression with Uncertainty Quantification

Nonparametric $$$$-Type Regression Estimation under Missing Response Data

Functional regression with dependent error and missing observation in reproducing kernel Hilbert spaces

Robust Kernel Approximation For Classification

Kernel matrix regression

Strong optimality of kernel functional regression in norms with partial response variables and applications

Robust estimation of the generalised partial linear model with missing covariates

Overlapping Cover Local Regression Machines

Semiparametric Double Robust and Efficient Estimation for Mean Functionals with Response Missing at Random

An Investigation of Methods for Handling Missing Data with Penalized Regression

A Learnable Kernel Machine for Short-Term Load Forecasting

Missing values handling for machine learning portfolios

Data-Dependent Kernel Machines for Microarray Data Classification

Mutual Kernel Matrix Completion

Robust Bayesian Classification with Incomplete Data

On Software Defect Prediction Using Machine Learning

Data Imputation by Pursuing Better Classification: A Supervised Kernel-Based Method

Privacy-Preserved Big Data Analysis Based on Asymmetric Imputation Kernels and Multiside Similarities

Machine Learning Based Missing Values Imputation in Categorical Datasets