Multi-view Maximum Margin Clustering with Privileged Information Learning
Yanshan Xiao,Jianwei Zhang,Bo Liu,Liang Zhao,Xiangjun Kong,Zhifeng Hao
DOI: https://doi.org/10.1109/tcsvt.2023.3311174
IF: 5.859
2023-01-01
IEEE Transactions on Circuits and Systems for Video Technology
Abstract:Maximum margin clustering (MMC) is a typical clustering method which aims to maximize the margin between different clusters. However, in practical applications, a data object may be represented by multiple feature sets (views), with each feature set representing different information of the underlying data. The traditional MMC methods can handle only the data from a single view and are unable to utilize the multi-view data to enhance the clustering model. In multi-view clustering, there are two basic principles: the consensus principle and complementarity principle. Most multi-view clustering methods implement mainly the consensus principle, while the complementarity principle has not been sufficiently taken into account. Distinguished from the existing methods, M3CP introduces the idea of privileged information learning into multi-view clustering and implements both of the consensus principle and complementarity principle. Based on privileged information learning, M3CP embodies the complementarity principle by considering one view as the main learning information and the other views as the privileged information, so that multiple views can provide information to complement each other. The derived learning problem is then solved by applying the constrained concave-convex procedure and cutting plane techniques. By employing these techniques, the computational time of M3CP is able to scale linearly with respect to the dataset size. Numerical experiments on real-life multi-view datasets demonstrate that M3CP is able to achieve better clustering accuracy and meanwhile needs less computational time, compared to state-of-the-art multi-view clustering methods.
engineering, electrical & electronic