Learnable Graph Convolutional Network and Feature Fusion for Multi-view Learning

Zhaoliang Chen,Lele Fu,Jie Yao,Wenzhong Guo,Claudia Plant,Shiping Wang
DOI: https://doi.org/10.48550/arXiv.2211.09155
2022-11-17
Abstract:In practical applications, multi-view data depicting objectives from assorted perspectives can facilitate the accuracy increase of learning algorithms. However, given multi-view data, there is limited work for learning discriminative node relationships and graph information simultaneously via graph convolutional network that has drawn the attention from considerable researchers in recent years. Most of existing methods only consider the weighted sum of adjacency matrices, yet a joint neural network of both feature and graph fusion is still under-explored. To cope with these issues, this paper proposes a joint deep learning framework called Learnable Graph Convolutional Network and Feature Fusion (LGCN-FF), consisting of two stages: feature fusion network and learnable graph convolutional network. The former aims to learn an underlying feature representation from heterogeneous views, while the latter explores a more discriminative graph fusion via learnable weights and a parametric activation function dubbed Differentiable Shrinkage Activation (DSA) function. The proposed LGCN-FF is validated to be superior to various state-of-the-art methods in multi-view semi-supervised classification.
Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to simultaneously learn discriminative node relationships and graph information in multi - view data. Most of the existing methods only consider the weighted sum of the adjacency matrix, without exploring the joint neural network of feature fusion and graph fusion. This results in the inability to fully utilize the complementary information between different views when processing multi - view data, thus affecting the performance of the learning algorithm. To address these problems, the authors propose a joint deep - learning framework named Learnable Graph Convolutional Network and Feature Fusion (LGCN - FF). This framework consists of two stages: a feature - fusion network and a learnable graph - convolutional network. The feature - fusion network aims to learn latent feature representations from heterogeneous views, while the learnable graph - convolutional network explores more discriminative graph fusion through learnable weights and a parameterized activation function - the Differentiable Shrinkage Activation (DSA) function. The DSA function can adaptively optimize node relationships and improve the robustness and generalization ability of the graph - convolutional network. Specifically, the main contributions of LGCN - FF include: 1. Proposing an end - to - end neural network framework for multi - view semi - supervised classification, which integrates a sparse auto - encoder and a learnable graph - convolutional network to jointly learn the complete representation of multiple features and graphs. 2. Constructing a learnable graph - convolutional network framework with adaptive weights and a parameterized DSA function, which can automatically mine more discriminative and robust graph representations from heterogeneous views. 3. Developing a multi - step optimization strategy to update the corresponding parameters in LGCN - FF through back - propagation. 4. In multi - view semi - supervised classification tasks, the proposed framework exhibits superior performance compared to other state - of - the - art graph - based algorithms. The paper verifies the effectiveness of LGCN - FF through experiments and tests it on multiple real - world multi - view datasets, demonstrating its advantages in multi - view semi - supervised classification tasks.