Abstract:Learning node representation is a fundamental problem in biological network analysis, as compact representation features reveal complicated network structures and carry useful information for downstream tasks such as link prediction and node classification. Recently, multiple networks that profile objects from different aspects are increasingly accumulated, providing the opportunity to learn objects from multiple perspectives. However, the complex common and specific information across different networks pose challenges to node representation methods. Moreover, ubiquitous noise in networks calls for more robust representation. To deal with these problems, we present a representation learning method for multiple biological networks. First, we accommodate the noise and spurious edges in networks using denoised diffusion, providing robust connectivity structures for the subsequent representation learning. Then, we introduce a graph regularized integration model to combine refined networks and compute common representation features. By using the regularized decomposition technique, the proposed model can effectively preserve the common structural property of different networks and simultaneously accommodate their specific information, leading to a consistent representation. A simulation study shows the superiority of the proposed method on different levels of noisy networks. Three network-based inference tasks, including drug-target interaction prediction, gene function identification and fine-grained species categorization, are conducted using representation features learned from our method. Biological networks at different scales and levels of sparsity are involved. Experimental results on real-world data show that the proposed method has robust performance compared with alternatives. Overall, by eliminating noise and integrating effectively, the proposed method is able to learn useful representations from multiple biological networks.

Towards Understanding Learning Representations: to What Extent Do Different Neural Networks Learn the Same Representation.

To What Extent Do Different Neural Networks Learn the Same Representation: A Neuron Activation Subspace Match Approach

Convergent Learning: Do different neural networks learn the same representations?

Formation of Representations in Neural Networks

Understanding Dynamics of Nonlinear Representation Learning and Its Application

When Representations Align: Universality in Representation Learning Dynamics

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

You Only Learn One Representation: Unified Network for Multiple Tasks

A Survey of Complex Network Representation Learning Methods.

Understanding Robust Learning through the Lens of Representation Similarities

Evaluating (and Improving) the Correspondence Between Deep Neural Networks and Human Representations

Can Temporal-Difference and Q-Learning Learn Representation? A Mean-Field Theory

Learning Representation for Multiple Biological Networks Via a Robust Graph Regularized Integration Approach

Similarity of Neural Network Representations Revisited

Understanding the Importance of Single Directions via Representative Substitution

Learning Network Representations with Neighboring Affinity

Universality of representation in biological and artificial neural networks

Investigating the properties of neural network representations in reinforcement learning

Representation Learning: A Statistical Perspective

Representations and generalization in artificial and brain neural networks

Exploring Consistency in Graph Representations:from Graph Kernels to Graph Neural Networks