Abstract:The Bayesian network provides a useful way to deal with uncertain information, which helps researchers to better understand the human cognitive process. The foundation of the Bayesian network focuses on identifying the qualitative relations between variables, which is also called structure learning. Local search in the ordering space is an effective method for learning the structure of large-scale Bayesian networks. However, the existing algorithms tend to the local optimum and stop searching for superior solutions. To tackle the problem, random perturbations are applied to the local optimum without specific strategies, resulting in many meaningless restarts that sacrifice much time but still fail to improve the results. As an extension of the local search, simulated annealing stochastically searches the solution spaces and selects relatively poor solutions with a certain probability. This paper proposes a method based on simulated annealing to learn Bayesian network structure in the ordering space, which expands the search scope by probabilistically accepting poorer solutions. Moreover, we improve simulated annealing by adding a memory module and modifying the termination condition. The memory module records the optimal solution before accepting a worse solution, which avoids losing the possible global optimal solution. The new termination condition is related to the quality of the search results, which reduces many redundant searches. Besides, we design a new restart strategy based on ensemble learning. When the search traps in the local optimum, a new ordering is obtained to restart the search by perturbing the current ordering with constraints. The constraints are generated by the results of ensemble learning on multiple structures, which help the algorithm approach the global optimum solution. Experimental results show that our proposed methods improve the accuracy and efficiency in learning the optimal structure over the benchmarks compared to the state-of-the-art algorithms.

Improving the performance of weak supervision searches using transfer and meta-learning

Improving the performance of weak supervision searches using transfer and meta-learning

Improving the performance of weak supervision searches using data augmentation

Meta-tag Propagation by Co-Training an Ensemble Classifier for Improving Image Search Relevance

Policy Learning Using Weak Supervision.

The Improved Ordering-Based Search Method Incorporating with Ensemble Learning

Investigating Weak Supervision in Deep Ranking.

Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts

Practical Network Modeling Using Weak Supervision Signals for Human-Centric Networking in Metaverse

A Survey of Meta-learning for Classification Tasks

Investigating Relative Performance of Transfer and Meta Learning

Is the Meta-Learning Idea Able to Improve the Generalization of Deep Neural Networks on the Standard Supervised Learning?

Revisiting Meta-Learning As Supervised Learning

Meta Learning to Rank for Sparsely Supervised Queries

Meta Self-Refinement for Robust Learning with Weak Supervision

Towards Safe Weakly Supervised Learning

Boosting Order-Preserving and Transferability for Neural Architecture Search: a Joint Architecture Refined Search and Fine-tuning Approach

Transfer Learning by Ranking for Weakly Supervised Object Annotation

Supervision by Fusion: Towards Unsupervised Learning of Deep Salient Object Detector

Boosting Supervision with Self-Supervision for Few-shot Learning

A weakly supervised method for 3D object detection with partially annotated samples