Abstract:With the rapid development of artificial intelligence and data science, Dynamic Bayesian Network (DBN), as an effective probabilistic graphical model, has been widely used in many engineering fields. And swarm intelligence algorithm is an optimization algorithm based on natural selection with the characteristics of distributed, self-organization and robustness. By applying the high-performance swarm intelligence algorithm to DBN structure learning, we can fully utilize the algorithm's global search capability to effectively process time-based data, improve the efficiency of network generation and the accuracy of network structure. This study proposes an improved bacterial foraging optimization algorithm (IBFO-A) to solve the problems of random step size, limited group communication, and the inability to maintain a balance between global and local searching. The IBFO-A algorithm framework comprises four layers. First, population initialization is achieved using a logistics-sine chaotic mapping strategy as the basis for global optimization. Second, the activity strategy of a colony foraging trend is constructed by combining the exploration phase of the Osprey optimization algorithm. Subsequently, the strategy of bacterial colony propagation is improved using a "genetic" approach and the Multi-point crossover operator. Finally, the elimination-dispersal activity strategy is employed to escape the local optimal solution. To solve the problem of complex DBN learning structures due to the introduction of time information, a DBN structure learning method called IBFO-D, which is based on the IBFO-A algorithm framework, is proposed. IBFO-D determines the edge direction of the structure by combining the dynamic K2 scoring function, the designed V-structure orientation rule, and the trend activity strategy. Then, according to the improved reproductive activity strategy, the concept of "survival of the fittest" is applied to the network candidate solution while maintaining species diversity. Finally, the global optimal network structure with the highest score is obtained based on the elimination-dispersal activity strategy. Multiple tests and comparison experiments were conducted on 10 sets of benchmark test functions, two non-temporal and temporal data types, and six data samples of two benchmark 2T-BN networks to evaluate and analyze the optimization performance and structure learning ability of the proposed algorithm under various data types. The experimental results demonstrated that IBFO-A exhibits good convergence, stability, and accuracy, whereas IBFO-D is an effective approach for learning DBN structures from data and has practical value for engineering applications.

Collaborative Learning by Boosting in Distributed Environments

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

Network boosting on different networks

Efficient Collaborative Learning over Unreliable D2D Network: Adaptive Cluster Head Selection and Resource Allocation

A Graph Neural Network Based Decentralized Learning Scheme

Adaptive Cluster Head Selection and Spectrum Allocation for D2D-Enabled Collaborative Learning

Distributed Extreme Learning Machine for Nonlinear Learning over Network

Projection-free Distributed Online Learning in Networks

DBS: Dynamic Batch Size For Distributed Deep Neural Network Training

Collaborative Deep Learning in Fixed Topology Networks

Peering Beyond the Gradient Veil with Distributed Auto Differentiation

Asynchronous Local Computations in Distributed Bayesian Learning

Network Fault-tolerant and Byzantine-resilient Social Learning via Collaborative Hierarchical Non-Bayesian Learning

A distributed cooperative learning algorithm based on Zero-Gradient-Sum strategy using Radial Basis Function Network

Decentralized Learning over Wireless Networks with Broadcast-Based Subgraph Sampling

Network game and boosting

Learning the Optimal Path and DNN Partition for Collaborative Edge Inference

Learning over inherently distributed data

Dynamic Bayesian network structure learning based on an improved bacterial foraging optimization algorithm

Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks

A Scalable, High-Performance, and Fault-Tolerant Network Architecture for Distributed Machine Learning