Abstract:Background: Probabilistic Boolean networks (PBNs) have been proposed for analyzing external control in gene regulatory networks with incorporation of uncertainty. A context-sensitive PBN with perturbation (CS-PBNp), extending a PBN with context-sensitivity to reflect the inherent biological stability and random perturbations to express the impact of external stimuli, is considered to be more suitable for modeling small biological systems intervened by conditions from the outside. In this paper, we apply probabilistic model checking, a formal verification technique, to optimal control for a CS-PBNp that minimizes the expected cost over a finite control horizon. Results: We first describe a procedure of modeling a CS-PBNp using the language provided by a widely used probabilistic model checker PRISM. We then analyze the reward-based temporal properties and the computation in probabilistic model checking; based on the analysis, we provide a method to formulate the optimal control problem as minimum reachability reward properties. Furthermore, we incorporate control and state cost information into the PRISM code of a CS-PBNp such that automated model checking a minimum reachability reward property on the code gives the solution to the optimal control problem. We conduct experiments on two examples, an apoptosis network and a WNT5A network. Preliminary experiment results show the feasibility and effectiveness of our approach. Conclusions: The approach based on probabilistic model checking for optimal control avoids explicit computation of large-size state transition relations associated with PBNs. It enables a natural depiction of the dynamics of gene regulatory networks, and provides a canonical form to formulate optimal control problems using temporal properties that can be automated solved by leveraging the analysis power of underlying model checking engines. This work will be helpful for further utilization of the advances in formal verification techniques in system biology.

A Probabilistic Boolean Network Based on Semi-Markov Decision Processes

On Pinning Reachability of Probabilistic Boolean Control Networks

Optimal Control of Steady-State Probability Distributions of Probabilistic Boolean Networks

Stabilization and Finite-Time Stabilization of Probabilistic Boolean Control Networks

State Feedback Stabilization for Probabilistic Boolean Networks.

A Genetic Algorithm for Optimal Control of Probabilistic Boolean Networks

Optimal Finite-Horizon Control for Probabilistic Boolean Networks with Hard Constraints

Optimal Control Policy for Probabilistic Boolean Networks with Hard Constraints.

Bisimulations of Probabilistic Boolean Networks

Construction and Control of Genetic Regulatory Networks:A Multivariate Markov Chain Approach

Quotients of Probabilistic Boolean Networks

Set Stabilization of Probabilistic Boolean Networks Using Pinning Control

Deep Reinforcement Learning Based Optimal Infinite-Horizon Control of Probabilistic Boolean Control Networks

A Simplified Multivariate Markov Chain Model for the Construction and Control of Genetic Regulatory Networks

Estimation of State and Mode for Boolean Networks with Markov Jump Parameters

Model checking optimal finite-horizon control for probabilistic gene regulatory networks

Policy Iteration Approach to the Infinite Horizon Average Optimal Control of Probabilistic Boolean Networks

Probabilistic Boolean networks: a rule-based uncertainty model for gene regulatory networks

Controllability of Probabilistic Boolean Control Networks.

Simulation Study in Probabilistic Boolean Network Models for Genetic Regulatory Networks.

Construction of Probabilistic Boolean Networks from a Prescribed Transition Probability Matrix: A Maximum Entropy Rate Approach