Abstract:This letter addresses the problem of designing the transition probabilities of a finite Markov chain (the policy) in order to minimize the expected cost for reaching a destination node from a source node while maintaining a fixed level of entropy spread throughout the network (the exploration). It is motivated by the following scenario. Suppose you have to route agents through a network in some optimal way, for instance, by minimizing the total travel cost-nothing particular up to now-you could use a standard shortest-path algorithm. Suppose, however, that you want to avoid pure deterministic routing policies in order, for instance, to allow some continual exploration of the network, avoid congestion, or avoid complete predictability of your routing strategy. In other words, you want to introduce some randomness or unpredictability in the routing policy (i.e., the routing policy is randomized). This problem, which will be called the randomized shortest-path problem (RSP), is investigated in this work. The global level of randomness of the routing policy is quantified by the expected Shannon entropy spread throughout the network and is provided a priori by the designer. Then, necessary conditions to compute the optimal randomized policy-minimizing the expected routing cost-are derived. Iterating these necessary conditions, reminiscent of Bellman's value iteration equations, allows computing an optimal policy, that is, a set of transition probabilities in each node. Interestingly and surprisingly enough, this first model, while formulated in a totally different framework, is equivalent to Akamatsu's model ( 1996 ), appearing in transportation science, for a special choice of the entropy constraint. We therefore revisit Akamatsu's model by recasting it into a sum-over-paths statistical physics formalism allowing easy derivation of all the quantities of interest in an elegant, unified way. For instance, it is shown that the unique optimal policy can be obtained by solving a simple linear system of equations. This second model is therefore more convincing because of its computational efficiency and soundness. Finally, simulation results obtained on simple, illustrative examples show that the models behave as expected.

Interpolating between Random Walks and Shortest Paths: a Path Functional Approach

Shape of shortest paths in random spatial networks

Lazy random walks and optimal transport on graphs

Randomized shortest-path problems: two related models

From unbiased to maximal-entropy random walks on hypergraphs

Efficiency of energy-consuming random walkers: Variability in energy helps

Random Walks on Stochastic and Deterministic Small-World Networks.

Random Walks Along the Streets and Canals in Compact Cities: Spectral analysis, Dynamical Modularity, Information, and Statistical Mechanics

Navigation by anomalous random walks on complex networks

Mean First Hitting Time of Searching for Path Through Random Walks on Complex Networks

Building your path to escape from home

From unbiased to maximal entropy random walks on hypergraphs

Transition from localized to delocalized trajectories in random walk subject to random drives

Random walks with long-range steps generated by functions of Laplacian matrices

Lévy Random Walks on Multiplex Networks.

From the Physics of Interacting Polymers to Optimizing Routes on the London Underground

Superdiffusive planar random walks with polynomial space-time drifts

Optimal and suboptimal networks for efficient navigation measured by mean-first passage time of random walks.

Intelligibility and First Passage Times In Complex Urban Networks

Phase space maximal entropy random walk: Langevin-like ensembles of physical trajectories

Stochastic paths controlling speed and dissipation