Abstract:In many practical systems, the control or decision-making is usually triggered by certain events. These systems are classified as discrete event dynamic systems (DEDSs). Considering the performance optimization of these systems,a new optimization framework called event-based optimization(EBO)is introduced in this paper.Compared with Markov decision process(MDP),one of the main characteristics of EBO is that decisions are made based on"events"rather than states.In this regard,there exist a number of advantages for EBO.First,an event usually corresponds to a set of state transitions with some common properties.Generally,the number of events of a system requiring decisions is much smaller than that of states. Therefore, the EBO approach can utilize the special structure of systems characterized by events to aggregate the potentials,thus alleviating the curses of dimensionality.Second,the EBO approach applies to many practical problems where actions are required only when certain events happen. Such problems do not fit well the standard MDP formulation in which the decisions made based on different states are independent.However,for that cases,the same action may be taken for the same event,which may correspond to many different states. Based on the basic theory of MDP,this paper is addressed around three aspects.First,we briefly review the basic ideas of EBO and the development for its theory and applications. Second,we introduce the simulation-based policy iteration methods for EBO based on the performance potentials or Q-factors;Third,a case study is conducted on the coordination of electric vehicle charging with the distributed wind power generation of a building,which aims to shed some lights on the application of EBO in energy Internet.

A rollout method for finite-stage event-based decision processes

Rollout-Based Interactive Motion Planning for Automated Vehicles *

On solving optimal policies for event-based dynamic programming

On Solving Optimal Policies for Finite-Stage Event-Based Optimization

Event-triggered Distributed Nash Equilibrium Seeking over Directed Graphs and Its Application to Power Management

Event-based optimization with lagged state information

A Potential-Based Method for Finite-Stage Markov Decision Process

On Solving Event-Based Optimization with Average Reward over Infinite Stages

A tutorial on event-based optimization with application in energy Internet

An Ordinal Optimization Based Method For Selecting Events

Lifted-Rollout for Approximate Policy Iteration of Markov Decision Process

On Multi-Scale Event-Based Optimization

Event-based Optimization with Random Packet Dropping

Online policy iteration algorithm for semi-Markov switching state-space control processes

Rollout Heuristics for Online Stochastic Contingent Planning

A Rollout Algorithm For Multichain Markov Decision Processes With Average Cost

Optimization of Joint Replacement Policies for Multipart Systems by a Rollout Framework

Constrained Multiagent Rollout and Multidimensional Assignment with the Auction Algorithm

A deep reinforcement learning method for multi-stage equipment development planning in uncertain environments

Event-based optimization for finite-horizon total-cost markov decision processes

Reinforcement Learning for POMDP: Partitioned Rollout and Policy Iteration With Application to Autonomous Sequential Repair Problems