Optimal Monitoring Schedule in Dynamic Contracts

Mingliu Chen,Peng Sun,Yongbo Xiao

DOI: https://doi.org/10.1287/opre.2019.1968

IF: 2.7

2020-01-01

Operations Research

Abstract:Monitoring in Dynamic Contract Design

What problem does this paper attempt to address?

Optimal monitor-based supervisor sythesis for a class of Petri nets with unobservable transitions

Ning Ran,Hongye Su,Weimin Wu,Shouguang Wang,Huixia Liu

DOI: https://doi.org/10.1109/ICNSC.2015.7116087

2015-01-01

Abstract:This paper deals with constraint transformation problems in a system with unobservable events, which is modeled by Petri nets with unobservable transitions. First, the concept of an unobservable influence subnet is presented and its properties are studied. Next, based on the properties, an algorithm is proposed to transform a given generalized mutual exclusion constraint (GMEC) into an optimal admissible one that can be enforced directly on the net in the form of monitor-based supervisor. The proposed algorithm has high computational efficiency at the expense of application scope. Finally, an example is used to illustrate the application of the proposed method.
Optimal incentive contract with endogenous monitoring technology

Anqi Li,Ming Yang

DOI: https://doi.org/10.3982/TE3130

2020-07-06

Theoretical Economics

Abstract:Recent technology advances have enabled firms to flexibly process and analyze sophisticated employee performance data at a reduced and yet significant cost. We develop a theory of optimal incentive contracting where the monitoring technology that governs the above procedure is part of the designer's strategic planning. In otherwise standard principal–agent models with moral hazard, we allow the principal to partition agents' performance data into any finite categories, and to pay for the amount of information the output signal carries. Through analysis of the trade‐off between giving incentives to agents and saving the monitoring cost, we obtain characterizations of optimal monitoring technologies such as information aggregation, strict monotone likelihood ratio property, likelihood ratio–convex performance classification, group evaluation in response to rising monitoring costs, and assessing multiple task performances according to agents' endogenous tendencies to shirk. We examine implications of these results for workforce management and firms' internal organizations.

economics
Distributed system contract monitoring

Adrian Francalanza,Andrew Gauci,Gordon J. Pace

DOI: https://doi.org/10.1016/j.jlap.2013.04.001

2013-07-01

The Journal of Logic and Algebraic Programming

Abstract:Runtime verification of distributed systems poses various challenges. A pivotal challenge is the choice of howto distribute the monitors themselves across the system.On one hand, centralised monitoringmay result in increased communication overhead and information exposure across locations, while, on the other hand, systems with dynamic topologies and properties are difficult to address using static monitor choreographies. In this paper we present mDPi, a location-aware π-calculus extension for reasoning about the distributed monitoring scenario.We also define numerousmonitoring strategies for a regular expression-based logic, including a novel approach in which monitors migrate to ensure local monitoring. Finally, we present a number of results which emerge from this formalism, justifying our approach.

English Else
Dynamic Contract Design in the Presence Of Double Moral Hazard

Feng Tian,Ekaterina Astashkina,Izak Duenyas

DOI: https://doi.org/10.2139/ssrn.4249177

2023-01-01

SSRN Electronic Journal

Abstract:We consider a stylized incentive management problem over an infinite time horizon, where the principal hires an agent to provide services to customers. Customers request service in one of two ways: either via an online or a traditional, offline, channel. The principal does not observe the offline customers' arrivals, nor does she observe whether the agent exerts (costly) effort that can increase the arrival rate of customers. This creates an opportunity for the agent (i) to divert cash (that is, to under-report the number of offline customers and pocket respective revenues) and also (ii) to shirk (that is, not to exert effort), thus, leading to a novel and so-far-unexplored double moral hazard problem. To address this problem, we formulate a constrained, continuous-time, stochastic optimal control problem and derive an optimal contract with a simple, intuitive structure, that includes a payment scheme and a potential termination time of the agent. We enrich the model to allow the principal to either (i) monitor the agent or (ii) dynamically adjust the prices for the services in both channels. Both tools help the principal to alleviate the double moral hazard problem. We derive respective optimal strategies for using those tools that guarantee highest profits. We show that the worse the agent's past performance is, the more the principal should monitor the agent and the lower the prices should be set. Finally, we demonstrate that sole monitoring of the offline arrivals can, sometimes, make the agent better off, as opposed to the situation when the principal monitors both the offline arrivals and effort, which always makes the agent worse off.
Transaction Monitoring of Smart Contracts

Margarita Capretto,Martin Ceresa,Cesar Sanchez

DOI: https://doi.org/10.48550/arXiv.2207.02517

2022-07-06

Cryptography and Security

Abstract:Blockchains are modern distributed systems that provide decentralized financial capabilities with trustable guarantees. Smart contracts are programs written in specialized programming languages running on a blockchain and govern how tokens and cryptocurrency are sent and received. Smart contracts can invoke other contracts during the execution of transactions initiated by external users. Once deployed, smart contracts cannot be modified and their pitfalls can cause malfunctions and losses, for example by attacks from malicious users. Runtime verification is a very appealing technique to improve the reliability of smart contracts. One approach consists of specifying undesired executions (never claims) and detecting violations of the specification on the fly. This can be done by extending smart contracts with additional instructions corresponding to monitor specified properties, resulting in an onchain monitoring approach. In this paper, we study transaction monitoring that consists of detecting violations of complete transaction executions and not of individual operations within transactions. Our main contributions are to show that transaction monitoring is not possible in most blockchains and propose different execution mechanisms that would enable transaction monitoring.
Dynamic Contracts with Partial Observations: Application to Indirect Load Control

Insoon Yang,Duncan S. Callaway,Claire J. Tomlin

DOI: https://doi.org/10.48550/arXiv.1403.5328

2014-03-21

Abstract:This paper proposes a method to design an optimal dynamic contract between a principal and an agent, who has the authority to control both the principal's revenue and an engineered system. The key characteristic of our problem setting is that the principal has very limited information: the principal has no capability to monitor the agent's control or the state of the engineered system. The agent has perfect observations. With this asymmetry of information, we show that the principal can induce the agent to control both the revenue and the system processes in a way that maximizes the principal's utility, if the principal offers appropriate real-time and end-time compensation. We reformulate the dynamic contract design problem as a stochastic optimal control of both the engineered system and the agent's future expected payoff, which can be numerically solved using an associated Hamilton-Jacobi-Bellman equation. The performance and usefulness of the proposed contract are demonstrated with an indirect load control problem.

Optimization and Control
But Who Will Monitor the Monitor?

David Rahman

DOI: https://doi.org/10.1257/aer.102.6.2767

IF: 10.7

2012-10-01

American Economic Review

Abstract:Suppose that providing incentives for a group of individuals in a strategic context requires a monitor to detect their deviations. What about the monitor's deviations? To address this question, I propose a contract that makes the monitor responsible for monitoring, and thereby provides incentives even when the monitor's observations are not only private, but costly, too. I also characterize exactly when such a contract can provide monitors with the right incentives to perform. In doing so, I emphasize virtual enforcement and suggest its implications for the theory of repeated games. (JEL C78, D23, D82, D86)

economics
Model Predictive Monitoring of Dynamical Systems for Signal Temporal Logic Specifications

Xinyi Yu,Weijie Dong,Xiang Yin,Shaoyuan Li

2023-11-09

Abstract:Online monitoring aims to evaluate or to predict, at runtime, whether or not the behaviors of a system satisfy some desired specification. It plays a key role in safety-critical cyber-physical systems. In this work, we propose a new monitoring approach, called model predictive monitoring, for specifications described by Signal Temporal Logic (STL) formulae. Specifically, we assume that the observed state traces are generated by an underlying dynamical system whose model is known but the control law is unknown. The main idea is to use the dynamic of the system to predict future states when evaluating the satisfaction of the STL formulae. To this end, effective approaches for the computation of feasible sets of STL formulae are provided. We show that, by explicitly utilizing the model information of the dynamical system, the proposed online monitoring algorithm can falsify or certify of the specification in advance compared with existing algorithms, where no model information is used. We also demonstrate the proposed monitoring algorithm by several real world case studies.

Systems and Control,Formal Languages and Automata Theory
Online Monitoring of Dynamic Systems for Signal Temporal Logic Specifications with Model Information

Xinyi Yu,Weijie Dong,Xiang Yin,Shaoyuan Li

DOI: https://doi.org/10.48550/arXiv.2203.16267

2022-03-30

Abstract:Online monitoring aims to evaluate or to predict, at runtime, whether or not the behaviors of a system satisfy some desired specification. It plays a key role in safety-critical cyber-physical systems. In this work, we propose a new model-based approach for online monitoring for specifications described by Signal Temporal Logic (STL) formulae. Specifically, we assume that the observed state traces are generated by an underlying dynamic system whose model is known. The main idea is to consider the dynamic of the system when evaluating the satisfaction of the STL formulae. To this end, effective approaches for the computation of feasible sets for STL formulae are provided. We show that, by explicitly utilizing the model information of the dynamic system, the proposed online monitoring algorithm can falsify or certify of the specification in advance compared with existing algorithms, where no model information is used. We also demonstrate the proposed monitoring algorithm by case studies.

Systems and Control
Monitoring with Rich Data

Mira Frick,Ryota Iijima,Yuhta Ishii

2024-07-03

Abstract:We consider moral hazard problems where a principal has access to rich monitoring data about an agent's action. Rather than focusing on optimal contracts (which are known to in general be complicated), we characterize the optimal rate at which the principal's payoffs can converge to the first-best payoff as the amount of data grows large. Our main result suggests a novel rationale for the widely observed binary wage schemes, by showing that such simple contracts achieve the optimal convergence rate. Notably, in order to attain the optimal convergence rate, the principal must set a lenient cutoff for when the agent receives a high vs. low wage. In contrast, we find that other common contracts where wages vary more finely with observed data (e.g., linear contracts) approximate the first-best at a highly suboptimal rate. Finally, we show that the optimal convergence rate depends only on a simple summary statistic of the monitoring technology. This yields a detail-free ranking over monitoring technologies that quantifies their value for incentive provision in data-rich settings and applies regardless of the agent's specific utility or cost functions.

Theoretical Economics,Computer Science and Game Theory
Optimal Dynamic Contract of Influence

Yi Chen

DOI: https://doi.org/10.2139/ssrn.3303006

2018-01-01

SSRN Electronic Journal

Abstract:In this paper, I study the optimal dynamic contract in a principal-agent model wherein the agent with transparent preferences privately observes a persistently evolving state. Over time, the principal takes actions to match a state-dependent target, where actions are committed based on the agent's report history. I solve the optimal contract in closed-form, which sometimes prescribes actions that move in the opposite direction of the target. I provide a simple necessary and sufficient condition for that to occur. The principal generically fares better than babbling, but efficiency is not approached as players become patient. Over time, the principal is worse off in expectation, but the agent fares better or worse depending on the shape of the principal's state-dependent target. Mean reversion leads to more co-movement between the action and the target. A short horizon dampens the principal's response to information.
A Mode of Intelligent Equipment Monitoring Optimization Based on Dynamic Programming Algorithm

Zhilei Zheng,Chuan Jiang

DOI: https://doi.org/10.1155/2022/1569428

IF: 3.12

2022-03-18

Computational Intelligence and Neuroscience

Abstract:With the continuous development of the national economy and scientific productivity, urban construction and people’s living standards are also getting higher and higher. Although people enjoy increasingly convenient life, the demand for intelligence is getting higher and higher. Digital intelligent equipment has the functions of data collection, calculation and analysis, diagnostic and early warning, and communication functions. Analyze the status quo and existing problems of the development of intelligent equipment, as well as analyze and research key monitoring technologies in the use and development of digital intelligent equipment and provide optimal solutions for intelligent equipment hardware development requirements, software development, and model algorithms. Intelligent equipment monitoring is related to all aspects of people’s livelihood, and its intelligent development is related to the public role in this field in the future. Accurate results of monitoring can provide data support for schools, research institutions, the public, and the government. At the same time, it is also an important basis for formulating social policies. At present, the commonly used monitoring method usually adopts time series algorithm. Through literature review, it is found that the algorithm has the problem of distortion of correct data, which affects the accuracy of monitoring results. Based on the above reasons, this article combines the wavelet function with the planning algorithm and proposes a dynamic programming algorithm, which removes the redundant monitoring data in turn and clusters the distortion monitoring data with the wavelet function, which improves the accuracy and computational efficiency of the algorithm and gives full play to the monitoring of intelligence. The simulation results using MATLAB show that the planning algorithm can eliminate 90% of redundant monitoring data and improve the extraction rate of characteristic monitoring data. At the same time, the accuracy of the planning algorithm reaches 95%, and the calculation time is less than 25 s, which is better than the static planning algorithm. Therefore, the dynamic programming algorithm can better utilize the intelligence, convenience, and efficiency of the equipment to optimize the monitoring model.

mathematical & computational biology,neurosciences
Optimizing Static and Adaptive Probing Schedules for Rapid Event Detection

Ahmad Mahmoody,Evgenios M. Kornaropoulos,Eli Upfal

DOI: https://doi.org/10.48550/arXiv.1509.02487

2015-09-10

Abstract:We formulate and study a fundamental search and detection problem, Schedule Optimization, motivated by a variety of real-world applications, ranging from monitoring content changes on the web, social networks, and user activities to detecting failure on large systems with many individual machines. We consider a large system consists of many nodes, where each node has its own rate of generating new events, or items. A monitoring application can probe a small number of nodes at each step, and our goal is to compute a probing schedule that minimizes the expected number of undiscovered items at the system, or equivalently, minimizes the expected time to discover a new item in the system. We study the Schedule Optimization problem both for deterministic and randomized memoryless algorithms. We provide lower bounds on the cost of an optimal schedule and construct close to optimal schedules with rigorous mathematical guarantees. Finally, we present an adaptive algorithm that starts with no prior information on the system and converges to the optimal memoryless algorithms by adapting to observed data.

Data Structures and Algorithms,Machine Learning
Adaptive Monitoring For Transition Process Using Dynamic Mutual Information Similarity Analysis

Yuchen He,Zhiqiang Ge,Zhihuan Song

DOI: https://doi.org/10.1109/CCDC.2016.7532041

2016-01-01

Abstract:Due to the non-stationarity in a transition process, it is impossible to implement the monitoring using conventional statistical algorithms. In this paper, a novel identification and monitoring method for transitions using the mutual information similarity analysis (MISA) is proposed to cope with the problem. In the MISA method, the difference between different stable modes as well as transitions is identified. Therefore, the whole process can be divided into several small sub-segments. Considering the dynamic information contained in the process, the classical DPLS model is utilized for online identification and monitoring. Finally, the proposed algorithm is tested using the TE benchmark.
Sleep When Everything Looks Fine: Self-Triggered Monitoring for Signal Temporal Logic Tasks

Chuwei Wang,Xinyi Yu,Jianing Zhao,Lars Lindemann,Xiang Yin

2023-11-27

Abstract:Online monitoring is a widely used technique in assessing if the performance of the system satisfies some desired requirements during run-time operation. Existing works on online monitoring usually assume that the monitor can acquire system information periodically at each time instant. However, such a periodic mechanism may be unnecessarily energy-consuming as it essentially requires to turn on sensors consistently. In this paper, we proposed a novel self-triggered mechanism for model-based online monitoring of discrete-time dynamical system under specifications described by signal temporal logic (STL) formulae. Specifically, instead of sampling the system state at each time instant, a self-triggered monitor can actively determine when the next system state is sampled in addition to its monitoring decision regarding the satisfaction of the task. We propose an effective algorithm for synthesizing such a self-triggered monitor that can correctly evaluate a given STL formula on-the-fly while maximizing the time interval between two observations. We show that, compared with the standard online monitor with periodic information, the proposed self-triggered monitor can significantly reduce observation burden while ensuring that no information of the STL formula is lost. Case studies are provided to illustrate the proposed monitoring mechanism.

Systems and Control
Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

Markus Rabe,Sven Schewe

DOI: https://doi.org/10.4204/EPTCS.28.10

2010-06-26

Abstract:We study time-bounded reachability in continuous-time Markov decision processes for time-abstract scheduler classes. Such reachability problems play a paramount role in dependability analysis and the modelling of manufacturing and queueing systems. Consequently, their analysis has been studied intensively, and techniques for the approximation of optimal control are well understood. From a mathematical point of view, however, the question of approximation is secondary compared to the fundamental question whether or not optimal control exists. We demonstrate the existence of optimal schedulers for the time-abstract scheduler classes for all CTMDPs. Our proof is constructive: We show how to compute optimal time-abstract strategies with finite memory. It turns out that these optimal schedulers have an amazingly simple structure - they converge to an easy-to-compute memoryless scheduling policy after a finite number of steps. Finally, we show that our argument can easily be lifted to Markov games: We show that both players have a likewise simple optimal strategy in these more general structures.

Formal Languages and Automata Theory
A Non-optimality Detection Technique for Continuous Processes

Lingjian Ye,Yi Cao,Xiushui Ma,Zhihuan Song

DOI: https://doi.org/10.3182/20140824-6-za-1003.00979

2014-01-01

IFAC Proceedings Volumes

Abstract:This paper develops a novel non-optimality detection technique for continuous processes based on the theory of process monitoring. Since the optimal statuses have some common features so as to satisfy optimality necessary conditions, the distributions of process variables are found to fall in some subspace that is determined from the disturbances. To detect those statuses that are not optimally operated, non-optimality is considered as a special kind of process fault. An equivalent interpretation is also provided to demonstrate the rationale of proposed analogy. For illustration, the principal component analysis (PCA) is particularly employed as a detection tool, whose effectiveness is verified through an exothermic reactor example.
Approximately Optimal Monitoring of Plan Preconditions

Craig Boutilier

DOI: https://doi.org/10.48550/arXiv.1301.3839

IF: 14.4

2013-01-16

Artificial Intelligence

Abstract:Monitoring plan preconditions can allow for replanning when a precondition fails, generally far in advance of the point in the plan where the precondition is relevant. However, monitoring is generally costly, and some precondition failures have a very small impact on plan quality. We formulate a model for optimal precondition monitoring, using partially-observable Markov decisions processes, and describe methods for solving this model efficitively, though approximately. Specifically, we show that the single-precondition monitoring problem is generally tractable, and the multiple-precondition monitoring policies can be efficitively approximated using single-precondition soultions.
Formal Specification-based Online Monitoring

Hui Liang,Jin Song Dong,Jing Sun,Roger Duke,Rudolph E. Seviora

DOI: https://doi.org/10.1109/iceccs.2006.1690364

2006-01-01

Abstract:With current trends towards more complex software system and use of higher level languages, a monitoring technique is of increasing importance for the areas such as performance enhancement, dependability, correctness checking and so on. In this paper, we present a formal specification-based online monitoring technique. The key idea of our technique is to build a linking system, which connects a specification animator and a program debugger. The required information about dynamic behaviors of the formal specification and concrete implementation of a target system is obtained from the animator and the debugger. Based on that information, the judgment on the consistency of the concrete implementation with the formal specification will be provided. Not embedding any instrumentation code into the target system, our monitoring technique will not alter the dynamic behavior of the target system. Animating the formal specification, rather than annotating the target system with extra formal specifications, our monitoring technique separates the implementation-dependent description of the monitored objects and the formal requirement specification of them
Dynamic Distributed Monitoring Strategy for Large-Scale Nonstationary Processes Subject to Frequently Varying Conditions Under Closed-Loop Control.

Chunhui Zhao,He Sun

DOI: https://doi.org/10.1109/TIE.2018.2864703

IF: 7.7

2019-01-01

IEEE Transactions on Industrial Electronics

Abstract:Large-scale processes under closed-loop control are commonly subjected to frequently varying conditions due to load changes or other causes, resulting in typical nonstationary characteristics. For closed-loop control processes, the normal changes in operation conditions may distort the static and dynamic variations in a different way from real faults. In this paper, a dynamic distributed monitorin...

Optimal Monitoring Schedule in Dynamic Contracts

Optimal monitor-based supervisor sythesis for a class of Petri nets with unobservable transitions

Optimal incentive contract with endogenous monitoring technology

Distributed system contract monitoring

Dynamic Contract Design in the Presence Of Double Moral Hazard

Transaction Monitoring of Smart Contracts

Dynamic Contracts with Partial Observations: Application to Indirect Load Control

But Who Will Monitor the Monitor?

Model Predictive Monitoring of Dynamical Systems for Signal Temporal Logic Specifications

Online Monitoring of Dynamic Systems for Signal Temporal Logic Specifications with Model Information

Monitoring with Rich Data

Optimal Dynamic Contract of Influence

A Mode of Intelligent Equipment Monitoring Optimization Based on Dynamic Programming Algorithm

Optimizing Static and Adaptive Probing Schedules for Rapid Event Detection

Adaptive Monitoring For Transition Process Using Dynamic Mutual Information Similarity Analysis

Sleep When Everything Looks Fine: Self-Triggered Monitoring for Signal Temporal Logic Tasks

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

A Non-optimality Detection Technique for Continuous Processes

Approximately Optimal Monitoring of Plan Preconditions

Formal Specification-based Online Monitoring

Dynamic Distributed Monitoring Strategy for Large-Scale Nonstationary Processes Subject to Frequently Varying Conditions Under Closed-Loop Control.