Abstract:A machine-learned system that is fair in static decision-making tasks may have biased societal impacts in the long-run. This may happen when the system interacts with humans and feedback patterns emerge, reinforcing old biases in the system and creating new biases. While existing works try to identify and mitigate long-run biases through smart system design, we introduce techniques for monitoring fairness in real time. Our goal is to build and deploy a monitor that will continuously observe a long sequence of events generated by the system in the wild, and will output, with each event, a verdict on how fair the system is at the current point in time. The advantages of monitoring are two-fold. Firstly, fairness is evaluated at run-time, which is important because unfair behaviors may not be eliminated a priori, at design-time, due to partial knowledge about the system and the environment, as well as uncertainties and dynamic changes in the system and the environment, such as the unpredictability of human behavior. Secondly, monitors are by design oblivious to how the monitored system is constructed, which makes them suitable to be used as trusted third-party fairness watchdogs. They function as computationally lightweight statistical estimators, and their correctness proofs rely on the rigorous analysis of the stochastic process that models the assumptions about the underlying dynamics of the system. We show, both in theory and experiments, how monitors can warn us (1) if a bank's credit policy over time has created an unfair distribution of credit scores among the population, and (2) if a resource allocator's allocation policy over time has made unfair allocations. Our experiments demonstrate that the monitors introduce very low overhead. We believe that runtime monitoring is an important and mathematically rigorous new addition to the fairness toolbox.

But Who Will Monitor the Monitor?

Do Venture Capitalists Play A Monitoring Role in an Emerging Market? Evidence from the Pay-Performance Relationship of Chinese Entrepreneurial Firms

Optimal incentive contract with endogenous monitoring technology

Monitoring Strategies of Enterprise's Emission Reduction with Asymmetric Information.

Monitoring with Rich Data

Incentives to Monitor Borrowers in Fulfilling Loan Contracts

Voting by Hands Promotes Institutionalised Monitoring in Indirect Reciprocity

Designing Incentive Schemes Based on Intervention: The Case of Perfect Monitoring

Monitoring the Monitor: Does Ownership Matter?

Supervision, peer pressure, and incentives in a labor-managed firm

Dynamic Contract Design in the Presence Of Double Moral Hazard

Should transparency be (in-)transparent? On monitoring aversion and cooperation in teams

Monitoring decisions in vertical integration

Evolution of public cooperation in a monitored society with implicated punishment and within-group enforcement

Monitoring: Which Institutions Matter?

New Security Offerings As an Incentive Mechanism

The Interactive Effect of Monitoring and Incentive Alignment on Agency Costs

Designing Efficient Resource Sharing For Impatient Players Using Limited Monitoring

Better monitoring ...Worse outcome?

Runtime Monitoring of Dynamic Fairness Properties

Uniformly strict equilibrium for repeated games with private monitoring and communication