Flexible Optimization for Cyber-Physical and Human Systems

Andrea Simonetto

2024-03-07

Abstract:Can we allow humans to pick among different, yet reasonably similar, decisions? Are we able to construct optimization problems whose outcome are sets of feasible, close-to-optimal decisions for human users to pick from, instead of a single, hardly explainable, do-as-I-say ``optimal'' directive?

Optimization and Control

What problem does this paper attempt to address?

Optimal Coupling Pattern of Cyber-Physical Systems

Jiang,Hui-Liang Shen,Yongxiang Xia,Herbert H. C. Iu

DOI: https://doi.org/10.1109/iscas51556.2021.9401252

2021-01-01

Abstract:In the modern society, physical infrastructure and information technology are inseparable. The concept of cyber-physical systems (CPSs) is then proposed and has been widely concerned by researchers in recent years. Various models have been introduced to meet the actual needs. In one type of those models, the physical part and the cyber part are coupled and influence each other. The cyber part monitors and controls the physical part, but at the same time it may also bring certain harm; the fault in one part may also be transmitted to the other and affect the performance of the counterpart. Here, this paper introduces an asymmetric interdependent model and studies how the coupling pattern of CPSs affects the system robustness. In addition, the coupling pattern of CPSs is optimized by using the simulated annealing (SA) algorithm to reduce the performance loss. The results of this paper may find applications in the future CPS planning.
Robustness Improvement for Cyber Physical System Based on an Optimization Model of Interdependent Constraints

Haicheng Tu,Yongxiang Xia,Xi Zhang,Hui-liang Shen

DOI: https://doi.org/10.1063/5.0043601

2021-01-01

Chaos An Interdisciplinary Journal of Nonlinear Science

Abstract:With the rapid development of information technology, traditional infrastructure networks have evolved into cyber physical systems (CPSs). However, this evolution has brought along with it cyber failures, in addition to physical failures, which can affect the safe and stable operation of the whole system. In light of this, in this paper, we propose an interdependence-constrained optimization model to improve the robustness of the cyber physical system. The proposed model includes not only the realistic physical law but also the interdependence between the physical network and the cyber network. However, this model is highly nonlinear and cannot be solved directly. Therefore, we transform the model into a bi-level mixed integer linear programming problem, which can be easily and effectively solved in polynomial time. We conduct the simulation based on standard Institute of Electrical and Electronics Engineers test cases and study the impact of the disaster level and coupling strength on the robustness of the whole system. The simulation results show that our proposed model can effectively improve the robustness of the cyber physical system. Moreover, we compare the performance of the power supply in different CPSs, which have different network structures of the cyber network. Our work can provide useful instructions for system operators to improve the robustness of CPSs after extreme events happen in them.
Multi-Objective Optimization for Cyber-Physical-Social Systems: A Case Study of Electric Vehicles Charging and Discharging

Wei Li,Zhiyun Lin,Hanyun Zhou,Gangfeng Yan

DOI: https://doi.org/10.1109/access.2019.2921716

IF: 3.9

2019-01-01

IEEE Access

Abstract:Cyber-physical-social system (CPSS), an integration of cyberspace, physical space, and social space, has revolutionized the relationship between human, computers, and physical environments. Electrical cyber-physical system integrating human behaviors and interactions is a typical CPSS, and the study of electric vehicles (EVs) charging and discharging in the CPSS has become a research hotspot due to its environmental advantages and social benefits. This paper focuses on simultaneously optimizing the power load stability and the total cost of vehicle owners in the CPSS. First, the optimal scheduling problem is formulated as a multi-objective optimization problem with system's technical constraints, and then a hierarchical optimal algorithm is proposed to solve the problem. The convergence analysis of the proposed algorithm is presented to ensure its optimal performance. Further, this paper combines the proposed algorithm with a moving horizon method to deal with the EV owners random arrival and departure case based on the owners' convenience and preferences. It shows that the proposed algorithm not only enhances stable performance of the power load but also improves satisfaction of the vehicle owners in the CPSS framework integrating power grids, energy consumption areas, and social components. Numerical simulations are presented to demonstrate the effectiveness of the proposed algorithm.
Flexible here-and-now decisions for two-stage multi-objective optimization: Method and application to energy system design selection

Dinah Elena Hollermann,Marc Goerigk,Dörthe Franzisca Hoffrogge,Maike Hennen,André Bardow

DOI: https://doi.org/10.48550/arXiv.1906.08621

2019-06-20

Abstract:The synthesis of energy systems is a two-stage optimization problem where design decisions have to be implemented here-and-now (first stage), while for the operation of installed components, we can wait-and-see (second stage). To identify a sustainable design, we need to account for both economical and environmental criteria leading to multi-objective optimization problems. However, multi-objective optimization leads not to one optimal design but to multiple Pareto-efficient design options in general. Thus, the decision maker usually has to decide manually which design should finally be implemented. In this paper, we propose the flexible here-and-now decision (flex-hand) approach for automatic identification of one single design for multi-objective optimization. The approach minimizes the distance of the Pareto front based on one fixed design to the Pareto front allowing multiple designs. Uncertainty regarding parameters of future operations can be easily included through a robust extension of the flex-hand approach. Results of a real-world case study show that the obtained design is highly flexible to adapt operation to the considered objective functions. Thus, the design provides an energy system with the ability to adapt to a changing focus in decision criteria, e. g., due to changing political aims.

Optimization and Control,Systems and Control
Resilient Distributed Optimization for Multi-Agent Cyberphysical Systems

Michal Yemini,Angelia Nedić,Andrea J. Goldsmith,Stephanie Gil

2024-06-06

Abstract:This work focuses on the problem of distributed optimization in multi-agent cyberphysical systems, where a legitimate agents' iterates are influenced both by the values it receives from potentially malicious neighboring agents, and by its own self-serving target function. We develop a new algorithmic and analytical framework to achieve resilience for the class of problems where stochastic values of trust between agents exist and can be exploited. In this case we show that convergence to the true global optimal point can be recovered, both in mean and almost surely, even in the presence of malicious agents. Furthermore, we provide expected convergence rate guarantees in the form of upper bounds on the expected squared distance to the optimal value. Finally, numerical results are presented that validate our analytical convergence guarantees even when the malicious agents compose the majority of agents in the network and where existing methods fail to converge to the optimal nominal points.

Robotics,Signal Processing,Systems and Control
Stochastic Online Optimization for Cyber-Physical and Robotic Systems

Hao Ma,Melanie Zeilinger,Michael Muehlebach

2024-04-08

Abstract:We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that model the evolution of a cyber-physical system, which has, in general, a continuous state and action space, is nonlinear, and where the state is only partially observed. We also incorporate an approximate model of the dynamics as prior knowledge into the learning process and show that even rough estimates of the dynamics can significantly improve the convergence of our algorithms. Our online optimization framework encompasses both gradient descent and quasi-Newton methods, and we provide a unified convergence analysis of our algorithms in a non-convex setting. We also characterize the impact of modeling errors in the system dynamics on the convergence rate of the algorithms. Finally, we evaluate our algorithms in simulations of a flexible beam, a four-legged walking robot, and in real-world experiments with a ping-pong playing robot.

Machine Learning,Robotics
An Optimization Approach for a Robust and Flexible Control in Collaborative Applications

Federico Benzi,Cristian Secchi

DOI: https://doi.org/10.1109/icra48506.2021.9561098

2021-05-30

Abstract:In Human-Robot Collaboration, the robot operates in a highly dynamic environment. Thus, it is pivotal to guarantee the robust stability of the system during the interaction but also a high flexibility of the robot behavior in order to ensure safety and reactivity to the variable conditions of the collaborative scenario. In this paper we propose a control architecture capable of maximizing the flexibility of the robot while guaranteeing a stable behavior when physically interacting with the environment. This is achieved by combining an energy tank based variable admittance architecture with control barrier functions. The proposed architecture is experimentally validated on a collaborative robot.
Multi-Objective Controller Synthesis with Uncertain Human Preferences

Shenghui Chen,Kayla Boggess,David Parker,Lu Feng

DOI: https://doi.org/10.48550/arXiv.2105.04662

2022-03-03

Abstract:Complex real-world applications of cyber-physical systems give rise to the need for multi-objective controller synthesis, which concerns the problem of computing an optimal controller subject to multiple (possibly conflicting) criteria. The relative importance of objectives is often specified by human decision-makers. However, there is inherent uncertainty in human preferences (e.g., due to artifacts resulting from different preference elicitation methods). In this paper, we formalize the notion of uncertain human preferences and present a novel approach that accounts for this uncertainty in the context of multi-objective controller synthesis for Markov decision processes (MDPs). Our approach is based on mixed-integer linear programming and synthesizes an optimally permissive multi-strategy that satisfies uncertain human preferences with respect to a multi-objective property. Experimental results on a range of large case studies show that the proposed approach is feasible and scalable across varying MDP model sizes and uncertainty levels of human preferences. Evaluation via an online user study also demonstrates the quality and benefits of the synthesized controllers.

Artificial Intelligence,Formal Languages and Automata Theory
A Framework for Effective AI Recommendations in Cyber-Physical-Human Systems

Aditya Dave,Heeseung Bang,Andreas A. Malikopoulos

2024-03-09

Abstract:Many cyber-physical-human systems (CPHS) involve a human decision-maker who may receive recommendations from an artificial intelligence (AI) platform while holding the ultimate responsibility of making decisions. In such CPHS applications, the human decision-maker may depart from an optimal recommended decision and instead implement a different one for various reasons. In this letter, we develop a rigorous framework to overcome this challenge. In our framework, we consider that humans may deviate from AI recommendations as they perceive and interpret the system's state in a different way than the AI platform. We establish the structural properties of optimal recommendation strategies and develop an approximate human model (AHM) used by the AI. We provide theoretical bounds on the optimality gap that arises from an AHM and illustrate the efficacy of our results in a numerical example.

Systems and Control,Artificial Intelligence,Human-Computer Interaction,Machine Learning
Real-time Optimization, Supervisory and Safety Control for Distributed Networked Cyber-physical System

Shaoyuan LI,Yuanqing XIA,Peng CHENG

DOI: https://doi.org/10.13976/j.cnki.xk.2018.0001

2018-01-01

Information and Control

Abstract:Networked CPS systems are a class of complicated physical systems with inter-connected and coupled sub-systems. By exchanging information via networks, each sub-system can coordinate and optimize their be-haviors and make local decisions in order to achieve global tasks. For this class of systems, it is difficult to solve the optimization problems efficiently and adaptively using the classical centralized approaches. There-fore, it is necessary and important to develop novel distributed optimization methods for networked systems. In particular, there is a great demand for such distributed methods in modern distributed networked systems, in-cluding smart-grids and sensor networks. In this project, we tackle the difficulties in real-time optimization and decision making of networked systems. By investigating the information exchange mechanisms and the physical couplings between each sub-system, three key problems are formulated:the constrained optimization problem when dynamical coupling, the decision making problem for consensus under multi-task conflict and the adaptive cooperation problem under network topology changes. By adjusting the feasible region of the dy-namically-coupled constrained optimization problem, analyzing and predicting the dynamic behavior of each sub-system, and switching the operation mode of the system, we develop a comprehensive framework for real-time optimization and decision making of networked systems. Much progress in the CPS optimization and control has been made, in this paper, some further problems are discussed based on the results of this special issue.
A Scalable Stochastic Programming Approach for the Design of Flexible Systems

Joshua L. Pulsipher,Victor M. Zavala

DOI: https://doi.org/10.1016/j.compchemeng.2019.05.033

2021-06-24

Abstract:We study the problem of designing systems in order to minimize cost while meeting a given flexibility target. Flexibility is attained by enforcing a joint chance constraint, which ensures that the system will exhibit feasible operation with a given target probability level. Unfortunately, joint chance constraints are complicated mathematical objects that often need to be reformulated using mixed-integer programming (MIP) techniques. In this work, we cast the design problem as a conflict resolution problem that seeks to minimize cost while maximizing flexibility. We propose a purely continuous relaxation of this problem that provides a significantly more scalable approach relative to MIP methods and show that the formulation delivers solutions that closely approximate the Pareto set of the original joint chance-constrained problem.

Optimization and Control
Online Pareto-Optimal Decision-Making for Complex Tasks using Active Inference

Peter Amorese,Shohei Wakayama,Nisar Ahmed,Morteza Lahijanian

2024-06-18

Abstract:When a robot autonomously performs a complex task, it frequently must balance competing objectives while maintaining safety. This becomes more difficult in uncertain environments with stochastic outcomes. Enhancing transparency in the robot's behavior and aligning with user preferences are also crucial. This paper introduces a novel framework for multi-objective reinforcement learning that ensures safe task execution, optimizes trade-offs between objectives, and adheres to user preferences. The framework has two main layers: a multi-objective task planner and a high-level selector. The planning layer generates a set of optimal trade-off plans that guarantee satisfaction of a temporal logic task. The selector uses active inference to decide which generated plan best complies with user preferences and aids learning. Operating iteratively, the framework updates a parameterized learning model based on collected data. Case studies and benchmarks on both manipulation and mobile robots show that our framework outperforms other methods and (i) learns multiple optimal trade-offs, (ii) adheres to a user preference, and (iii) allows the user to adjust the balance between (i) and (ii).

Robotics,Artificial Intelligence
Personalized Optimization with User's Feedback

Andrea Simonetto,Emiliano Dall'Anese,Julien Monteil,Andrey Bernstein

DOI: https://doi.org/10.1016/j.automatica.2021.109767

2020-08-06

Abstract:This paper develops an online algorithm to solve a time-varying optimization problem with an objective that comprises a known time-varying cost and an unknown function. This problem structure arises in a number of engineering systems and cyber-physical systems where the known function captures time-varying engineering costs, and the unknown function models user's satisfaction; in this context, the objective is to strike a balance between given performance metrics and user's satisfaction. Key challenges related to the problem at hand are related to (1) the time variability of the problem, and (2) the fact that learning of the user's utility function is performed concurrently with the execution of the online algorithm. This paper leverages Gaussian processes (GP) to learn the unknown cost function from noisy functional evaluation and build pertinent upper confidence bounds. Using the GP formalism, the paper then advocates time-varying optimization tools to design an online algorithm that exhibits tracking of the oracle-based optimal trajectory within an error ball, while learning the user's satisfaction function with no-regret. The algorithmic steps are inexact, to account for possible limited computational budgets or real-time implementation considerations. Numerical examples are illustrated based on a problem related to vehicle platooning.

Optimization and Control,Systems and Control
Evolutionary Optimization of Complex Systems in Uncertain Environments

Yaochu Jin

DOI: https://doi.org/10.2991/ifsa-eusflat-15.2015.4

2015-01-01

Abstract:This talk aims to discuss the main challenges in evolutionary optimization of complex systems to bridge the gap between the academic research and the urgent demands from industry. We will show that, while solving “hard” problems, such as multi-modal and strongly correlated problems, multi-objective optimization problems with a large number of objectives, and multi-objective optimization problems having a very complex Pareto front are popular in academia, industry is more concerned with complexity in formulating the optimization problems, choosing the right decision variables, defining the most important objectives, dealing with computationally very expensive and uncertain problems, and handling different time/cost constraints in the conceptual, design and verification phases. We will also point out that some assumptions in the present research on multi-objective and dynamic optimization are unrealistic, leading to results of little practical value. In the presentation, several application examples from industry, such as design optimization of vehicles, high-lift wing systems, micro heat exchangers, and steel-making and continuous casting will be used to illustrate the real-world challenges in evolutionary optimization. 16th World Congress of the International Fuzzy Systems Association (IFSA) 9th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT) © 2015. The authors Published by Atlantis Press 13
Multi-Agent Optimization for Safety Analysis of Cyber-Physical Systems: Position Paper

Önder Gürcan,Nataliya Yakymets,Sara Tucci-Piergiovanni,Ansgar Radermacher

2024-03-26

Abstract:Failure Mode, Effects and Criticality Analysis (FMECA) is one of the safety analysis methods recommended by most of the international standards. The classical FMECA is made in a form of a table filled in either manually or by using safety analysis tools. In both cases, the design engineers have to choose the trade-offs between safety and other development constraints. In the case of complex cyber-physical systems (CPS) with thousands of specified constraints, this may lead to severe problems and significantly impact the overall criticality of CPS. In this paper, we propose to adopt optimization techniques to automate the decision making process conducted after FMECA of CPS. We describe a multi-agent based optimization method which extends classical FMECA for offering optimal solutions in terms of criticality and development constraints of CPS.

Artificial Intelligence,Cryptography and Security
Optimizing Risk-averse Human-AI Hybrid Teams

Andrew Fuchs,Andrea Passarella,Marco Conti

DOI: https://doi.org/10.1109/SMARTCOMP61445.2024.00037

2024-03-13

Abstract:We anticipate increased instances of humans and AI systems working together in what we refer to as a hybrid team. The increase in collaboration is expected as AI systems gain proficiency and their adoption becomes more widespread. However, their behavior is not error-free, making hybrid teams a very suitable solution. As such, we consider methods for improving performance for these teams of humans and AI systems. For hybrid teams, we will refer to both the humans and AI systems as agents. To improve team performance over that seen for agents operating individually, we propose a manager which learns, through a standard Reinforcement Learning scheme, how to best delegate, over time, the responsibility of taking a decision to any of the agents. We further guide the manager's learning so they also minimize how many changes in delegation are made resulting from undesirable team behavior. We demonstrate the optimality of our manager's performance in several grid environments which include failure states which terminate an episode and should be avoided. We perform our experiments with teams of agents with varying degrees of acceptable risk, in the form of proximity to a failure state, and measure the manager's ability to make effective delegation decisions with respect to its own risk-based constraints, then compare these to the optimal decisions. Our results show our manager can successfully learn desirable delegations which result in team paths near/exactly optimal with respect to path length and number of delegations.

Artificial Intelligence,Machine Learning
Satisfactory Optimization Control In Fuzzy Dynamic Environment For Complex Systems

Sy Li,Yg Xi

DOI: https://doi.org/10.1109/cca.2000.897446

2000-01-01

Abstract:This paper investigates the use of fuzzy decision making in predictive control, the use of fuzzy goals and fuzzy constraints in predictive control allows for a more flexible aggregation of the control objectives than the usual weighting sum of squared errors. Compared to the standard quadratic objective function, with the fuzzy decision making approach, the designer has more freedom in specifying the desired process behavior.
Optimization-Driven Adaptive Experimentation

Ethan Che,Daniel R. Jiang,Hongseok Namkoong,Jimmy Wang

2024-11-08

Abstract:Real-world experiments involve batched & delayed feedback, non-stationarity, multiple objectives & constraints, and (often some) personalization. Tailoring adaptive methods to address these challenges on a per-problem basis is infeasible, and static designs remain the de facto standard. Focusing on short-horizon ($\le 10$) adaptive experiments, we move away from bespoke algorithms and present a mathematical programming formulation that can flexibly incorporate a wide range of objectives, constraints, and statistical procedures. We formulating a dynamic program based on central limit approximations, which enables the use of scalable optimization methods based on auto-differentiation and GPU parallelization. To evaluate our framework, we implement a simple heuristic planning method ("solver") and benchmark it across hundreds of problem instances involving non-stationarity, personalization, and multiple objectives & constraints. Unlike bespoke methods (e.g., Thompson sampling variants), our mathematical programming framework provides consistent gains over static randomized control trials and exhibits robust performance across problem instances.

Machine Learning
Human-Variability-Respecting Optimal Control for Physical Human-Machine Interaction

Sean Kille,Paul Leibold,Philipp Karg,Balint Varga,Sören Hohmann

2024-05-06

Abstract:Physical Human-Machine Interaction plays a pivotal role in facilitating collaboration across various domains. When designing appropriate model-based controllers to assist a human in the interaction, the accuracy of the human model is crucial for the resulting overall behavior of the coupled system. When looking at state-of-the-art control approaches, most methods rely on a deterministic model or no model at all of the human behavior. This poses a gap to the current neuroscientific standard regarding human movement modeling, which uses stochastic optimal control models that include signal-dependent noise processes and therefore describe the human behavior much more accurate than the deterministic counterparts. To close this gap by including these stochastic human models in the control design, we introduce a novel design methodology resulting in a Human-Variability-Respecting Optimal Control that explicitly incorporates the human noise processes and their influence on the mean and variability behavior of a physically coupled human-machine system. Our approach results in an improved overall system performance, i.e. higher accuracy and lower variability in target point reaching, while allowing to shape the joint variability, for example to preserve human natural variability patterns.

Systems and Control
Risk-Sensitive Cooperative Games for Human-Machine Systems

Agostino Capponi,Reza Ghanadan,Matt Stern

DOI: https://doi.org/10.48550/arXiv.1705.09580

2017-05-26

Abstract:Autonomous systems can substantially enhance a human's efficiency and effectiveness in complex environments. Machines, however, are often unable to observe the preferences of the humans that they serve. Despite the fact that the human's and machine's objectives are aligned, asymmetric information, along with heterogeneous sensitivities to risk by the human and machine, make their joint optimization process a game with strategic interactions. We propose a framework based on risk-sensitive dynamic games; the human seeks to optimize her risk-sensitive criterion according to her true preferences, while the machine seeks to adaptively learn the human's preferences and at the same time provide a good service to the human. We develop a class of performance measures for the proposed framework based on the concept of regret. We then evaluate their dependence on the risk-sensitivity and the degree of uncertainty. We present applications of our framework to self-driving taxis, and robo-financial advising.

Machine Learning,Artificial Intelligence

Flexible Optimization for Cyber-Physical and Human Systems

Optimal Coupling Pattern of Cyber-Physical Systems

Robustness Improvement for Cyber Physical System Based on an Optimization Model of Interdependent Constraints

Multi-Objective Optimization for Cyber-Physical-Social Systems: A Case Study of Electric Vehicles Charging and Discharging

Flexible here-and-now decisions for two-stage multi-objective optimization: Method and application to energy system design selection

Resilient Distributed Optimization for Multi-Agent Cyberphysical Systems

Stochastic Online Optimization for Cyber-Physical and Robotic Systems

An Optimization Approach for a Robust and Flexible Control in Collaborative Applications

Multi-Objective Controller Synthesis with Uncertain Human Preferences

A Framework for Effective AI Recommendations in Cyber-Physical-Human Systems

Real-time Optimization, Supervisory and Safety Control for Distributed Networked Cyber-physical System

A Scalable Stochastic Programming Approach for the Design of Flexible Systems

Online Pareto-Optimal Decision-Making for Complex Tasks using Active Inference

Personalized Optimization with User's Feedback

Evolutionary Optimization of Complex Systems in Uncertain Environments

Multi-Agent Optimization for Safety Analysis of Cyber-Physical Systems: Position Paper

Optimizing Risk-averse Human-AI Hybrid Teams

Satisfactory Optimization Control In Fuzzy Dynamic Environment For Complex Systems

Optimization-Driven Adaptive Experimentation

Human-Variability-Respecting Optimal Control for Physical Human-Machine Interaction

Risk-Sensitive Cooperative Games for Human-Machine Systems