Abstract:There is an extensive body of literature on the topic of estimating situational states, in applications ranging from cyber-defense to military operations to traffic situations and autonomous cars. In the military/defense/intelligence literature, situation assessment seems to be the sine qua non for any research on surveillance and reconnaissance, command and control, and intelligence analysis. Virtually all of this work focuses on assessing the situation-at-the-moment; many if not most of the estimation techniques are based on Data and Information Fusion (DIF) approaches, with some recent schemes employing Artificial Intelligence (AI) and Machine Learning (ML) methods. But estimating and recognizing situational conditions is most often couched in a decision-making, action-taking context, implying that actions may be needed so that certain goal situations will be reached as a result of such actions, or at least that progress toward such goal states will be made. This context thus frames the estimation of situational states in the larger context of a control-loop, with a need to understand the temporal evolution of situational states, not just a snapshot at a given time. Estimating situational dynamics requires the important functions of situation recognition, situation prediction, and situation understanding that are also central to such an integrated estimation + action-taking architecture. The varied processes for all of these combined capabilities lie in a closed-loop "situation control" framework, where the core operations of a stochastic control process involve situation recognition-learning-prediction-situation "error" assessment-and action taking to move the situation to a goal state. We propose several additional functionalities for this closed-loop control process in relation to some prior work on this topic, to include remarks on the integration of control-theoretic principles. Expanded remarks are also made on the state of the art of the schemas and computational technologies for situation recognition, prediction and understanding, as well as the roles for human intelligence in this larger framework.

A framework for describing interaction between human operators and autonomous, automated, and manual control systems

Modelling operator control work across traffic management domains: implications for interaction design

Human Autonomy in Future Drone Traffic: Joint Human–AI Control in Temporal Cognitive Work

Actor-Oriented Control System Design: A Responsible Framework Perspective

Actor-Oriented Control System Design

A real-time interactive decision-making and control framework for complex cyber-physical-human systems

Designing for shared cognition in air traffic management

Joining the blunt and the pointy end of the spear: towards a common framework of joint action, human–machine cooperation, cooperative guidance and control, shared, traded and supervisory control

Human-Automation Interaction Through Shared and Traded Control Applications

Human-Robot Interaction via a Joint-Initiative Supervised Autonomy (JISA) Framework

An Expanded Framework for Situation Control

A Human-Machine Shared Control Framework Considering Time-Varying Driver Characteristics

Realising Meaningful Human Control Over Automated Driving Systems: A Multidisciplinary Approach

A Framework to Manage the Complex Organisation of Collaborating: Its Application to Autonomous Systems

A Dynamic Behavior Control Framework for Physical Human-Robot Interaction

A Unified Interaction Control Framework for Safe Robotic Ultrasound Scanning with Human-Intention-Aware Compliance

A Framework for Analysing Driver Interactions with Semi-Autonomous Vehicles

A hierarchical control framework for autonomous decision-making systems: Integrating HMDP and MPC

Designing Automated Vehicle and Traffic Systems towards Meaningful Human Control

The Integration Method of Multimodal Human-Computer Interaction Framework

A Universal Framework for Generalized Run Time Assurance with JAX Automatic Differentiation