DPA 2 : Architecture for Co-operative Dynamical Physical Agents

E. D. Acebo,Albert Oller i Pujol,J. D. L. Rosa

Abstract:This paper introduces dynamical aspects into physical agents design. Some current approaches are introduced into this new conception that takes into account dynamics for evaluating the difficulty of agent actions. A example of a convoy system shows some preliminary results.

Computer Science,Engineering

What problem does this paper attempt to address?

Dynamic Self-Organizing System Supported by PDC-Agent

Beishui Liao,Ji Gao

DOI: https://doi.org/10.3321/j.issn:1003-9775.2006.02.009

2006-01-01

Abstract:A policy-desire-contract extended agent model (PDC-Agent) is proposed to establish automatic composition of web services. According to the three types of factors such as policies, desires and contracts, PDC-Agent can rationally select the intended services and their properties by virtue of a preference-based decision-making mechanism, and participate in virtual-organization (VO) formation and service composition. The process of autonomic service composition and a case study are presented. This system can be well adapted to the variation of business requirements and perform real-time application integration in the open, dynamic and heterogeneous VO environment.
An Extended Bdi Agent With Policies And Contracts

Bei-Shui Liao,Hua-Xin Huang,Ji Gao

DOI: https://doi.org/10.1007/11802372_12

2006-01-01

Abstract:In order to enable the intelligent agents to be aware of the dynamic business requirements and strategies, and cooperate with other agents in a stable and explicit way, a policy and contract extended BDI logic (called BGI(PDC) logic) has been proposed, by integrating contracts and policies into traditional BDI model. On the basis of BGIPDC logic, this paper proposes a model of agent architecture as a concrete realization of it, called PDC-agent. PDC-agent is an extension of traditional BDI agent, by adding a policy engine, a contract engine and a goal maintenance component into agent's interpreter. Besides, PDC-agent has two characteristics. First, the operation of PDC-agent is based on an event-driven mechanism. Various events drive the components of the interpreter. Second, the representation of PDC-agent is on the basis of ontology.
Modeling Dynamic Architectures for Multi-Agent Systems

Wen-Pin JIAO,Zhong-Zhi SHI

DOI: https://doi.org/10.3321/j.issn:0254-4164.2000.07.010

2000-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:Multi-agent systems are investigated in view of software architectures, and formalized using a process calculus, the π-calculus. To build a dynamic architecture for multi-agent systems, a multi-agent system model is put forward at first and described formally in the polyadic π-calculus. Then a kind of architecture for multi-agent systems, called CARBA which is similar to CORBA, is built based on the roles played by agents in multi-agent systems. Finally, the dynamic characteristics of the architecture are analyzed.
Structured agents for physical construction

Victor Bapst,Alvaro Sanchez-Gonzalez,Carl Doersch,Kimberly L. Stachenfeld,Pushmeet Kohli,Peter W. Battaglia,Jessica B. Hamrick

DOI: https://doi.org/10.48550/arXiv.1904.03177

2019-05-13

Abstract:Physical construction---the ability to compose objects, subject to physical dynamics, to serve some function---is fundamental to human intelligence. We introduce a suite of challenging physical construction tasks inspired by how children play with blocks, such as matching a target configuration, stacking blocks to connect objects together, and creating shelter-like structures over target objects. We examine how a range of deep reinforcement learning agents fare on these challenges, and introduce several new approaches which provide superior performance. Our results show that agents which use structured representations (e.g., objects and scene graphs) and structured policies (e.g., object-centric actions) outperform those which use less structured representations, and generalize better beyond their training when asked to reason about larger scenes. Model-based agents which use Monte-Carlo Tree Search also outperform strictly model-free agents in our most challenging construction problems. We conclude that approaches which combine structured representations and reasoning with powerful learning are a key path toward agents that possess rich intuitive physics, scene understanding, and planning.

Machine Learning,Artificial Intelligence
A dynamic architecture for multi-agent systems

Wenpin Jiao,Zhongzhi Shi

DOI: https://doi.org/10.1109/TOOLS.1999.796491

1999-01-01

Abstract:Multi agent systems are investigated from the point of view of software architectures, and formalized using a process calculus, the pi-calculus. To build a dynamic architecture for multi agent systems, two models for agents and multi agent systems are put forward respectively. Then a kind of architecture for multi agent systems, called CARBA which is similar to CORBA, is built based on the roles played by agents in multi agent systems. Finally, the dynamic characteristics of the architecture are analyzed as well
A New Dynamic Distributed Planning Approach: Application to DPDP Problems

Zakaria Tolba

2024-02-24

Abstract:In this work, we proposed a new dynamic distributed planning approach that is able to take into account the changes that the agent introduces on his set of actions to be planned in order to take into account the changes that occur in his environment. Our approach fits into the context of distributed planning for distributed plans where each agent can produce its own plans. According to our approach the generation of the plans is based on the satisfaction of the constraints by the use of the genetic algorithms. Our approach is to generate, a new plan by each agent, whenever there is a change in its set of actions to plan. This in order to take into account the new actions introduced in its new plan. In this new plan, the agent takes, each time, as a new action set to plan all the old un-executed actions of the old plan and the new actions engendered by the changes and as a new initial state; the state in which the set of actions of the agent undergoes a change. In our work, we used a concrete case to illustrate and demonstrate the utility of our approach.

Artificial Intelligence,Multiagent Systems
Evolving Dyadic Strategies for a Cooperative Physical Task

Saber Sheybani,Eduardo J. Izquierdo,Eatai Roth

DOI: https://doi.org/10.48550/arXiv.2004.10558

2020-04-22

Abstract:Many cooperative physical tasks require that individuals play specialized roles (e.g., leader-follower). Humans are adept cooperators, negotiating these roles and transitions between roles innately. Yet how roles are delegated and reassigned is not well understood. Using a genetic algorithm, we evolve simulated agents to explore a space of feasible role-switching policies. Applying these switching policies in a cooperative manual task, agents process visual and haptic cues to decide when to switch roles. We then analyze the evolved virtual population for attributes typically associated with cooperation: load sharing and temporal coordination. We find that the best performing dyads exhibit high temporal coordination (anti-synchrony). And in turn, anti-synchrony is correlated to symmetry between the parameters of the cooperative agents. These simulations furnish hypotheses as to how human cooperators might mediate roles in dyadic tasks.

Neural and Evolutionary Computing,Multiagent Systems
Autonomous 3D Exploration in Large-Scale Environments with Dynamic Obstacles

Emil Wiman,Ludvig Widén,Mattias Tiger,Fredrik Heintz

2023-10-27

Abstract:Exploration in dynamic and uncertain real-world environments is an open problem in robotics and constitutes a foundational capability of autonomous systems operating in most of the real world. While 3D exploration planning has been extensively studied, the environments are assumed static or only reactive collision avoidance is carried out. We propose a novel approach to not only avoid dynamic obstacles but also include them in the plan itself, to exploit the dynamic environment in the agent's favor. The proposed planner, Dynamic Autonomous Exploration Planner (DAEP), extends AEP to explicitly plan with respect to dynamic obstacles. To thoroughly evaluate exploration planners in such settings we propose a new enhanced benchmark suite with several dynamic environments, including large-scale outdoor environments. DAEP outperform state-of-the-art planners in dynamic and large-scale environments. DAEP is shown to be more effective at both exploration and collision avoidance.

Robotics,Artificial Intelligence
Predictability Awareness for Efficient and Robust Multi-Agent Coordination

Roman Chiva Gil,Daniel Jarne Ornia,Khaled A. Mustafa,Javier Alonso Mora

2024-11-09

Abstract:To safely and efficiently solve motion planning problems in multi-agent settings, most approaches attempt to solve a joint optimization that explicitly accounts for the responses triggered in other agents. This often results in solutions with an exponential computational complexity, making these methods intractable for complex scenarios with many agents. While sequential predict-and-plan approaches are more scalable, they tend to perform poorly in highly interactive environments. This paper proposes a method to improve the interactive capabilities of sequential predict-and-plan methods in multi-agent navigation problems by introducing predictability as an optimization objective. We interpret predictability through the use of general prediction models, by allowing agents to predict themselves and estimate how they align with these external predictions. We formally introduce this behavior through the free-energy of the system, which reduces under appropriate bounds to the Kullback-Leibler divergence between plan and prediction, and use this as a penalty for unpredictable <a class="link-external link-http" href="http://trajectories.The" rel="external noopener nofollow">this http URL</a> proposed interpretation of predictability allows agents to more robustly leverage prediction models, and fosters a soft social convention that accelerates agreement on coordination strategies without the need of explicit high level control or communication. We show how this predictability-aware planning leads to lower-cost trajectories and reduces planning effort in a set of multi-robot problems, including autonomous driving experiments with human driver data, where we show that the benefits of considering predictability apply even when only the ego-agent uses this strategy.

Robotics
PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments

James Mullen,Dinesh Manocha

DOI: https://doi.org/10.1109/TVCG.2023.3247054

2023-03-25

Abstract:We present PACE, a novel method for modifying motion-captured virtual agents to interact with and move throughout dense, cluttered 3D scenes. Our approach changes a given motion sequence of a virtual agent as needed to adjust to the obstacles and objects in the environment. We first take the individual frames of the motion sequence most important for modeling interactions with the scene and pair them with the relevant scene geometry, obstacles, and semantics such that interactions in the agents motion match the affordances of the scene (e.g., standing on a floor or sitting in a chair). We then optimize the motion of the human by directly altering the high-DOF pose at each frame in the motion to better account for the unique geometric constraints of the scene. Our formulation uses novel loss functions that maintain a realistic flow and natural-looking motion. We compare our method with prior motion generating techniques and highlight the benefits of our method with a perceptual study and physical plausibility metrics. Human raters preferred our method over the prior approaches. Specifically, they preferred our method 57.1% of the time versus the state-of-the-art method using existing motions, and 81.0% of the time versus a state-of-the-art motion synthesis method. Additionally, our method performs significantly higher on established physical plausibility and interaction metrics. Specifically, we outperform competing methods by over 1.2% in terms of the non-collision metric and by over 18% in terms of the contact metric. We have integrated our interactive system with Microsoft HoloLens and demonstrate its benefits in real-world indoor scenes. Our project website is available at <a class="link-external link-https" href="https://gamma.umd.edu/pace/" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Graphics
Dynamic Path Planning and Movement Control in Pedestrian Simulation

Fatema Tuj Johora,Philipp Kraus,Jörg P. Müller

DOI: https://doi.org/10.48550/arXiv.1709.08235

2017-09-24

Multiagent Systems

Abstract:Modeling and simulation of pedestrian behavior is used in applications such as planning large buildings, disaster management, or urban planning. Realistically simulating pedestrian behavior is challenging, due to the complexity of individual behavior as well as the complexity of interactions of pedestrians with each other and with the environment. This work-in-progress paper addresses the tactical (path planning) and the operational level (movement control) of pedestrian simulation from the perspective of multiagent-based modeling. We propose (1) an novel extension of the JPS routing algorithm for tactical planning, and (2) an architecture how path planning can be integrated with a social-force based movement control. The architecture is inspired by layered architectures for robot planning and control. We validate correctness and efficiency of our approach through simulation runs.
Double Agent Architecture: A Framework for Personal Mobility

Hongbo Si,Yue Wang,Jian Yuan,Xiuming Shan

DOI: https://doi.org/10.1109/wicom.2009.5302190

2009-01-01

Abstract:This paper proposes an agent-based architecture to realize personal mobility. Following terminal mobility, personal mobility is becoming another research hotspot in the area of mobility and mobility management. Through the comparison of the frameworks of these two sorts of mobility, two core issues of realizing personal mobility are brought forward. A new architecture, Double Agent Architecture, is proposed to support personal mobility. The holistic framework of this architecture and detailed structure of network entities are also stated. Two kinds of agents, managed by users and service providers respectively, are utilized in this model to fulfill these two corresponding key tasks. Moreover, the processes of communication establishment and handoff performance in the environment of this new architecture are described, also the advantages of this new network configuration and working scheme are pointed out.
Position-Based Multi-Agent Dynamics for Real-Time Crowd Simulation (MiG paper)

Tomer Weiss,Alan Litteneker,Chenfanfu Jiang,Demetri Terzopoulos

DOI: https://doi.org/10.1145/3136457.3136462

2018-02-20

Abstract:Exploiting the efficiency and stability of Position-Based Dynamics (PBD), we introduce a novel crowd simulation method that runs at interactive rates for hundreds of thousands of agents. Our method enables the detailed modeling of per-agent behavior in a Lagrangian formulation. We model short-range and long-range collision avoidance to simulate both sparse and dense crowds. On the particles representing agents, we formulate a set of positional constraints that can be readily integrated into a standard PBD solver. We augment the tentative particle motions with planning velocities to determine the preferred velocities of agents, and project the positions onto the constraint manifold to eliminate colliding configurations. The local short-range interaction is represented with collision and frictional contact between agents, as in the discrete simulation of granular materials. We incorporate a cohesion model for modeling collective behaviors and propose a new constraint for dealing with potential future collisions. Our new method is suitable for use in interactive games.

Graphics
A Dynamic-Epistemic Logic for Mobile Structured Agents

Anya Yermakova,Alexandru Baltag

DOI: https://doi.org/10.48550/arXiv.1212.4179

2012-12-17

Logic in Computer Science

Abstract:Multi-agent systems have been studied in various contexts of both application and theory. We take Dynamic Epistemic Logic (DEL), one of the formalisms designed to reason about such systems, as the foundation of the language we will build. BioAmbient calculus is an extension of \pi-calculus, developed largely for applications to biomolecular systems. It deals with ambients and their ability to communicate and to execute concurrent processes while moving. In this paper we combine the formalism of Dynamic Epistemic Logic together with the formalism of BioAmbient Calculus in order to reason about knowledge maintained and gained upon process transitions. The motivation lies in developing a language that captures locally available information through assignment of knowledge, with potential application to biological systems as well as social, virtual, and others. We replace the ambients of BioAmbient Calculus with agents, to which we attribute knowledge, and explore the parallels of this treatment. The resulting logic describes the information flow governing mobile structured agents, organized hierarchically, whose architecture (and local information) may change due to actions such as communication, merging (of two agents), entering (of an agent into the inner structure of another agent) and exiting (of an agent from the structure of another). We show how the main axioms of DEL must be altered to accommodate the informational effects of the agents' dynamic architecture.
Cyber Physical Games

Warisa Sritriratanarak,Paulo Garcia

2024-07-08

Abstract:We describe a formulation of multi-agents operating within a Cyber-Physical System, resulting in collaborative or adversarial games. We show that the non-determinism inherent in the communication medium between agents and the underlying physical environment gives rise to environment evolution that is a probabilistic function of agents' strategies. We name these emergent properties Cyber Physical Games and study its properties. We present an algorithmic model that determines the most likely system evolution, approximating Cyber Physical Games through Probabilistic Finite State Automata, and evaluate it on collaborative and adversarial versions of the Iterated Boolean Game, comparing theoretical results with simulated ones. Results support the validity of the proposed model, and suggest several required research directions to continue evolving our understanding of Cyber Physical System, as well as how to best design agents that must operate within such environments.

Distributed, Parallel, and Cluster Computing,Artificial Intelligence
A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

Hao Xiong,Huanhui Cao,Lin Zhang,Wenjie Lu

DOI: https://doi.org/10.48550/arXiv.2104.01445

2021-04-04

Abstract:Pursuit-evasion games are ubiquitous in nature and in an artificial world. In nature, pursuer(s) and evader(s) are intelligent agents that can learn from experience, and dynamics (i.e., Newtonian or Lagrangian) is vital for the pursuer and the evader in some scenarios. To this end, this paper addresses the pursuit-evasion game of intelligent agents from the perspective of dynamics. A bio-inspired dynamics formulation of a pursuit-evasion game and baseline pursuit and evasion strategies are introduced at first. Then, reinforcement learning techniques are used to mimic the ability of intelligent agents to learn from experience. Based on the dynamics formulation and reinforcement learning techniques, the effects of improving both pursuit and evasion strategies based on experience on pursuit-evasion games are investigated at two levels 1) individual runs and 2) ranges of the parameters of pursuit-evasion games. Results of the investigation are consistent with nature observations and the natural law - survival of the fittest. More importantly, with respect to the result of a pursuit-evasion game of agents with baseline strategies, this study achieves a different result. It is shown that, in a pursuit-evasion game with a dynamics formulation, an evader is not able to escape from a slightly faster pursuer with an effective learned pursuit strategy, based on agile maneuvers and an effective learned evasion strategy.

Systems and Control,Multiagent Systems
A Dynamic Model of Multi-Agent System

SL Hu,C Shi

DOI: https://doi.org/10.1109/icmlc.2004.1380648

2004-01-01

Abstract:There are two purposes in this paper. First, it presents an approach to designing an agent. For adapting to the cooperative requests of the agents in a multi-agent system, we distinguish between the two aspects of underlying attributes of an agent: individual and organizational. And introduce a concept "pairs of roles". The other purpose is to show how to express the behavioral semantics of an agent and a multi-agent system with the "state transition graph". The individual attributes of an agent consist of beliefs and intentions, and for intentions we adopt the "twin-subset semantics" developed by us. While the organizational attributes of an agent consist of "pairs of roles". These compose the state of individual agent and the relations between agents. The state transitions are produced by the behaviors of agents and materialize the dynamic characters of agent and the turn of a multi-agent system. And the behaviors arise from the mental states of agents and the situations.
Dynamic Encirclement For Anonymous Agents With Arbitrary Formations

Na Huang,Jiaqiang Zhuge,Zhiyong Sun,Di Huang,Yaguang Kong,Qiang Lu

DOI: https://doi.org/10.1109/tcns.2024.3354890

IF: 4.347

2024-01-01

IEEE Transactions on Control of Network Systems

Abstract:In this study, distributed circle surrounding control problems are investigated for double-integrator anonymous multi-agent systems, where all available information for each agent can be obtained based on its moving local coordinate frame. Firstly, the dynamics of each agent described in the local frames are developed in light of the transformation relation between the global and local frames. Then, distributed formation control protocols are designed by local measurements to form and maintain the expected arbitrary circle formations in a plane. The proposed protocols efficiently reduce the requirement of the equipped devices and data processing capabilities, since the agents do not need to equip with expensive and high-precision sensors to acquire the real-time acceleration of the target. Finally, the effectiveness of the theoretical result is demonstrated by simulations.

computer science, information systems,automation & control systems
Hybrid Decision Making for Scalable Multi-Agent Navigation: Integrating Semantic Maps, Discrete Coordination, and Model Predictive Control

Koen de Vos,Elena Torta,Herman Bruyninckx,Cesar Lopez Martinez,Rene van de Molengraft

2024-10-16

Abstract:This paper presents a framework for multi-agent navigation in structured but dynamic environments, integrating three key components: a shared semantic map encoding metric and semantic environmental knowledge, a claim policy for coordinating access to areas within the environment, and a Model Predictive Controller for generating motion trajectories that respect environmental and coordination constraints. The main advantages of this approach include: (i) enforcing area occupancy constraints derived from specific task requirements; (ii) enhancing computational scalability by eliminating the need for collision avoidance constraints between robotic agents; and (iii) the ability to anticipate and avoid deadlocks between agents. The paper includes both simulations and physical experiments demonstrating the framework's effectiveness in various representative scenarios.

Robotics
PDE-based multi-agent formation control using flatness and backstepping: Analysis, design and robot experiments

Gerhard Freudenthaler,Thomas Meurer

DOI: https://doi.org/10.1016/j.automatica.2020.108897

IF: 6.4

2020-05-01

Automatica

Abstract:A PDE-based control concept is developed to deploy a multi-agent system into desired formation profiles. The dynamic model is based on a coupled linear, time-variant parabolic distributed parameter system. By means of a particular coupling structure parameter information can be distributed within the agent continuum. Flatness-based motion planning and feedforward control are combined with a backstepping-based boundary controller to stabilize the distributed parameter system of the tracking error. The tracking controller utilizes the required state information from a Luenberger-type state observer. By means of an exogenous system the relocation of formation profiles is achieved. The transfer of the control strategy to a finite-dimensional discrete multi-agent system is obtained by a suitable finite difference discretization of the continuum model, which in addition imposes a leader–follower communication topology. The results are evaluated both in simulation studies and in experiments for a swarm of mobile robots realizing the transition between different stable and unstable formation profiles.

automation & control systems,engineering, electrical & electronic

DPA 2 : Architecture for Co-operative Dynamical Physical Agents

Dynamic Self-Organizing System Supported by PDC-Agent

An Extended Bdi Agent With Policies And Contracts

Modeling Dynamic Architectures for Multi-Agent Systems

Structured agents for physical construction

A dynamic architecture for multi-agent systems

A New Dynamic Distributed Planning Approach: Application to DPDP Problems

Evolving Dyadic Strategies for a Cooperative Physical Task

Autonomous 3D Exploration in Large-Scale Environments with Dynamic Obstacles

Predictability Awareness for Efficient and Robust Multi-Agent Coordination

PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments

Dynamic Path Planning and Movement Control in Pedestrian Simulation

Double Agent Architecture: A Framework for Personal Mobility

Position-Based Multi-Agent Dynamics for Real-Time Crowd Simulation (MiG paper)

A Dynamic-Epistemic Logic for Mobile Structured Agents

Cyber Physical Games

A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

A Dynamic Model of Multi-Agent System

Dynamic Encirclement For Anonymous Agents With Arbitrary Formations

Hybrid Decision Making for Scalable Multi-Agent Navigation: Integrating Semantic Maps, Discrete Coordination, and Model Predictive Control

PDE-based multi-agent formation control using flatness and backstepping: Analysis, design and robot experiments