Parallel Cooperating A-Teams

D. Barbucha,I. Czarnowski,P. Jędrzejowicz,E. Ratajczak-Ropel,I. Wierzbowska

DOI: https://doi.org/10.1007/978-3-642-23938-0_33

2011-09-21

Abstract:

What problem does this paper attempt to address?

Towards a cooperative soccer team in RoboCup

Jun Guan,DiJun Luo,Da Ming Liang,Rong Xiong

2004-01-01

Abstract:The key skills and algorithms of soccer simulation team ZJUBase are proposed. To improve the decision-making ability in complex, noisy and dynamic environment such as in soccer games, the layered decision-making architecture is applied and the methods and key points of maintaining the world model and the skills of players are presented. The team formation, roles and the novel idea of cooperative teammates set (CTS) are also introduced to reduce the complexity of the problem-solving work. Through the CTS of each player and on-line greedily searching, the players will cooperate to win the game.
Parallel Asynchronous Team Algorithms: Convergence and Performance Analysis

B Baran,E Kaszkurewicz,A Bhaya

DOI: https://doi.org/10.1109/71.508248

IF: 5.3

1996-01-01

IEEE Transactions on Parallel and Distributed Systems

Abstract:This paper formalizes a general technique to combine different methods in the solution of large systems of nonlinear equations using parallel asynchronous implementations on distributed-memory multiprocessor systems. Such combinations of methods, referred to as Team Algorithms, are evaluated as a way of obtaining desirable properties of different methods and a sufficient condition for their convergence is derived. The load flow problem of electrical power networks is presented as an example problem that, under certain conditions, has the characteristics to make a Team Algorithm an appealing choice for its solution. Experimental results of an implementation on an Intel iPSC/860 Hypercube are reported, showing that considerable speedup and robustness can be obtained using team algorithms.
Cooperation strategies for agent-based P2P systems.

Loris Penserini,Lin Liu,John Mylopoulos,Maurizio Panti,Luca Spalazzi

2003-01-01

Abstract:We are interested in peer-to-peer (P2P) computing, where a P2P application consists of a (wireless) network of nodes (peers), and assumes full peer autonomy, no global control, and intermittent connectivity. P2P computing has many advantages over classical client-server and web-based distributed architectures. However, the P2P computing model also has a number of limitations in the mechanisms it supports for data management and interchange. To overcome some of these, we propose an agent-based P2P model whose nodes are software agents (peer agents). This paper uses the i * modeling framework to analyze and evaluate peer agent cooperation strategies using three possible evaluation criteria.
Exploiting Heterogeneous Robotic Systems in Cooperative Missions

Nicola Bezzo,Joshua P. Hecker,Karl Stolleis,Melanie E. Moses,Rafael Fierro

DOI: https://doi.org/10.48550/arXiv.1509.00948

2015-09-03

Abstract:In this paper we consider the problem of coordinating robotic systems with different kinematics, sensing and vision capabilities to achieve certain mission goals. An approach that makes use of a heterogeneous team of agents has several advantages when cost, integration of capabilities, or large search areas need to be considered. A heterogeneous team allows for the robots to become "specialized", accomplish sub-goals more effectively, and thus increase the overall mission efficiency. Two main scenarios are considered in this work. In the first case study we exploit mobility to implement a power control algorithm that increases the Signal to Interference plus Noise Ratio (SINR) among certain members of the network. We create realistic sensing fields and manipulation by using the geometric properties of the sensor field-of-view and the manipulability metric, respectively. The control strategy for each agent of the heterogeneous system is governed by an artificial physics law that considers the different kinematics of the agents and the environment, in a decentralized fashion. Through simulation results we show that the network is able to stay connected at all times and covers the environment well. The second scenario studied in this paper is the biologically-inspired coordination of heterogeneous physical robotic systems. A team of ground rovers, designed to emulate desert seed-harvester ants, explore an experimental area using behaviors fine-tuned in simulation by a genetic algorithm. Our robots coordinate with a base station and collect clusters of resources scattered within the experimental space. We demonstrate experimentally that through coordination with an aerial vehicle, our ant-like ground robots are able to collect resources two times faster than without the use of heterogeneous coordination.

Robotics
Reinforcement Learning Strategy for Solving the Resource-Constrained Project Scheduling Problem by a Team of A-Teams

Piotr Jędrzejowicz,Ewa Ratajczak-Ropel

DOI: https://doi.org/10.1007/978-3-319-05458-2_21

2014-01-01

Abstract:In this paper the Team of A-Teams for solving the resource-constrained project scheduling problem (RCPSP) using the reinforcement learning interactive strategy is proposed. RCPSP belongs to the NP-hard problem class. To solve this problem a parallel cooperating A-Teams consisting of the asynchronous agents implemented using JABAT middleware have been proposed. Within each of the A-Team the interaction strategy using reinforcement learning is used. To evaluate the proposed approach computational experiment has been carried out.
Cooperation and Competition When Bidding for Complex Projects: Centralized and Decentralized Perspectives

Piotr Skowron,Krzysztof Rzadca,Anwitaman Datta

DOI: https://doi.org/10.1109/mis.2017.4

IF: 6.744

2017-01-01

IEEE Intelligent Systems

Abstract:To successfully complete a complex project, agents (companies or individuals) must form a team with the required competencies and resources. A team can be formed either by the project issuer based on individual agents' offers (centralized formation) or by the agents themselves (decentralized formation) bidding for a project as a consortium. The authors investigate rational strategies for agents, propose concepts to characterize the stability of winning teams and study computational complexity of finding these concepts of stability.

computer science, artificial intelligence,engineering, electrical & electronic
Evolving Dyadic Strategies for a Cooperative Physical Task

Saber Sheybani,Eduardo J. Izquierdo,Eatai Roth

DOI: https://doi.org/10.48550/arXiv.2004.10558

2020-04-22

Abstract:Many cooperative physical tasks require that individuals play specialized roles (e.g., leader-follower). Humans are adept cooperators, negotiating these roles and transitions between roles innately. Yet how roles are delegated and reassigned is not well understood. Using a genetic algorithm, we evolve simulated agents to explore a space of feasible role-switching policies. Applying these switching policies in a cooperative manual task, agents process visual and haptic cues to decide when to switch roles. We then analyze the evolved virtual population for attributes typically associated with cooperation: load sharing and temporal coordination. We find that the best performing dyads exhibit high temporal coordination (anti-synchrony). And in turn, anti-synchrony is correlated to symmetry between the parameters of the cooperative agents. These simulations furnish hypotheses as to how human cooperators might mediate roles in dyadic tasks.

Neural and Evolutionary Computing,Multiagent Systems
Research on Cognitive Cooperation in Multi-Agent Systems

Sun Juan,Dou Wan-chun

DOI: https://doi.org/10.1007/bf02831747

2006-01-01

Abstract:The accomplishment of a complex problem usually involves cooperation between participators with different knowledge background concerned. This paper identifies interdependency between different sub problems (through problem decomposition) as the major factor that influences cooperative relations in multi-Agent systems, based on which we propose an efficient means to measure cooperation coefficient (degree) between different Agents. Then cognitive cooperation between Agents is analyzed which aims at collecting the wisdom of the cognitive community for a systematic solution to the overall problem.
Effect of Long-Term Starvation on the Survival, Recovery, and Carbon Utilization Profiles of a Bovine Escherichia coli O157:H7 Isolate from New Zealand

R. N. Xavier,H. Morgan,I. McDonald,Helen Withers

DOI: https://doi.org/10.1128/AEM.00045-14

2014-05-09

Applied and Environmental Microbiology

Abstract:ABSTRACT The ability to maintain a dual lifestyle of colonizing the ruminant gut and surviving in nonhost environments once shed is key to the success of Escherichia coli O157:H7 as a zoonotic pathogen. Both physical and biological conditions encountered by the bacteria are likely to change during the transition between host and nonhost environments. In this study, carbon starvation at suboptimal temperatures in nonhost environments was simulated by starving a New Zealand bovine E. coli O157:H7 isolate in phosphate-buffered saline at 4 and 15°C for 84 days. Recovery of starved cells on media with different nutrient availabilities was monitored under aerobic and anaerobic conditions. We found that the New Zealand bovine E. coli O157:H7 isolate was able to maintain membrane integrity and viability over 84 days and that the level of recovery depended on the nutrient level of the recovery medium as well as the starvation temperature. In addition, a significant difference in carbon utilization was observed between starved and nonstarved cells.
Cooperative parallel asynchronous computation of the solution of symmetric linear systems

Bhaya, Amit,Bliman, P.,Pazos, F.

DOI: https://doi.org/10.1109/CDC.2010.5717471

2010-01-01

Abstract:This paper introduces a new paradigm, called cooperative computation, for the solution of systems of linear equations with symmetric coefficient matrices. The simplest version of the algorithm consists of two agents, each one computing the solution of the whole system, using an iterative method. Infrequent unidirectional communication occurs from one agent to the other, either periodically, or probabilistically, thus characterizing the computation as parallel and asynchronous. Every time one agent communicates its current approximation of the solution to the other, the receiving agent carries out a least squares computation to replace its current value by an affine combination of the current approximations, and the algorithm continues until a stopping criterion is met. Deterministic and probabilistic variants of this algorithm are introduced and shown to be efficient, specifically in relation to the popular Barzilai-Borwein algorithm, particularly for ill-conditioned matrices.
Influence of Team Interactions on Multi-Robot Cooperation: A Relational Network Perspective

Yasin Findik,Hamid Osooli,Paul Robinette,Kshitij Jerath,S. Reza Ahmadzadeh

2023-10-20

Abstract:Relational networks within a team play a critical role in the performance of many real-world multi-robot systems. To successfully accomplish tasks that require cooperation and coordination, different agents (e.g., robots) necessitate different priorities based on their positioning within the team. Yet, many of the existing multi-robot cooperation algorithms regard agents as interchangeable and lack a mechanism to guide the type of cooperation strategy the agents should exhibit. To account for the team structure in cooperative tasks, we propose a novel algorithm that uses a relational network comprising inter-agent relationships to prioritize certain agents over others. Through appropriate design of the team's relational network, we can guide the cooperation strategy, resulting in the emergence of new behaviors that accomplish the specified task. We conducted six experiments in a multi-robot setting with a cooperative task. Our results demonstrate that the proposed method can effectively influence the type of solution that the algorithm converges to by specifying the relationships between the agents, making it a promising approach for tasks that require cooperation among agents with a specified team structure.

Robotics,Multiagent Systems
Parallel Implementations of the Cooperative Particle Swarm Optimization on Many-core and Multi-core Architectures

Nadia Nedjah,Rogério de M. Calazan,Luiza de Macedo Mourelle,Chao Wang

DOI: https://doi.org/10.1007/s10766-015-0368-3

2015-01-01

International Journal of Parallel Programming

Abstract:Particle swarm optimization (PSO) is an evolutionary heuristics-based method used for continuous function optimization. PSO is stochastic yet very robust. Nevertheless, real-world optimizations require a high computational effort to converge to a good solution for the problem. In general, parallel PSO implementations provide good performance. However, this depends heavily on the parallelization strategy used as well as the number and characteristics of the exploited processors. In this paper, we propose a cooperative strategy, which consists of subdividing an optimization problem into many simpler sub-problems. Each of these focuses on a distinct subset of the problem dimensions. The optimization work for all the selected sub-problems is done in parallel. We map the work onto four different parallel high-performance multiprocessors, which are based on multi- and many-core architectures. The performance of the strategy thus implemented is evaluated for four well known benchmark functions with high-dimension and different complexity. The obtained speedups are compared to that yielded by a serial PSO implementation.
Modeling And Evaluating Cooperation Strategies In P2p Agent Systems

L Penserini,L Liu,J Mylopoulos,M Panti,L Spalazzi

DOI: https://doi.org/10.1007/3-540-45074-2_9

2003-01-01

Abstract:Distributed computing is becoming a fundamental technology for information exchange and cooperation. However, for such a technology to gain wide use, it must cater to users who do not own sophisticated (hardware and software) platforms and permanent network connections. For such users, the recent. Peer-to-Peer (P2P) computing model has many advantages over classical client-server and web-based distributed models. However, the P2P computing model in its current form has a number of other limitations in the data exchange and the protocols it supports. To overcome some of these, we proposed an agent based P2P system model whose nodes are sgents (Peer Agents). In this paper, we adopt the i* graphical framework to help the modeling and evaluating of Peer Agent's cooperation strategies. Although, the highly dynamic nature of P2P networks complicates the evaluation procedure, we propose three possible evaluation criteria in order to characterize the, best strategy related to a particular failure symptom.
Cooperative planning for physically interacting heterogeneous robots

Michael A Sebok,Herbert G Tanner

DOI: https://doi.org/10.3389/frobt.2024.1172105

2024-03-13

Abstract:Heterogeneous multi-agent systems can be deployed to complete a variety of tasks, including some that are impossible using a single generic modality. This paper introduces an approach to solving the problem of cooperative behavior planning in small heterogeneous robot teams where members can both function independently as well as physically interact with each other in ways that give rise to additional functionality. This approach enables, for the first time, the cooperative completion of tasks that are infeasible when using any single modality from those agents comprising the team.
Cooperating CoScheduling: A Coscheduling Proposal Aimed at Non-Dedicated Heterogeneous NOWs

Francesc Giné,Francesc Solsona,Mauricio Hanzich,Porfidio Hernández,Emilio Luque

DOI: https://doi.org/10.1007/s11390-007-9082-y

IF: 1.871

2007-09-01

Journal of Computer Science and Technology

Abstract:Implicit coscheduling techniques applied to non-dedicated homogeneous Networks Of Workstations (NOWs) have shown they can perform well when many local users compete with a single parallel job. Implicit coscheduling deals with minimizing the communication waiting time of parallel processes by identifying the processes in need of coscheduling through gathering and analyzing implicit runtime information, basically communication events. Unfortunately, implicit coscheduling techniques do not guarantee the performance of local and parallel jobs, when the number of parallel jobs competing against each other is increased. Thus, a low efficiency use of the idle computational resources is achieved.In order to solve these problems, a new technique, named Cooperating CoScheduling (CCS), is presented in this work. Unlike traditional implicit coscheduling techniques, under CCS, each node takes its scheduling decisions from the occurrence of local events, basically communication, memory, Input/Output and CPU, together with foreign events received from cooperating nodes. This allows CCS to provide a social contract based on reserving a percentage of CPU and memory resources to ensure the progress of parallel jobs without disturbing the local users, while coscheduling of communicating tasks is ensured. Besides, the CCS algorithm uses status information from the cooperating nodes to balance the resources across the cluster when necessary. Experimental results in a non-dedicated heterogeneous NOW reveal that CCS allows the idle resources to be exploited efficiently, thus obtaining a satisfactory speedup and provoking an overhead that is imperceptible to the local user.

computer science, software engineering, hardware & architecture
A Multi-Agent Cooperating Approach to Quasi-Parallel Genetic Algorithms

江瑞,罗予频,胡东成,司徒国业

DOI: https://doi.org/10.3321/j.issn:0372-2112.2002.10.020

2002-01-01

Abstract:This paper describes a kind of parallel genetic algorithm that is based on the idea of multi-agent cooperation.The algorithm consists of several computing units,in each of which a simple genetic algorithm is maintained,thus each computing unit can be regarded as an independent autonomous agent.The algorithm allocates computing resources to each unit according to the resource-allocating vector and carries through exchange of individuals between units according to the individual-migrating matrix.From the viewpoint of multi-agent system,the allocation of computing resource represents the coordination between agents,while the migration of individuals represents the collaboration between them.The algorithm can be implemented easily in a serial computer and it has the quasi-parallel feature in this case.The analyses to such a quasi-parallel genetic algorithm in two dimension show that since the cooperation between computing agents is taken into account in the algorithm,the computing resources can be utilized in a more effective way and thus better performances are presented when the algorithm deals with different kinds of optimizing problems.
Competitive Coevolutionary Multi-Agent Systems: The Application to Mapping and Scheduling Problems

Franciszek Seredynski

DOI: https://doi.org/10.1006/jpdc.1997.1394

IF: 4.542

1997-11-01

Journal of Parallel and Distributed Computing

Abstract:A new paradigm for a parallel and distributed evolutionary computation is proposed in this paper. The main idea of the proposed approach is based on considering a given system as a multi-agent system with game-theoretic models of interaction between players. For this purpose a model of noncooperativeN-person games with limited interaction is considered. Each player in the game has a payoff function and a set of actions. While players compete to maximize their payoffs, we are interested in the global behavior of the team of players, measured by the average payoff received by the team. To evolve a global behavior in the system, we propose three distributed schemes with evaluation of only local fitness functions. The first scheme uses ε-learning automata and is compared with two coevolutionary schemes, which we call loosely coupled genetic algorithms and loosely coupled classifier systems, respectively. We present simulation results which indicate that the global behavior in the systems emerges and is achieved in particular by only a local cooperation between players acting without global information about the system. The models of multi-agent systems are applied to develop parallel and distributed algorithms of dynamic mapping and scheduling tasks in parallel computers.

computer science, theory & methods
Open Ad Hoc Teamwork with Cooperative Game Theory

Jianhong Wang,Yang Li,Yuan Zhang,Wei Pan,Samuel Kaski

2024-07-07

Abstract:Ad hoc teamwork poses a challenging problem, requiring the design of an agent to collaborate with teammates without prior coordination or joint training. Open ad hoc teamwork (OAHT) further complicates this challenge by considering environments with a changing number of teammates, referred to as open teams. One promising solution in practice to this problem is leveraging the generalizability of graph neural networks to handle an unrestricted number of agents with various agent-types, named graph-based policy learning (GPL). However, its joint Q-value representation over a coordination graph lacks convincing explanations. In this paper, we establish a new theory to understand the representation of the joint Q-value for OAHT and its learning paradigm, through the lens of cooperative game theory. Building on our theory, we propose a novel algorithm named CIAO, based on GPL's framework, with additional provable implementation tricks that can facilitate learning. The demos of experimental results are available on <a class="link-external link-https" href="https://sites.google.com/view/ciao2024" rel="external noopener nofollow">this https URL</a>, and the code of experiments is published on <a class="link-external link-https" href="https://github.com/hsvgbkhgbv/CIAO" rel="external noopener nofollow">this https URL</a>.

Multiagent Systems,Machine Learning
Combinatorial-hybrid Optimization for Multi-agent Systems under Collaborative Tasks

Zili Tang,Junfeng Chen,Meng Guo

2023-08-27

Abstract:Multi-agent systems can be extremely efficient when working concurrently and collaboratively, e.g., for transportation, maintenance, search and rescue. Coordination of such teams often involves two aspects: (i) selecting appropriate sub-teams for different tasks; (ii) designing collaborative control strategies to execute these tasks. The former aspect can be combinatorial w.r.t. the team size, while the latter requires optimization over joint state-spaces under geometric and dynamic constraints. Existing work often tackles one aspect by assuming the other is given, while ignoring their close dependency. This work formulates such problems as combinatorial-hybrid optimizations (CHO), where both the discrete modes of collaboration and the continuous control parameters are optimized simultaneously and iteratively. The proposed framework consists of two interleaved layers: the dynamic formation of task coalitions and the hybrid optimization of collaborative behaviors. Overall feasibility and costs of different coalitions performing various tasks are approximated at different granularities to improve the computational efficiency. At last, a Nash-stable strategy for both task assignment and execution is derived with provable guarantee on the feasibility and quality. Two non-trivial applications of collaborative transportation and dynamic capture are studied against several baselines.

Robotics
Geometric topology based cooperation for multiple robots in adversarial environments

Dandan Zhang,Long Wang,Junzhi Yu

DOI: https://doi.org/10.1016/j.conengprac.2007.12.004

IF: 4.057

2008-01-01

Control Engineering Practice

Abstract:This paper addresses the cooperation problem for a team of mobile robots in adversarial environments. Considering the mutual influence among the robots, two key factors are defined: the impact factor and the suffering factor. A stochastic assignment model is built, based on the geometric topology of the targets, through which the robots can exhibit temporal cooperation. To reduce computational complexity, a genetic algorithm is employed to optimize the relative weights of the impact factor and the suffering factor, and after that, the Improved Hungarian Algorithm is used to solve the assignment problem. Both simulation and experimental results demonstrate the effectiveness of the proposed method.

Parallel Cooperating A-Teams

Towards a cooperative soccer team in RoboCup

Parallel Asynchronous Team Algorithms: Convergence and Performance Analysis

Cooperation strategies for agent-based P2P systems.

Exploiting Heterogeneous Robotic Systems in Cooperative Missions

Reinforcement Learning Strategy for Solving the Resource-Constrained Project Scheduling Problem by a Team of A-Teams

Cooperation and Competition When Bidding for Complex Projects: Centralized and Decentralized Perspectives

Evolving Dyadic Strategies for a Cooperative Physical Task

Research on Cognitive Cooperation in Multi-Agent Systems

Effect of Long-Term Starvation on the Survival, Recovery, and Carbon Utilization Profiles of a Bovine Escherichia coli O157:H7 Isolate from New Zealand

Cooperative parallel asynchronous computation of the solution of symmetric linear systems

Influence of Team Interactions on Multi-Robot Cooperation: A Relational Network Perspective

Parallel Implementations of the Cooperative Particle Swarm Optimization on Many-core and Multi-core Architectures

Modeling And Evaluating Cooperation Strategies In P2p Agent Systems

Cooperative planning for physically interacting heterogeneous robots

Cooperating CoScheduling: A Coscheduling Proposal Aimed at Non-Dedicated Heterogeneous NOWs

A Multi-Agent Cooperating Approach to Quasi-Parallel Genetic Algorithms

Competitive Coevolutionary Multi-Agent Systems: The Application to Mapping and Scheduling Problems

Open Ad Hoc Teamwork with Cooperative Game Theory

Combinatorial-hybrid Optimization for Multi-agent Systems under Collaborative Tasks

Geometric topology based cooperation for multiple robots in adversarial environments