Abstract:This poster paper will discuss a variety of items related to Human-Machine Teaming and research in support in-creasing control of autonomous machines present in phys-ical problem domains of interest. Many military tasks can be decomposed into their primary elements – intelligence preparation, reconnaissance, movement, maneuver, fires, and and support across the combat domains of interest – air, land, sea, etc. There are an increasing number of au-tonomous and semi-autonomous ground-based systems available, such as the Multi-Utility Tactical Transport (MUTT) Unmanned Ground Vehicle, for movement of materials, or Quadrupedal Unmanned Ground Vehicle (QUGV) for the disposal of explosive ordinance, comple-mented by aerial platforms considering of a wide variety of Unmanned Aerial Systems (UAS) for the gathering and transmitting of information, held together by a common backbone and network. The preponderance of new systems and capabilities brings new issues, one of which is critical to research - how to control and manage a large number of systems. Commercial systems of significantly less capability, such as light-up drone shows, involve approximately 2 people per 100 drones; meaning that a single controller for a sin-gle drone is simply a non-starter. How can research be applied to scale the complexity of operations upwards without additional demands of personnel? This poster discusses several portions of early-stage research into a variety of applications, including: Reasoning about mixed-team processes, includ-ing real/synthetic teammates, and how infor-mation gathered about the use of synthetic teammates within simulation can be transitioned into utilization for a robotic teammate Embedding affective information into dialogue channels in order to save cognitive bandwidth Repurposing of foundational dialogue models for specific tasks and purposes Utilizing psychological research to design sys-tems in order to infer user intent Theory of mind research for autonomous systems regarding their human operators Simulated environments and agents in order to test the simulations in representative areas. Common-Sense reasoning augmented by Large Language Model technology for instructing ro-botic platforms The following things will be discussed at the poster ses-sion, representing a portfolio of ongoing work addressing the problems of large-scale multi-agent command and control. While the near-term application of these tech-nologies is into military problem domains; the poster presentation is cleared for public release.

TagTeam: Towards Wearable-Assisted, Implicit Guidance for Human--Drone Teams

Tethered Aerial Visual Assistance

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework

Human-UAV Teaming in Dynamic and Uncertain Environments.

Autonomous Visual Assistance for Robot Operations Using a Tethered UAV

Learning to Assist and Communicate with Novice Drone Pilots for Expert Level Performance

The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System

An Intelligent Human–Unmanned Aerial Vehicle Interaction Approach in Real Time Based on Machine Learning Using Wearable Gloves

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Human-Machine Teaming for UAVs: An Experimentation Platform

Multimodal Interaction with Multiple Co-located Drones in Search and Rescue Missions

Challenges in Close-Proximity Safe and Seamless Operation of Manned and Unmanned Aircraft in Shared Airspace

A Low-Level Active Vision Framework For Collaborative Unmanned Aircraft Systems

Shared Affordance-awareness via Augmented Reality for Proactive Assistance in Human-robot Collaboration

Tools and methods for Human-Autonomy Teaming: Contributions to cognitive state monitoring and system adaptation

Vision-based Relative Detection and Tracking for Teams of Micro Aerial Vehicles

Moving to Advanced Research on Human Machine Interface Design

Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyond

Autonomous Navigation System for Multi-Quadrotor Coordination and Human Detection in Search and Rescue