Abstract:Machine Learning (ML) and Artificial intelligence (AI) have increased automation potential within defense applications such as border protection, compound security, and surveillance applications. Advances in low-size weight and power (SWAP) computing platforms and unmanned aerial systems (UAS) have enabled autonomous systems to meet the critical needs of future defense systems. Recent academic advances in deep learning aided computer vision yielding impressive results on object detection and recognition, necessary capabilities to enable autonomy in defense applications. These advances, often open-sourced, enable the opportunistic integration of state-of-the-art (SOTA) algorithms. However, these systems require a large amount of object-relevant data to transfer from general academic domains to more relevant situations. Additionally, UAS systems require costly verification and validation of autonomy logic. These challenges can lead to high costs for both training data generation and costly field autonomy integration and testing activities. To address these challenges, in conjunction with partners, Elbit America has developed a multipurpose synthetic simulation environment capable of generating synthetic training data and prototyping, verifying, and validating autonomous distributed behaviors. We integrated a thermal modeling capability into Unreal Engine to create realistic training data by enabling the real-time simulation of SWIR, MWIR, and LWIR sensors. This radiometrically correct sensor model capability enables the simulation-based training data generation for our object recognition and classification pipeline, called Rapid Algorithm Development and Deployment (RADD). Several drones were instantiated using emulated flight controllers to enable end-to-end autonomy training and development before hardware availability. Herein, we describe an overview of the simulation environment and its relevance to detection, classification, and distributed autonomous decision-making.

Astralis: A High-Fidelity Simulator for Heterogeneous Robot and Human-Robot Teaming

FastSim: A Modular and Plug-and-Play Simulator for Aerial Robots

A Comprehensive Simulation Testbench For Aerial Robot In Dynamic Scenario Using Gazebo-Ros

HumRoboSim: an Autonomous Humanoid Robot Simulation System

Aerial Gym -- Isaac Gym Simulator for Aerial Robots

AiRobSim: Simulating a Multisensor Aerial Robot for Urban Search and Rescue Operation and Training

Simulation Platform for Autonomous Aerial Manipulation in Dynamic Environments

OmniLRS: A Photorealistic Simulator for Lunar Robotics

Model-driven design space exploration for multi-robot systems in simulation

A real-time simulation architecture for multi-arm space robots based on rapid prototyping

High-Fidelity Joint Self-Driving Simulation Platform for Unmanned All-Terrain Vehicles

From Concept to Field Tests: Accelerated Development of Multi-AUV Missions Using a High-Fidelity Faster-than-Real-Time Simulator

From Simulations to Reality: Enhancing Multi-Robot Exploration for Urban Search and Rescue

Multi-agent collaboration environment simulation

Development of A Low-Cost High-Fidelity Simulator for Search and Rescue Robot

A Framework for Visually Realistic Multi-robot Simulation in Natural Environment

XTDrone: A Customizable Multi-Rotor UAVs Simulation Platform

Demonstrating HumanTHOR: A Simulation Platform and Benchmark for Human-Robot Collaboration in a Shared Workspace

AAM-SEALS: Developing Aerial-Aquatic Manipulators in SEa, Air, and Land Simulator

QuadSwarm: A Modular Multi-Quadrotor Simulator for Deep Reinforcement Learning with Direct Thrust Control

The Multi-UAV cooperative target tracking simulation system