Abstract:Machine Learning (ML) and Artificial intelligence (AI) have increased automation potential within defense applications such as border protection, compound security, and surveillance applications. Advances in low-size weight and power (SWAP) computing platforms and unmanned aerial systems (UAS) have enabled autonomous systems to meet the critical needs of future defense systems. Recent academic advances in deep learning aided computer vision yielding impressive results on object detection and recognition, necessary capabilities to enable autonomy in defense applications. These advances, often open-sourced, enable the opportunistic integration of state-of-the-art (SOTA) algorithms. However, these systems require a large amount of object-relevant data to transfer from general academic domains to more relevant situations. Additionally, UAS systems require costly verification and validation of autonomy logic. These challenges can lead to high costs for both training data generation and costly field autonomy integration and testing activities. To address these challenges, in conjunction with partners, Elbit America has developed a multipurpose synthetic simulation environment capable of generating synthetic training data and prototyping, verifying, and validating autonomous distributed behaviors. We integrated a thermal modeling capability into Unreal Engine to create realistic training data by enabling the real-time simulation of SWIR, MWIR, and LWIR sensors. This radiometrically correct sensor model capability enables the simulation-based training data generation for our object recognition and classification pipeline, called Rapid Algorithm Development and Deployment (RADD). Several drones were instantiated using emulated flight controllers to enable end-to-end autonomy training and development before hardware availability. Herein, we describe an overview of the simulation environment and its relevance to detection, classification, and distributed autonomous decision-making.

Terrain RL Simulator

The Interactive Simulation Environments of OAIR

Obstacle Tower: A Generalization Challenge in Vision, Control, and Planning

Terrain Runner

Scenic4RL: Programmatic Modeling and Generation of Reinforcement Learning Environments

Self-play Decision-making Method of Deep Reinforcement Learning Guided by Behavior Tree under Complex Environment

DeepMind Lab2D

DeepSim: A Reinforcement Learning Environment Build Toolkit for ROS and Gazebo

CoRL: Environment Creation and Management Focused on System Integration

Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAX

Physical Simulation for Multi-agent Multi-machine Tending

Programmatic Modeling and Generation of Real-Time Strategic Soccer Environments for Reinforcement Learning

A Complex Terrain Simulation Approach Using Ensemble Learning of Random Forest Regression

Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Tasks

ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games

RL STaR Platform: Reinforcement Learning for Simulation based Training of Robots

Environment as Policy: Learning to Race in Unseen Tracks

simlandr: Simulation-Based Landscape Construction for Dynamical Systems

Multi-agent collaboration environment simulation

Developing Algorithms for the Internet of Flying Things Through Environments With Varying Degrees of Realism -- Extended Version

Development of a Simulation Environment for Robot Soccer Game with Deep Reinforcement Learning and Role Assignment