Abstract:Machine Learning (ML) and Artificial intelligence (AI) have increased automation potential within defense applications such as border protection, compound security, and surveillance applications. Advances in low-size weight and power (SWAP) computing platforms and unmanned aerial systems (UAS) have enabled autonomous systems to meet the critical needs of future defense systems. Recent academic advances in deep learning aided computer vision yielding impressive results on object detection and recognition, necessary capabilities to enable autonomy in defense applications. These advances, often open-sourced, enable the opportunistic integration of state-of-the-art (SOTA) algorithms. However, these systems require a large amount of object-relevant data to transfer from general academic domains to more relevant situations. Additionally, UAS systems require costly verification and validation of autonomy logic. These challenges can lead to high costs for both training data generation and costly field autonomy integration and testing activities. To address these challenges, in conjunction with partners, Elbit America has developed a multipurpose synthetic simulation environment capable of generating synthetic training data and prototyping, verifying, and validating autonomous distributed behaviors. We integrated a thermal modeling capability into Unreal Engine to create realistic training data by enabling the real-time simulation of SWIR, MWIR, and LWIR sensors. This radiometrically correct sensor model capability enables the simulation-based training data generation for our object recognition and classification pipeline, called Rapid Algorithm Development and Deployment (RADD). Several drones were instantiated using emulated flight controllers to enable end-to-end autonomy training and development before hardware availability. Herein, we describe an overview of the simulation environment and its relevance to detection, classification, and distributed autonomous decision-making.

TanksWorld: A Multi-Agent Environment for AI Safety Research

AI Safety Gridworlds

Safeguarding AI Agents: Developing and Analyzing Safety Architectures

From homeostasis to resource sharing: Biologically and economically compatible multi-objective multi-agent AI safety benchmarks

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?

MatrixWorld: A pursuit-evasion platform for safe multi-agent coordination and autocurricula

HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions

Multi-agent collaboration environment simulation

PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety

Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

Trustworthy, Responsible, and Safe AI: A Comprehensive Architectural Framework for AI Safety with Challenges and Mitigations

Concrete Problems in AI Safety, Revisited

A Virtual Environment with Multi-Robot Navigation, Analytics, and Decision Support for Critical Incident Investigation

Intelligent complex for modeling safety movement of a multi-agent group of marine robots in uncertain environments

Games for AI Control: Models of Safety Evaluations of AI Deployment Protocols

Let's Keep It Safe: Designing User Interfaces that Allow Everyone to Contribute to AI Safety

A Safe Harbor for AI Evaluation and Red Teaming

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

Learning Adaptive Safety for Multi-Agent Systems

World Models: The Safety Perspective

Artificial Intelligence for Safety-Critical Systems in Industrial and Transportation Domains: A Survey