Abstract:Machine Learning (ML) and Artificial intelligence (AI) have increased automation potential within defense applications such as border protection, compound security, and surveillance applications. Advances in low-size weight and power (SWAP) computing platforms and unmanned aerial systems (UAS) have enabled autonomous systems to meet the critical needs of future defense systems. Recent academic advances in deep learning aided computer vision yielding impressive results on object detection and recognition, necessary capabilities to enable autonomy in defense applications. These advances, often open-sourced, enable the opportunistic integration of state-of-the-art (SOTA) algorithms. However, these systems require a large amount of object-relevant data to transfer from general academic domains to more relevant situations. Additionally, UAS systems require costly verification and validation of autonomy logic. These challenges can lead to high costs for both training data generation and costly field autonomy integration and testing activities. To address these challenges, in conjunction with partners, Elbit America has developed a multipurpose synthetic simulation environment capable of generating synthetic training data and prototyping, verifying, and validating autonomous distributed behaviors. We integrated a thermal modeling capability into Unreal Engine to create realistic training data by enabling the real-time simulation of SWIR, MWIR, and LWIR sensors. This radiometrically correct sensor model capability enables the simulation-based training data generation for our object recognition and classification pipeline, called Rapid Algorithm Development and Deployment (RADD). Several drones were instantiated using emulated flight controllers to enable end-to-end autonomy training and development before hardware availability. Herein, we describe an overview of the simulation environment and its relevance to detection, classification, and distributed autonomous decision-making.

On games and simulators as a platform for development of artificial intelligence for command and control

Artificial intelligence for wargaming and modeling

The Development Tendency of Artificial Intelligence in Command and Control: A Brief Survey

The Future of Collaborative Human-Artificial Intelligence Decision-Making for Mission Planning

From Chess and Atari to StarCraft and Beyond: How Game AI is Driving the World of AI

Games for Artificial Intelligence Research: A Review and Perspectives

Scalable Interactive Machine Learning for Future Command and Control

Military Simulator - A Case Study of Behaviour Tree and Unity based architecture

Scaling Intelligent Agents in Combat Simulations for Wargaming

Strategic Insights from Simulation Gaming of AI Race Dynamics

The Rise of AI-Driven Simulators: Building a New Crystal Ball

Multi-agent collaboration environment simulation

Scalability in modeling and simulation systems for multi-agent, AI, and machine learning applications

Artificial Intelligence in Military Medicine

Navigating the Landscape of Multiplayer Games

Artificial Intelligence in Military Application – Opportunities and Challenges

Development of intelligent systems and application of gamification in artificial intelligent learning

Agile, Antifragile, Artificial-Intelligence-Enabled, Command and Control

King of the Hill: C2 for Next Generation Swarm Warfare

Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment

From the Lab to the Classroom and Beyond: Extending a Game-Based Research Platform for Teaching AI to Diverse Audiences