Abstract:Artificial Intelligence (AI) methods need to be evaluated thoroughly to ensure reliable behavior. In applications like autonomous driving, a complex environment with an uncountable number of different situations and conditions needs to be handled by a method whose behavior needs to be predictable. To accomplish this, simulations can be used as a first step. However, the physical world behaves differently, as the example of autonomous driving shows. There, erroneous behavior has been found in test drives that was not noticed in simulations. Errors were caused by conditions or situations that were not covered by the simulations (e.g., specific lighting conditions or other vehicle's behavior). However, the problem with real world testing of autonomous driving features is that critical conditions or situations occur very rarely-while the test effort is high. A solution can be the combination of physical world tests and simulations-and miniature vehicles as an intermediate step between both. With model cars (in a sufficiently complex model environment) advantages of both can be combined: (1) low test effort and a repeatable variation of conditions/situations as an advantage like in simulations and (2) (limited) physical world testing with unspecified and potentially unknown properties as an advantage like in real-world tests. Additionally, such physical tests can be carried out in less stable cases like already in the early stages of AI method testing and/or in approaches using online learning. Now, we propose to use a) miniature vehicles at a small scale of 1:87 and b) use sensors and computational power only on the vehicle itself. By this limitation, a further consequence is expected: Here, autonomy methods need to be optimized drastically or even redesigned from scratch. The resulting methods are supposed to be less complex-and, thus, again less error-prone. We call this approach "Miniature Autonomy" and apply it to the road, water, and aerial vehicles. In this article, we briefly describe a small test area we built (3 sqm.), a large test area used alternatively (1,545 sqm.), two last generation autonomous miniature vehicles (one road, one aerial vehicle), and an autonomous driving demo case demonstrating the application.

Foundation Models for Rapid Autonomy Validation

SAVME: Efficient Safety Validation for Autonomous Systems Using Meta-Learning

Prospective Role of Foundation Models in Advancing Autonomous Vehicles

Dynamically Expanding Capacity of Autonomous Driving with Near-Miss Focused Training Framework

Efficient falsification approach for autonomous vehicle validation using a parameter optimisation technique based on reinforcement learning

Diagnosing and Predicting Autonomous Vehicle Operational Safety Using Multiple Simulation Modalities and a Virtual Environment

Rapid Generation of Challenging Simulation Scenarios for Autonomous Vehicles Based on Adversarial Test

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing

ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events

A human factors approach to validating driver models for interaction-aware automated vehicles

Towards a Universal Evaluation Model for Careful and Competent Autonomous Driving

Verifying Collision Risk Estimation using Autonomous Driving Scenarios Derived from a Formal Model

Miniature Autonomy as Means to Find New Approaches in Reliable Autonomous Driving AI Method Design

Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities

CRASH: Challenging Reinforcement-Learning Based Adversarial Scenarios For Safety Hardening

Realistic Extreme Behavior Generation for Improved AV Testing

Experimental Validation of Safe MPC for Autonomous Driving in Uncertain Environments

End-to-end Methods for Autonomous Driving in Simulation

An Adaptive Multi-Fidelity Sampling Framework for Safety Analysis of Connected and Automated Vehicles

Adaptive Design of Experiments for Accelerated Safety Evaluation of Automated Vehicles

Interactive Critical Scenario Generation for Autonomous Vehicles Testing Based on In-depth Crash Data Using Reinforcement Learning