OpenSBT: A Modular Framework for Search-based Testing of Automated Driving Systems

Lev Sorokin,Tiziano Munaro,Damir Safin,Brian Hsuan-Cheng Liao,Adam Molin
2023-11-02
Abstract:Search-based software testing (SBT) is an effective and efficient approach for testing automated driving systems (ADS). However, testing pipelines for ADS testing are particularly challenging as they involve integrating complex driving simulation platforms and establishing communication protocols and APIs with the desired search algorithm. This complexity prevents a wide adoption of SBT and thorough empirical comparative experiments with different simulators and search approaches. We present OpenSBT, an open-source, modular and extensible framework to facilitate the SBT of ADS. With OpenSBT, it is possible to integrate simulators with an embedded system under test, search algorithms and fitness functions for testing. We describe the architecture and show the usage of our framework by applying different search algorithms for testing Automated Emergency Braking Systems in CARLA as well in the high-fidelity Prescan simulator in collaboration with our industrial partner DENSO. OpenSBT is available at <a class="link-external link-https" href="https://git.fortiss.org/opensbt" rel="external noopener nofollow">this https URL</a>. A demo video is provided here: <a class="link-external link-https" href="https://youtu.be/6csl" rel="external noopener nofollow">this https URL</a>\_UAOD\_4.
Software Engineering
What problem does this paper attempt to address?