Abstract:In an era of connectivity and automation, the vehicle industry is adopting numerous technologies to transform driver-centric vehicles into intelligent mechanical devices driven by software components. Software integration and network connectivity inherit numerous security issues that open the door for malicious attacks. Software security testing is a scalable and practical approach to identify systems' weaknesses and vulnerabilities at an early stage and throughout their life-cycle. Security specialists recommend fuzz testing to identify vulnerabilities within vehicle software systems. Nevertheless, the randomness and blindness of fuzzing hinder it from becoming a reliable security tool. This article presents a vulnerability-oriented fuzz (VulFuzz) testing framework that utilizes security vulnerability metrics designed particularly for connected and autonomous vehicles to direct and prioritize the fuzz testing toward the most vulnerable components. While most gray-box fuzzing techniques aim solely to expand code coverage, the proposed approach assigns weights to ensure a thorough examination of the most vulnerable components. Moreover, we employ an input structure-aware mutation technique that can bypass vehicle software systems' input formats to boost test performance and avoid dropped test cases. Such a testing technique will contribute to the quality assurance of vehicle software engineering. We implemented the proposed approach on OpenPilot, a driver assistance system, and compared our results to American fuzzy lop (AFL) and an unguided mutation-based fuzzer. Within 16.8 h, VulFuzz exposed 335 crashes, 41 times more than AFL and two times more than an unguided mutation-based fuzzer. VulFuzz is explicitly efficient for automotive systems, reaching the same code coverage as AFL but with more exposed crashes and fewer dropped messages.

A systematic review of fuzzy testing for information systems and applications

Application of fuzzy expert system in test case selection for system regression test

Vulnerability analysis dased on a fuzzy input testing

A Novel Fuzzy Classification to Enhance Software Regression Testing

Survey of Directed Fuzzy Technology

A systematic review of fuzzing based on machine learning techniques

Vulnerability-Oriented Fuzz Testing for Connected Autonomous Vehicle Systems

Firmware Fuzzing: the State of the Art

Fuzz testing in practice: Obstacles and solutions

PAVFuzz: State-Sensitive Fuzz Testing of Protocols in Autonomous Vehicles

A Survey of Network Protocol Fuzzing: Model, Techniques and Directions

Survey of OS Kernel Fuzzing

Constructing Cyber-Physical System Testing Suites Using Active Sensor Fuzzing

Network protocol fuzz testing for information systems and applications: a survey and taxonomy

A cross-platform multifunctional testbed for vulnerability attack

Automated Software Testing Starting from Static Analysis: Current State of the Art

The Art, Science, and Engineering of Fuzzing: A Survey

A Model-Based Fuzzing Approach for DBMS

V-Fuzz: Vulnerability-Oriented Evolutionary Fuzzing

A Survey on the Development of Network Protocol Fuzzing Techniques

StateFuzz: System Call-Based State-Aware Linux Driver Fuzzing