Elastic Disentangle-Based Training for Point Cloud Segmentation Model with Remission Perturbation

Yongjian Fu,Shanding Ye,Hu Lin,Hong Li,Zhijie Pan
DOI: https://doi.org/10.1109/itsc57777.2023.10422610
2023-01-01
Abstract:Recent years have witnessed the significant development of intelligent transportation, especially for autonomous vehicle. As an important component of AV perceptual and mapping module, laser LiDAR, as well as its 3D point cloud data, are drawing more attention and are usually solved with impressively effective deep learning algorithm nowadays. However, deep learning methods are widely proved to be vulnerable to input perturbation, hindering the security of such a safety-critical application. Researchers therefore are paying attention to the security and robustness of point cloud perceptual models. While they usually mainly focus on geometric information (the 3D coordinates of cloud points), another important piece of information, remission, gains less attention. In this paper, we claim that remission contains a wealth of semantic information and plays non-negligible role in point cloud perception algorithm. We focus on the robustness of a point cloud deep model when confronting remission-based model-agnostic perturbation or model-aware adversarial attack, and a series of experiments indicate the importance of remission and the vulnerability of the deep model. Apart from that, we also propose an elastic disentangle-based training method in an adversarial manner to improve the robustness by flexibly adapting the model to depend more or less on remission information. Experiments show the effectiveness of our method, and the performance impairments when suffering model-agnostic perturbation and model-aware adversarial attack decrease by around 70% and 40%, respectively.
What problem does this paper attempt to address?