SWAM: Driver Distraction Recognition Based on Attention Mechanism.

Wanli Li,Jing Huang,Yizhi Huang,Yijie Chen,Renfa Li
DOI: https://doi.org/10.1109/smartworld-uic-atc-scalcom-digitaltwin-pricomp-metaverse56740.2022.00294
2022-01-01
Abstract:With an increasing number of vehicles, drivers, and various multimedia streams, distracted driving has been more prevalent than ever, leading to tremendous fatalities, injuries, and costs. Many efforts have been made to alleviate the threat caused by driver distraction, where methods based on Convolutional Neural Network (CNN) turned out to perform well. As one of the properties of CNN, however, the local perceptive field may serve as a limitation sometimes. Therefore, we propose a novel method named SWAM, which applies Shifted Windows to the Attention Mechanism for vision-based driver distraction recognition. Specifically, the self-attention mechanism is utilized to capture the long-distance dependency, so as to identify different kinds of driver manual distraction. In addition, techniques such as shifted windows and transfer learning are applied to boost performance. The experiments illustrate that our method worked out remarkably on AUC Distracted Driver V2, achieving up to an accuracy of 93.97%.
What problem does this paper attempt to address?