WiCapose: Multi-modal fusion based transparent authentication in mobileenvironments

Zhuo Chang,Yan Meng,Wenyuan Liu,Haojin Zhu,Lin Wang
DOI: https://doi.org/10.1016/j.jisa.2022.103130
IF: 4.96
2022-01-01
Journal of Information Security and Applications
Abstract:The prosperity of mobile sensing technology makes smartphone-based authentication more prevalent in mobileenvironment. The present single-modality security authentication based on human biometrics is vulnerableto counterfeit, and the procedure of basic two-factor authentication (2FA) is cumbersome. In this work, wepropose a 2FA method without additional devices and procedures, namelyWiCapose. The essential techniqueis to use the unique correlation of the two side-channel to complete multi-modal feature extraction andfusion authentication.WiCaposecan simultaneously extract the radio frequency (RF) gain feature that directlycharacterizes the finger movement and the inter-frame spatio-temporal difference from the rear camera thatindirectly portrays the tapping behaviors, to blend the micro-scale behavior pattern feature of the user's fingerand implicit biological features. Then we design and train a deep neural network to fuse both factors formitigating the limitation of the RF factor in environmental generalization and the uniqueness of the imagefactor on authentication performance. Experiments involving ten participants demonstrate that our method canachieve a 98% average accuracy on authentication and effectively resist shoulder-surfing attacks and mimicattacks.
What problem does this paper attempt to address?