Multimodal sensory fusion for soccer robot self-localization based on long short-term memory recurrent neural network

Wenhuan Lu,Ju Zhang,Xinli Zhao,Jianrong Wang,Jianwu Dang
DOI: https://doi.org/10.1007/s12652-017-0483-7
IF: 3.662
2017-04-06
Journal of Ambient Intelligence and Humanized Computing
Abstract:Self-localization is a fundamental requirement for autonomous mobile robots. With the rapid development in sensor technology, the sensor suites of robot provide multimodal information that naturally ensures perception robustness, multimodal sensory fusion are able to provide a better solution for enhance the capability of self-localization. This paper proposes a multimodal sensory fusion method based on Long Short-Term Memory (LSTM) Recurrent Neural Network (RNN) for RoboCup 3D Simulation league. This approach fuses Inertia Navigation System (INS) and vision perceptor information from different sensors at feature level instead of raw data. The experiment results demonstrate that the proposed approach makes an improvement in predictive accuracy and efficiency compared with the standard Extended Kalman Filter (EKF) and the static Particle Filter (PF) methods.
computer science, information systems,telecommunications, artificial intelligence
What problem does this paper attempt to address?