Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition
Darwin Quezada-Gaibor,Fernando Seco,Miguel Ortiz,Ni Zhu,Valerie Renaudin,Ryosuke Ichikari,Ryo Shimomura,Nozomu Ohta,Satsuki Nagae,Takeshi Kurata,Dongyan Wei,Xinchun Ji,Wenchao Zhang,Sebastian Kram,Maximilian Stahlke,Christopher Mutschler,Antonino Crivello,Paolo Barsocchi,Michele Girolami,Filippo Palumbo,Ruizhi Chen,Yuan Wu,Wei Li,Yue Yu,Shihao Xu,Lixiong Huang,Tao Liu,Jian Kuang,Xiaoji Niu,Takuto Yoshida,Yoshiteru Nagata,Yuto Fukushima,Nobuya Fukatani,Nozomi Hayashida,Yusuke Asai,Kenta Urano,Wenfei Ge,Nien-Ting Lee,Shih-Hau Fang,You-Cheng Jie,Shawn-Rong Young,Ying-Ren Chien,Chih-Chieh Yu,Chengqi Ma,Bang Wu,Wei Zhang,Yankun Wang,Yonglei Fan,Stefan Poslad,David R. Selviah,Weixi Wang,Hong Yuan,Yoshitomo Yonamoto,Masahiro Yamaguchi,Tomoya Kaichi,Baoding Zhou,Xu Liu,Zhining Gu,Chengjing Yang,Zhiqian Wu,Doudou Xie,Can Huang,Lingxiang Zheng,Ao Peng,Ge Jin,Qu Wang,Haiyong Luo,Hao Xiong,Linfeng Bao,Pushuo Zhang,Fang Zhao,Chia-An Yu,Chun-Hao Hung,Leonid Antsfeld,Boris Chidlovskii,Haitao Jiang,Ming Xia,Dayu Yan,Yuhang Li,Yitong Dong,Ivo Silva,Filipe Meneses,Adriano Moreira,Cedric De Cock,David Plets,Miroslav Opiela,Liqiang Zhang,Hu Li,Boxuan Chen,Yu Liu,Seanglidet Yean,Bo Zhi Lim,Wei Jie Teo,Bu Sung Lee,Hong Lye Oh,Francesco Potorti,Joaquin Torres-Sospedra,Antonio Ramon Jimenez,Antoni Perez-Navarro,Cristiano Pendao,Maria Joao Nicolau,Antonio Costa,Jakub Dzama
DOI: https://doi.org/10.1109/jsen.2021.3083149
IF: 4.3
2022-03-15
IEEE Sensors Journal
Abstract:Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements.
engineering, electrical & electronic,instruments & instrumentation,physics, applied