NTU VIRAL: A Visual-Inertial-Ranging-Lidar Dataset, From an Aerial Vehicle Viewpoint

Thien-Minh Nguyen,Shenghai Yuan,Muqing Cao,Yang Lyu,Thien Hoang Nguyen,Lihua Xie

DOI: https://doi.org/10.1177/02783649211052312

2022-02-01

Abstract:In recent years, autonomous robots have become ubiquitous in research and daily life. Among many factors, public datasets play an important role in the progress of this field, as they waive the tall order of initial investment in hardware and manpower. However, for research on autonomous aerial systems, there appears to be a relative lack of public datasets on par with those used for autonomous driving and ground robots. Thus, to fill in this gap, we conduct a data collection exercise on an aerial platform equipped with an extensive and unique set of sensors: two 3D lidars, two hardware-synchronized global-shutter cameras, multiple Inertial Measurement Units (IMUs), and especially, multiple Ultra-wideband (UWB) ranging units. The comprehensive sensor suite resembles that of an autonomous driving car, but features distinct and challenging characteristics of aerial operations. We record multiple datasets in several challenging indoor and outdoor conditions. Calibration results and ground truth from a high-accuracy laser tracker are also included in each package. All resources can be accessed via our webpage <a class="link-external link-https" href="https://ntu-aris.github.io/ntu_viral_dataset" rel="external noopener nofollow">this https URL</a>.

Robotics,Systems and Control

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of public datasets applicable to autonomous aerial systems (such as unmanned aerial vehicles), especially in the research on navigation capabilities in GPS - denied environments. Specifically, although there are currently many high - quality datasets for self - driving cars and ground robots, there are relatively few datasets specifically for unmanned aerial vehicles. These unmanned aerial vehicle datasets need to cover not only a variety of challenging indoor and outdoor conditions, but also have high - precision ground truth data, so that researchers can verify and compare different navigation algorithms. Therefore, the authors of the paper collected a series of datasets by constructing an unmanned aerial vehicle platform equipped with multiple sensors (such as 3D LiDAR, global shutter camera, inertial measurement unit (IMU), and ultra - wideband (UWB) ranging unit), aiming to fill this gap and provide a new benchmark test suite for unmanned aerial vehicle navigation research.