Abstract:Reconstruction and mapping of outdoor urban environment are critical to a large variety of applications, ranging from large-scale city-level 3D content creation for augmented and virtual reality to the digital twin construction of smart cities and automatic driving. The construction of large-scale city-level 3D model will become another important medium after images and videos. We propose an autonomous approach to reconstruct the voxel model of the scene in real-time, and estimate the best set of viewing angles according to the precision requirement. These task views are assigned to the drones based on Optimal Mass Transport (OMT) optimization. In this process, the multi-level pipelining in the chip design method is applied to accelerate the parallelism between exploration and data acquisition. Our method includes: (1) real-time perception and reconstruction of scene voxel model and obstacle avoidance; (2) determining the best observation and viewing angles of scene geometry through global and local optimization; (3) assigning the task views to the drones and planning path based on the OMT optimization, and iterating continuously according to new exploration results; (4) expediting exploration and data acquisition in parallel through multi-stage pipeline to improve efficiency. Our method can schedule routes for drones according to the scene and its optimal acquisition perspective in real-time, which avoids the model void and lack of accuracy caused by traditional aerial 3D scanning using routes of cultivating land regardless of the object, and lays a solid foundation for the 3D real-life model to directly become the available 3D data source for AR and VR. We evaluate the effectiveness of our method by collecting several groups of large-scale city-level data. Facts have proved that the accuracy and efficiency of reconstruction have been greatly improved.

Optimal Trajectory Planning of Drones for 3D Mobile Sensing

3D Path Planning of the Solar Powered UAV in the Urban-mountainous Environment with Multi-objective and Multi-constraint Based on the Enhanced Sparrow Search Algorithm Incorporating the Levy Flight Strategy

Time-optimal UAV Trajectory Planning for 3D Urban Structure Coverage

3D Trajectory Planning for Real-Time Image Acquisition in UAV-assisted VR

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

Near-Optimal 3-D Visual Coverage for Quadrotor Unmanned Aerial Vehicles Under Photogrammetric Constraints

A Path Planning Method for Collaborative Coverage Monitoring in Urban Scenarios

Multi-Drone Collaborative Trajectory Optimization for Large-Scale Aerial 3D Scanning

Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

Minimum time trajectory generation for surveying using UAVs

A Novel AI-Based Framework for AoI-Optimal Trajectory Planning in UAV-Assisted Wireless Sensor Networks

Optimal Trajectory Planning for UAV-relayed Dynamic Spectrum Access

Efficient Aerial Data Collection with Cooperative Trajectory Planning for Large-Scale Wireless Sensor Networks

Trajectory Planning for Unmanned Aerial Vehicles in Complicated Urban Environments: A Control Network Approach

On Theoretical Trajectory Planning of Multiple Drones To Minimize Latency in Search-and-Reconnaissance Operations

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

UAV Swarm Deployment and Trajectory for 3D Area Coverage via Reinforcement Learning

Optimal Transmission Control and Learning-Based Trajectory Design for UAV-Assisted Detection and Communication

UAV Trajectory Planning for Data Collection from Time-Constrained IoT Devices

DRL-UTPS: DRL-Based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network