Underwater Point Cloud Transmission Framework: Hybrid Encoder Implementation Based on CNN and Transformer

zexi deng,Yang Zhang,hongbo yang,he wang
DOI: https://doi.org/10.1088/1361-6501/ad8776
IF: 2.398
2024-10-18
Measurement Science and Technology
Abstract:In underwater multi-robot systems, 3D point cloud data generated by sonar and depth sensors facilitates the execution of more complex collaborative tasks among robots, which partly rely on efficient data transmission. In this work, we propose a hybrid encoder framework based on Convolutional Neural Network and Transformer for underwater point cloud transmission, aimed at dealing with large-scale point cloud data. Our encoder allows setting lower compression rate on regions or objects of interest for semantic point clouds, preserving crucial information in the point cloud. For underwater acoustic communication, we employ Orthogonal Frequency Division Multiplexing combined with Deep Joint Source-Channel Coding for transmission to enhance the system error-resilience. Compared to state-of-the-art methods in the simulation experiments, our end-to-end framework achieves considerable compression performance while eliminating certain cliff and leveling effects, also demonstrating robustness even with changing channels.
engineering, multidisciplinary,instruments & instrumentation
What problem does this paper attempt to address?