Abstract:In this work, we propose a disruptively frugal LiDAR perception dataflow that generates rather than senses parts of the environment that are either predictable based on the extensive training of the environment or have limited consequence to the overall prediction accuracy. Therefore, the proposed methodology trades off sensing energy with training data for low-power robotics and autonomous navigation to operate frugally with sensors, extending their lifetime on a single battery charge. Our proposed generative pre-training strategy for this purpose, called as radially masked autoencoding (R-MAE), can also be readily implemented in a typical LiDAR system by selectively activating and controlling the laser power for randomly generated angular regions during on-field operations. Our extensive evaluations show that pre-training with R-MAE enables focusing on the radial segments of the data, thereby capturing spatial relationships and distances between objects more effectively than conventional procedures. Therefore, the proposed methodology not only reduces sensing energy but also improves prediction accuracy. For example, our extensive evaluations on Waymo, nuScenes, and KITTI datasets show that the approach achieves over a 5% average precision improvement in detection tasks across datasets and over a 4% accuracy improvement in transferring domains from Waymo and nuScenes to KITTI. In 3D object detection, it enhances small object detection by up to 4.37% in AP at moderate difficulty levels in the KITTI dataset. Even with 90% radial masking, it surpasses baseline models by up to 5.59% in mAP/mAPH across all object classes in the Waymo dataset. Additionally, our method achieves up to 3.17% and 2.31% improvements in mAP and NDS, respectively, on the nuScenes dataset, demonstrating its effectiveness with both single and fused LiDAR-camera modalities. <a class="link-external link-https" href="https://github.com/sinatayebati/Radial_MAE" rel="external noopener nofollow">this https URL</a>.

PRISM: Pre-training RF Signals in Sparsity-aware Masked Autoencoders

MRF3Net: Infrared Small Target Detection Using Multi-Receptive Field Perception and Effective Feature Fusion

SBRF: A Fine-Grained Radar Signal Generator for Human Sensing

RF-Prism: Versatile RFID-based Sensing Through Phase Disentangling.

RFMask: A Simple Baseline for Human Silhouette Segmentation with Radio Signals

OpticalRS-4M: Scaling Efficient Masked Autoencoder Learning on Large Remote Sensing Dataset

PRISM: Mitigating EHR Data Sparsity Via Learning from Missing Feature Calibrated Prototype Patient Representations

NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields

RF-URL: Unsupervised Representation Learning for RF Sensing.

PRISM: Leveraging Prototype Patient Representations with Feature-Missing-Aware Calibration for EHR Data Sparsity Mitigation

Mask-VRDet: A Robust Riverway Panoptic Perception Model Based on Dual Graph Fusion of Vision and 4D Mmwave Radar

RF-URL

Dreamer: Dual-RIS-aided Imager in Complementary Modes

3-D SAR Imaging via Perceptual Learning Framework With Adaptive Sparse Prior

SpaRC: Sparse Radar-Camera Fusion for 3D Object Detection

Learning-based Split Unfolding Framework for 3-D Mmw Radar Sparse Imaging

Exploiting global and instance-level perceived feature relationship matrices for 3D face reconstruction and dense alignment

PSPNet:Pretraining and Self-supervised Fine-Tuning Based Prototypical Network for Radar Active Deception Jamming Recognition with Few Shots

psPRF:Pansharpening Planar Neural Radiance Field for Generalized 3D Reconstruction Satellite Imagery

Sense Less, Generate More: Pre-training LiDAR Perception with Masked Autoencoders for Ultra-Efficient 3D Sensing

RadarFormer: End-to-End Human Perception With Through-Wall Radar and Transformers