Abstract:Cooperative visual sensing among multiple vehicles has raised increasing concern with the development of connected vehicular systems. However, it remains challenging for effective cooperative sensing under communication constraints due to the lack of theoretic basis and efficient design for communication resource allocation in visual sensing networks. This paper establishes an information-based bit allocation framework for cooperative visual sensing in vehicular networks, where visual observations captured by on-board cameras are quantized before transmitted to the fusion center for 3D environment model estimation. Our aim is to allocate the quantization bits among observations in the network to minimize the overall estimation error. Specifically, we first design a Fisher information matrix (FIM)-based metric to evaluate the cooperative visual sensing error, and characterize the impact of quantization on sensing with geometric interpretations based on the relation among the 3D physical space, the quantization modulation space and the information eigenspace. Then we present closed-form investigations for the optimal bit allocation among observations in the network, and derive its dependence on network topology and communication constraints. Moreover, we propose a hierarchical bit allocation scheme and a convex relaxation-based scheme for cooperative visual sensing, and compare their performance with the generalized Breiman, Friedman, Olshen, and Stone (GBFOS) algorithm and the uniform allocation scheme. Numerical results validate that our schemes achieve near-optimal sensing performance under communication constraints with a significant reduction of computation load.

On the Information Evolution and Sensor Deployment for Multispacecraft Cooperative Visual 3-D Sensing of Orbital Targets

On the Information Evolution and Sensor Deployment for Multi-Spacecraft Cooperative Visual 3D Sensing of Orbital Targets

Sensor Deployment for Visual 3D Perception: A Perspective of Information Gains

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Geometric Simulation Analysis Of Multi-Band Mosaic Imaging From The Same Orbit By Agile Satellites

Multi-Spacecraft Predictive Sensor Tasking for Cislunar Space Situational Awareness

Metric Sensing and Control of a Quadrotor Using a Homography-Based Visual Inertial Fusion Method.

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Pose Estimation of Non-Cooperative Space Targets Based on Cross-Source Point Cloud Fusion

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion

Optical-and-Radar Image Fusion for Dynamic Estimation of Spin Satellites

An information fusion algorithm for integrated autonomous orbit determination of navigation satellites

Onboard Observer-Enhanced Filter in Handling Orbital Elements Estimation of Non-Cooperative Target

Optimal Observation Geometry Analysis for Multi-sensor System in 3D Case

An Efficient Virtual Stereo-vision Measurement Method of a Space Non-cooperative Target

A Multi-Agent Sensing Framework Via Joint Motion Planning and Resource Optimization

Automatic Instantaneous Attitude Estimation Framework for Spacecraft Based on Colocated Optical/ISAR Observation

Relative Motion Estimation Algorithm for Noncooperative Targets Considering Multiple Solutions of Rotational Parameters

3-D Reconstruction of Space Target Based on Silhouettes Fused ISAR–Optical Images

Information-Based Bit Allocation for Cooperative Visual Sensing in Vehicular Networks

Non-cooperative target recognition and relative motion estimation with inertial measurement unit assistance