Abstract:The practical application of visual odometry (VO) is challenging under High Dynamic Range (HDR) environments which has a significant impact on the quality of feature point tracking. There are two key attributes that affect the image quality of a camera, namely exposure time and gain. The goal of camera attributes control research is to design algorithms that can actively adjust camera acquisition attributes to obtain clear, information-rich images. We propose an efficient and stable camera attributes control method with distinct image quality metrics and a linear convergence search algorithm. Specifically, we propose to use the weighted sum of image gradient and entropy to represent the image quality. Its first order derivative is also computed for a line search algorithm to determine the optimal camera exposure. Then, the algorithm estimates scene change speed by optical flow and finds out the maximum exposure time without motion blur. Ultimately, the maximum exposure time and optimal camera exposure are used to determine the camera properties including exposure time and gain. Additionally, the proposed method speeds up the convergence of the algorithm with the help of simulated image generation which enables nearly optimal attributes to be obtained directly from an overexposed or underexposed image. To validate the proposed approach, we test it in challenging HDR environments with fast motion and compare it with built-in automatic exposure. It will be open source for the benefit of the community.

Robustness of Projection Algorithm for Under-Exposured Images

Real-Time Digital Image Stabilization System Based on Gray Projection Algorithm

Real-time Digital Image Stabilization Method Based on Projection Algorithm and Block Matching

Image Stabilization Using Motion Estimation and Micro-mechanical Compensation

A Fast Approach Against Large Foreground Motion in Real-time Image Stabilization

Extreme-Quality Computational Imaging via Degradation Framework

An Efficient Projection Defocus Algorithm Based on Multi-Scale Convolution Kernel Templates

Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination

Robust estimation of spectral reflectance by a projector-camera system

Imaging Simulation and Restoration for Mobile-based Long-focus Camera with Optical Stabilization

Robust ghost-free multiexposure fusion for dynamic scenes.

Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Highly Robust Real-Time Image Enhancement

Motion Blur Suppression Method Based on Dual Mode Imaging for Remote Sensing Image

An Adaptive Illumination Optimization Method for Local Overexposed Image

Robust Camera Motion Estimation in Video Sequences

Synthesize-Then-Evaluate Based Optimal Exposures Selection for High Dynamic Range Fringe Projection Profilometry

Temperature-Robust Learned Image Recovery for Shallow-Designed Imaging Systems

An effective and robust underwater image enhancement method based on color correction and artificial multi-exposure fusion

Pixel-wise Smoothing for Certified Robustness against Camera Motion Perturbations

Camera Attributes Control for Visual Odometry With Motion Blur Awareness