Abstract:High dynamic range imaging (HDRI) is an essential task in remote sensing, enhancing low dynamic range (LDR) remote sensing images and benefiting downstream tasks, such as object detection and image segmentation. However, conventional frame-based HDRI methods may encounter challenges in real-world scenarios due to the limited information inherent in a single image captured by conventional cameras. In this paper, an event-based remote sensing HDR imaging framework is proposed to address this problem, denoted as ERS-HDRI, which reconstructs the remote sensing HDR image from a single-exposure LDR image and its concurrent event streams. The proposed ERS-HDRI leverages a coarse-to-fine framework, incorporating the event-based dynamic range enhancement (E-DRE) network and the gradient-enhanced HDR reconstruction (G-HDRR) network. Specifically, to efficiently achieve dynamic range fusion from different domains, the E-DRE network is designed to extract the dynamic range features from LDR frames and events and perform intra- and cross-attention operations to adaptively fuse multi-modal data. A denoise network and a dense feature fusion network are then employed for the generation of the coarse, clean HDR image. Then, the G-HDRR network, with its gradient enhancement module and multiscale fusion module, performs structure enforcement on the coarse HDR image and generates a fine informative HDR image. In addition, this work introduces a specialized hybrid imaging system and a novel, real-world event-based remote sensing HDRI dataset that contains aligned remote sensing LDR images, remote sensing HDR images, and concurrent event streams for evaluation. Comprehensive experiments have demonstrated the effectiveness of the proposed method. Specifically, it improves state-of-the-art PSNR by about 30% and the SSIM score by about 9% on the real-world dataset.

Towards a Robust HDR Imaging System

A novel high dynamic range microscopic video system based on REC.2020

Highly Robust Real-Time Image Enhancement

An HDR Image Encoding Method Compatible with LDR Image Format

An Efficient Synthesizing and Tone-Mapping System for High Dynamic Range Images

Robust Artifact-Free High Dynamic Range Imaging of Dynamic Scenes

Pixel-wise Exposure Control for Single-Shot HDR Imaging: A Joint Optimization Approach

High Dynamic Range Image Rendering With A Luminance-Chromaticity Independent Model

Multi-Scale Dense Networks for Deep High Dynamic Range Imaging

ERS-HDRI: Event-Based Remote Sensing HDR Imaging

Learned HDR Image Compression for Perceptually Optimal Storage and Display

Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation

Scale-aware Two-stage High Dynamic Range Imaging

A Lightweight Network for High Dynamic Range Imaging

Progressive and Selective Fusion Network for High Dynamic Range Imaging

Event-assisted 12-stop HDR Imaging of Dynamic Scene

High dynamic range fusion for enhanced vision

High Dynamic Range Imaging on Mobile Devices Using Fusion of Multiexposure Images

A Unified HDR Imaging Method with Pixel and Patch Level

SJ-HD^2R: Selective Joint High Dynamic Range and Denoising Imaging for Dynamic Scenes

Efficient HDR Reconstruction from Real-World Raw Images