Abstract:High dynamic range imaging (HDRI) is an essential task in remote sensing, enhancing low dynamic range (LDR) remote sensing images and benefiting downstream tasks, such as object detection and image segmentation. However, conventional frame-based HDRI methods may encounter challenges in real-world scenarios due to the limited information inherent in a single image captured by conventional cameras. In this paper, an event-based remote sensing HDR imaging framework is proposed to address this problem, denoted as ERS-HDRI, which reconstructs the remote sensing HDR image from a single-exposure LDR image and its concurrent event streams. The proposed ERS-HDRI leverages a coarse-to-fine framework, incorporating the event-based dynamic range enhancement (E-DRE) network and the gradient-enhanced HDR reconstruction (G-HDRR) network. Specifically, to efficiently achieve dynamic range fusion from different domains, the E-DRE network is designed to extract the dynamic range features from LDR frames and events and perform intra- and cross-attention operations to adaptively fuse multi-modal data. A denoise network and a dense feature fusion network are then employed for the generation of the coarse, clean HDR image. Then, the G-HDRR network, with its gradient enhancement module and multiscale fusion module, performs structure enforcement on the coarse HDR image and generates a fine informative HDR image. In addition, this work introduces a specialized hybrid imaging system and a novel, real-world event-based remote sensing HDRI dataset that contains aligned remote sensing LDR images, remote sensing HDR images, and concurrent event streams for evaluation. Comprehensive experiments have demonstrated the effectiveness of the proposed method. Specifically, it improves state-of-the-art PSNR by about 30% and the SSIM score by about 9% on the real-world dataset.

Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation

Event-based asynchronous HDR imaging by temporal incident light modulation

A novel high dynamic range microscopic video system based on REC.2020

Event-assisted 12-stop HDR Imaging of Dynamic Scene

HDR Imaging for Dynamic Scenes with Events

EventHDR: from Event to High-Speed HDR Videos and Beyond

Learning Event Guided High Dynamic Range Video Reconstruction

ERS-HDRI: Event-Based Remote Sensing HDR Imaging

Color Event Enhanced Single-Exposure HDR Imaging

Pixel-wise Exposure Control for Single-Shot HDR Imaging: A Joint Optimization Approach

An Asynchronous Linear Filter Architecture for Hybrid Event-Frame Cameras

Learning from General Diffuse Surfaces: An Event-driven Approach for High Dynamic Range Industrial Optical Measurement

Single‐Shot Auto‐Exposure and High Dynamic Range Imaging Based on Asynchronous Operation of Pixel Array Circuitry

Towards a Robust HDR Imaging System

An Efficient Synthesizing and Tone-Mapping System for High Dynamic Range Images

A closed-loop all-electronic pixel-wise adaptive imaging system for high dynamic range video

Robust Artifact-Free High Dynamic Range Imaging of Dynamic Scenes

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos

Temporal-Mapping Photography for Event Cameras

Image Reconstruction with Event Cameras Based on Asynchronous Particle Filter

HDR Synthesis Technology for Spaceborne CMOS Cameras Based on Virtual Digital TDI