Abstract:Neuromorphic imaging is an emerging technique that imitates the human retina to sense variations in dynamic scenes. It responds to pixel-level brightness changes by asynchronous streaming events and boasts microsecond temporal precision over a high dynamic range, yielding blur-free recordings under extreme illumination. Nevertheless, this modality falls short in spatial resolution and leads to a low level of visual richness and clarity. Pursuing hardware upgrades is expensive and might cause compromised performance due to more burdens on computational requirements. Another option is to harness offline, plug-in-play super-resolution solutions. However, existing ones, which demand substantial sample volumes for lengthy training on massive computing resources, are largely restricted by real data availability owing to the current imperfect high-resolution devices, as well as the randomness and variability of motion. To tackle these challenges, we introduce the first self-supervised neuromorphic super-resolution prototype. It can be self-adaptive to per input source from any low-resolution camera to estimate an optimal, high-resolution counterpart of any scale, without the need of side knowledge and prior training. Evaluated on downstream tasks, such a simple yet effective method can obtain competitive results against the state-of-the-arts, significantly promoting flexibility but not sacrificing accuracy. It also delivers enhancements for inferior natural images and optical micrographs acquired under non-ideal imaging conditions, breaking through the limitations that are challenging to overcome with frame-based techniques. In the current landscape where the use of high-resolution cameras for event-based sensing remains an open debate, our solution is a cost-efficient and practical alternative, paving the way for more intelligent imaging systems.

Robust Superresolution Computational Imaging with Diffuser-Refined Illumination

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Resolution Enhancement and Background Suppression in Optical Super‐Resolution Imaging for Biological Applications

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Towards Super-Resolution Microwave Imaging: General Framework

Dispersal of adult Asian citrus psyllid, Diaphorina citri Kuwayama (Homoptera: Psyllidae), the vector of citrus greening disease, in artificial release experiments

Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model

Super-resolving Real-world Image Illumination Enhancement: A New Dataset and A Conditional Diffusion Model

Neuromorphic Imaging with Super-Resolution

Super Resolution Imaging Based on a Dynamic Single Pixel Camera

Parallel compressive super-resolution imaging with wide field-of-view based on physics enhanced network

Research on image super-resolution algorithm based on mixed deep convolutional networks

Long-distance mid-wave infrared super-resolution compressive imaging

Super-coding resolution single-pixel imaging based on unpaired data-driven deep learning

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

End-to-end Snapshot Compressed Super-Resolution Imaging with Deep Optics

General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model

Exploiting Raw Images for Real-Scene Super-Resolution

Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network