Abstract:In unmanned aerial vehicle based urban observation and monitoring, the performance of computer vision algorithms is inevitably limited by the low illumination and light pollution caused degradation, therefore, the application image enhancement is a considerable prerequisite for the performance of subsequent image processing algorithms. Therefore, we proposed a deep learning and generative adversarial network based model for UAV low illumination image enhancement, named LighterGAN. The design of LighterGAN refers to the CycleGAN model with two improvements—attention mechanism and semantic consistency loss—having been proposed to the original structure. Additionally, an unpaired dataset that was captured by urban UAV aerial photography has been used to train this unsupervised learning model. Furthermore, in order to explore the advantages of the improvements, both the performance in the illumination enhancement task and the generalization ability improvement of LighterGAN were proven in the comparative experiments combining subjective and objective evaluations. In the experiments with five cutting edge image enhancement algorithms, in the test set, LighterGAN achieved the best results in both visual perception and PIQE (perception based image quality evaluator, a MATLAB build-in function, the lower the score, the higher the image quality) score of enhanced images, scores were 4.91 and 11.75 respectively, better than EnlightenGAN the state-of-the-art. In the enhancement of low illumination sub-dataset Y (containing 2000 images), LighterGAN also achieved the lowest PIQE score of 12.37, 2.85 points lower than second place. Moreover, compared with the CycleGAN, the improvement of generalization ability was also demonstrated. In the test set generated images, LighterGAN was 6.66 percent higher than CycleGAN in subjective authenticity assessment and 3.84 lower in PIQE score, meanwhile, in the whole dataset generated images, the PIQE score of LighterGAN is 11.67, 4.86 lower than CycleGAN.

Image Enhancement of Low Light UAV Via Global Illumination Self-aware Feature Estimation

Low Light Enhancement by Unsupervised Network.

Lightweight Network Learning with Zero-Shot Neural Architecture Search for UAV Images

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Depth-Conditioned GAN for Underwater Image Enhancement

Zero-referenced Enlightening and Restoration for UAV Nighttime Vision

Self-Supervised Monocular Depth Estimation Using Global and Local Mixed Multi-Scale Feature Enhancement Network for Low-Altitude UAV Remote Sensing

Deep Learning-Based Technique for Remote Sensing Image Enhancement Using Multiscale Feature Fusion

HighlightNet: Highlighting Low-Light Potential Features for Real-Time UAV Tracking

LighterGAN: An Illumination Enhancement Method for Urban UAV Imagery

Image Restoration Via UAVFormer for Under-Display Camera of UAV.

Dense and Small Object Detection in UAV-Vision Based on a Global-Local Feature Enhanced Network

Low-Light Image Enhancement via a Deep Hybrid Network

Low-Light Image Enhancement With Regularized Illumination Optimization and Deep Noise Suppression

Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillance

Enhancing the Localization Accuracy of UAV Images under GNSS Denial Conditions

Enhancing Nighttime UAV Tracking with Light Distribution Suppression

Enlightening Low-Light Images With Dynamic Guidance for Context Enrichment

Low-light-level image enhancement algorithm based on integrated networks

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

Semantic segmentation for UAV low-light scenes based on deep learning and thermal infrared image features