Abstract:In unmanned aerial vehicle based urban observation and monitoring, the performance of computer vision algorithms is inevitably limited by the low illumination and light pollution caused degradation, therefore, the application image enhancement is a considerable prerequisite for the performance of subsequent image processing algorithms. Therefore, we proposed a deep learning and generative adversarial network based model for UAV low illumination image enhancement, named LighterGAN. The design of LighterGAN refers to the CycleGAN model with two improvements—attention mechanism and semantic consistency loss—having been proposed to the original structure. Additionally, an unpaired dataset that was captured by urban UAV aerial photography has been used to train this unsupervised learning model. Furthermore, in order to explore the advantages of the improvements, both the performance in the illumination enhancement task and the generalization ability improvement of LighterGAN were proven in the comparative experiments combining subjective and objective evaluations. In the experiments with five cutting edge image enhancement algorithms, in the test set, LighterGAN achieved the best results in both visual perception and PIQE (perception based image quality evaluator, a MATLAB build-in function, the lower the score, the higher the image quality) score of enhanced images, scores were 4.91 and 11.75 respectively, better than EnlightenGAN the state-of-the-art. In the enhancement of low illumination sub-dataset Y (containing 2000 images), LighterGAN also achieved the lowest PIQE score of 12.37, 2.85 points lower than second place. Moreover, compared with the CycleGAN, the improvement of generalization ability was also demonstrated. In the test set generated images, LighterGAN was 6.66 percent higher than CycleGAN in subjective authenticity assessment and 3.84 lower in PIQE score, meanwhile, in the whole dataset generated images, the PIQE score of LighterGAN is 11.67, 4.86 lower than CycleGAN.

RelightGAN: Instance-level Generative Adversarial Network for Face Illumination Transfer

Expression Conditional Gan for Facial Expression-to-Expression Translation.

A High-Performance Face Illumination Processing Method via Multi-Stage Feature Maps

IL-GAN: Illumination-invariant representation learning for single sample face recognition

Incremental Focal Loss GANs.

Exploiting Residual and Illumination with GANs for Shadow Detection and Shadow Removal

LumiGAN: Unconditional Generation of Relightable 3D Human Faces

FaceLit: Neural 3D Relightable Faces

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Facial Expression Transfer Based on Conditional Generative Adversarial Networks.

RAMT-GAN: Realistic and accurate makeup transfer with generative adversarial network

RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removal

Facial Expression Translation Using Landmark Guided GANs

LighterGAN: An Illumination Enhancement Method for Urban UAV Imagery

FrseGAN: Free‐style editable facial makeup transfer based on GAN combined with transformer

SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfer

Low-light Image Enhancement Algorithm Based on Retinex and Generative Adversarial Network

Face illumination recovery for the deep learning feature under severe illumination variations

In-the-Wild Facial Highlight Removal via Generative Adversarial Networks.

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition

An Efficient Integration of Disentangled Attended Expression and Identity FeaturesFor Facial Expression Transfer andSynthesis