Abstract:Face Super-Resolution (FSR) is critical for bolstering intelligent security in Internet of Things (IoT) systems. Recent deep learning-driven FSR algorithms have attained remarkable progress. However, they always require separate model training and optimization for each scaling factor or input resolution, leading to inefficiency and impracticality. To overcome these limitations, we propose SAFNet, an innovative framework tailored for scale-adaptive FSR with arbitrary input resolution. SAFNet integrates scale information into representation learning to enable adaptive feature extraction and introduces dual-embedding attention to boost adaptive feature reconstruction. It leverages facial self-similarity and spatial-frequency collaboration to achieve precise scale-aware SR representations. This is attained through three key modules: the Scale Adaption Guidance Unit (SAGU), the Scale-aware Non-Local Self-similarity (SNLS) module, and the Spatial-Frequency Interactive Modulation (SFIM) module. SAGU imports scaling factors using frequency encoding, SNLS exploits self-similarity to enrich feature representations, and SFIM incorporates spatial and frequency information to predict target pixel values adaptively. Comprehensive evaluations across four benchmark datasets reveal that SAFNet outperforms the second-best compared state-of-the-art (SOTA) method by about 0.2dB/0.007 in PSNR/SSIM (×4 on CelebA) with reduced 18.68%/42.64% computational complexity/time cost. This demonstrates SAFNet’s effectiveness and superiority, showcasing its potential as a promising solution for scale and input resolution adaptation challenges in FSR. The code will be available at https://github.com/ICVIPLab/SAFNethttps://github.com/ICVIPLab/SAFNet.

SFA: Small Faces Attention Face Detector

ASFD: Automatic and Scalable Face Detector

S$^3$FD: Single Shot Scale-invariant Face Detector

Scale-Aware Face Detection.

MSFD:Multi-Scale Receptive Field Face Detector

Feature Agglomeration Networks for Single Stage Face Detection

Finding Tiny Faces

Tiny Face Detection Based on Deep Learning

DEFace: Deep Efficient Face Network for Small Scale Variations

Small Object Detection using Multi-scale Feature Fusion and Attention

EfficientFace: an efficient deep network with feature enhancement for accurate face detection

EfficientSRFace: An Efficient Network with Super-Resolution Enhancement for Accurate Face Detection

FFEDet: Fine-Grained Feature Enhancement for Small Object Detection

ACWFace: efficient and lightweight face detector based on RetinaFace

ADYOLOv5-Face: An Enhanced YOLO-Based Face Detector for Small Target Faces

YOLO-FaceV2: A Scale and Occlusion Aware Face Detector

Scale Attention for Learning Deep Face Representation: A Study Against Visual Scale Variation

See As You Desire: Scale-adaptive Face Super-Resolution for Varying Low Resolutions

A Multi-Scale Fusion Convolutional Neural Network for Face Detection.

SE-IYOLOV3: an Accurate Small Scale Face Detector for Outdoor Security

SAFD: Single Shot Anchor Free Face Detector.