Abstract:Recently, scene coordinate regression (SCoRe) approaches for visual localization have been extensively investigated. However, current SCoRe methods are scene-specific and necessitate retraining when generalizing new scenarios, leaving a consistent rise in model capacity as the number of scenes increases. To this end, we develop UFVL-Net, a unifying framework that integrates localization tasks of multiple indoor scenarios into a manageable network and optimizes these tasks collectively under diversified scene domains, where the localization of each scenario domain is considered a separate task. UFVL-Net is storage-efficient since multiple models with shared parameters can be consolidated into a single one. Specifically, we introduce two parameter sharing policies, that is, channel-wise sharing policy (CSP) and kernel-wise sharing policy, which offer fine-grained parameter sharing within each layer of the backbone for efficient storage while providing task-specific parameters to tackle the inherent hurdles associated with multidomain learning for visual localization, that is, gradient conflict due to a skewed competition among tasks for the shared parameters. The key insight lies in that leveraging task-sharing parameters can learn a generic feature representation across scenes while utilizing task-specific parameters can learn task-related features for alleviating gradient conflict. Moreover, we develop a sign-based gradient normalization (SIGGrad) technique applied to task-sharing parameters to promote the training of UFVL-Net by further mitigating gradient conflict, thus emphasizing the utilization of task-sharing parameters and ensuring that each task is thoroughly optimized. We undertake extensive experiments across numerous datasets and complex real-world scenarios, showing that UFVL-Net families significantly outperform the cutting-edge methods with much less storage space. We demonstrate that UFVL-Net can be generalized to new scenarios using a few task-specific parameters, further highlighting the superiority of UFVL-Net. The code is available at here.

Learning With Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision

Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Toward Robust and Efficient Low-Light Image Enhancement: Progressive Attentive Retinex Architecture Search

Mutual Support and Promotion: Learning Structure Compensation and Context Completion for Low-Light Vision

Low-light Image Enhancement by Retinex Based Algorithm Unrolling and Adjustment

RIRO: from Retinex-Inspired Reconstruction Optimization Model to Deep Low-Light Image Enhancement Unfolding Network

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancement

Learning Multi-scale Retinex with Residual Network for Low-Light Image Enhancement

Low-Light Video Enhancement via Spatial-Temporal Consistent Illumination and Reflection Decomposition

R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network

A Two-Stage Unsupervised Approach for Low Light Image Enhancement

RCNet: Deep Recurrent Collaborative Network for Multi-View Low-Light Image Enhancement

Low-light Image Enhancement Via Deep Retinex Decomposition and Bilateral Learning

Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement

UFVL-Net: A Unified Framework for Visual Localization Across Multiple Indoor Scenes

FRC-Net: A Simple Yet Effective Architecture for Low-Light Image Enhancement

Multi-Modular Network-Based Retinex Fusion Approach for Low-Light Image Enhancement

SCRNet: a Retinex Structure-based Low-light Enhancement Model Guided by Spatial Consistency

Empowering Low-Light Image Enhancer through Customized Learnable Priors