Jointly optimizing global and local color consistency for multiple image mosaicking
Li Li,Menghan Xia,Chi Liu,Liang Li,Hanyun Wang,Jian Yao
DOI: https://doi.org/10.1016/j.isprsjprs.2020.10.006
IF: 12.7
2020-12-01
ISPRS Journal of Photogrammetry and Remote Sensing
Abstract:<p>In multiple image mosaicking, color inconsistency is a common and severe problem that degrades the quality of composite images. To avoid the appearance of visible seams, we need to optimize the color consistency before mosaicking multiple images. To facilitate the global optimization framework, existing approaches mainly use less flexible global models, e.g., the linear or gamma model, to eliminate the color differences between multiple images. These models can effectively ensure that the global tones in multiple images are consistent. However, their ability to correct local color discrepancies is usually poor. In this paper, we propose a novel image color correction approach that can correct global and local color discrepancies simultaneously and preserve image gradient as much as possible. First, we design an effective and flexible color correction model to represent the color mapping function for each image. Instead of using the same global model to correct color discrepancies for all pixels in one image, we apply a series of local linear models for color correction. For different superpixel regions, different linear models are applied to model the mapping functions. Second, based on this model, a specific global cost function that considers both gradient preservation and color consistency is designed and solved. In addition, a global color constraint is fused into this cost function to ensure that the corrected images have the similar global tone. Thus, we can jointly optimize the global and local color consistency by minimizing this cost function. The experimental results on several challenging datasets captured by different sensors demonstrate that the proposed approach outperforms the state-of-the-art color correction approaches in both visual quality and quantitative metrics.</p>
imaging science & photographic technology,remote sensing,geography, physical,geosciences, multidisciplinary