Towards the automatic selection of optimal seam line locations when merging optical remote-sensing images

Le Yu,Eun Jung Holden,Mike Charles Dentith,Hankui Zhang
DOI: https://doi.org/10.1080/01431161.2010.545083
IF: 3.531
2012-01-01
International Journal of Remote Sensing
Abstract:Image mosaicking is an important task in remote sensing due to the need for imagery with a greater spatial extent than provided by individual scenes. Merging of images requires the selection of a seam line within their area of overlap along which the scenes are merged. The seam line has a better chance of being invisible if it lies in regions where the images to be merged are very similar. The automatic detection of an optimal seam line is not a trivial task as it is difficult to find laterally continuous regions with high image similarity, and to identify image similarities when there are variations in the images, for example due to different illuminations or viewing directions, or shadow differences of tall structures. This article presents an automatic seam line location technique for remote-sensing images and achieves the following three objectives: to trace along the locations with minimal image difference so that the merged data set appears seamless; to avoid creating discontinuities within salient features within the images; and to ensure that the more accurate radiometric values that are associated with the least distance from the nadir point are better preserved in the mosaic image. Therefore, our method uses pixel-based image similarity measurement to choose the locations with high colour, edge and texture similarity; a region-based saliency map that is based on a human attention model to identify and avoid the areas with visibly dominant foreground objects; and location preference to encourage the seam line to lie as close as possible to an equal distance from the two nadir points of the images being merged. These measures are used as input to a cost function and the estimated costs are used to guide the tracing of the seam line in a dynamic programming algorithm. Our experiments demonstrate that the consideration of a combination of factors produces superior results to using just one or two of the variables as controls when merging high-resolution images containing complex structures.
What problem does this paper attempt to address?