The Effect of Infrared and Visible Image Fusion on Object Tracking Using Correlation Matching

Songfeng Yin,Liangcai Cao,Guofan Jin
DOI: https://doi.org/10.1117/12.900833
2011-01-01
Abstract:This paper studies on how the performance of object tracking using correlation matching can be affected by the pixel-level infrared and visible image fusion approaches, as compared to tracking using single modality source images. Several classic grayscale and color image fusion approaches have been investigated, with the former including traditional DWT method and our proposed adaptive weighted average method based on fuzzy logic and the latter including both linear and nonlinear color transfer methods. Object tracking in various conditions has been tested on a representative set of both simulated and real captured image sequences. Experimental results suggest that the location precision and robustness of object tracking can be improved effectively using fused images. Among the various tested fusion approaches, the techniques of fuzzy logic based grayscale image fusion and nonlinear color transfer consistently offer the best tracking performance.
What problem does this paper attempt to address?