Fast and Reliable Computational Rephotography on Mobile Device

Fei-Peng Tian,Yi-Bo Shi,Dongxu Miao,Wei Feng

DOI: https://doi.org/10.1109/ICME.2018.8486559

2018-07-01

Abstract:Rephotography, aiming to take a well-aligned image from the same pose of a reference image, is a very useful technique to study history, monitor environment and detect minute changes. Previous works either rely on human eye judgement that is very challenging and tedious or depend on high-precision robot platform that is non-portable and inapplicable to wild scenes. In this paper, we propose a fast and reliable computational rephotography approach that works well on mobile devices. Through well designed fast matching, our approach can generate faithful visual navigation rectangles and provide reliable navigation information in nearly real-time, thus is able to easily guide the rephotography process. To improve robustness and speed, we present a series of techniques including effective keyframe decision, feature substitution’ flow-based fast matching and adaptive matching mode switching. As a result, our approach can be well applied on wild environments and robust to large illumination and target changes. Extensive experiments verify its accuracy, effectiveness and generality on both planar and 3D scenes.

Computer Science,Engineering