EgoSampling: Wide View Hyperlapse From Egocentric Videos

Tavi Halperin,Yair Poleg,Chetan Arora,Shmuel Peleg

DOI: https://doi.org/10.1109/tcsvt.2017.2651051

IF: 5.859

2018-05-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The possibility of sharing one’s point of view makes the use of wearable cameras compelling. These videos are often long, boring, and coupled with extreme shaking, as the camera is worn on a moving person. Fast-forwarding (i.e., frame sampling) is a natural choice for quick video browsing. However, this accentuates the shake caused by natural head motion in an egocentric video, making the fast-forwarded video useless. We propose EgoSampling, an adaptive frame sampling that gives stable, fast-forwarded, hyperlapse videos. Adaptive frame sampling is formulated as an energy minimization problem, whose optimal solution can be found in polynomial time. We further turn the camera shake from a drawback into a feature, enabling the increase in field of view of the output video. This is obtained when each output frame is mosaiced from several input frames. The proposed technique also enables the generation of a single hyperlapse video from multiple egocentric videos, allowing even faster video consumption.

engineering, electrical & electronic