Learn to Walk Across Ages: Motion Augmented Multi-Age Group Gait Video Translation

Yiyi Zhang,Yasushi Makihara,Daigo Muramatsu,Jianfu Zhang,Li Niu,Liqing Zhang,Yasushi Yagi
DOI: https://doi.org/10.1109/access.2021.3061684
IF: 3.9
2021-01-01
IEEE Access
Abstract:We propose a framework for multi-age group gait video translation in which, for the first time, individuality-preserving aging patterns in walking style are learnt. More specifically, we build our framework on an existing multi-domain image translation model. Because the existing multi-domain image translation model was originally designed for a still image, we extend it to gait video by introducing a motion-augmented network architecture with three streams, where gait period, period-normalized phase-synchronized gait video, and its frame difference sequence are each input to one stream. We then train the network to ensure three aspects: aging effect (using an age group classification loss), individuality preservation (using a reconstruction loss), and gait realism (using an adversarial loss). Our framework quantitatively and qualitatively outperforms state-of-the-art age progression/regression methods on the largest gait database, OULP-Age, with respect to both age group classification and identity recognition.
What problem does this paper attempt to address?