Action Detection by Fusing Hierarchically Filtered Motion with Spatiotemporal Interest Point Features

Zicheng Liu,Yingli Tian,Zhengyou Zhang,Liangliang Cao

DOI: https://doi.org/10.4018/978-1-4666-3682-8.CH012

Abstract:This chapter addresses the problem of action detection from cluttered videos. In recent years, many feature extraction schemes have been designed to describe various aspects of actions. However, due to the difficulty of action detection, e.g., the cluttered background and potential occlusions, a single type of features cannot effectively solve the action detection problems in cluttered videos. In this chapter, we propose a new type of features, Hierarchically Filtered Motion (HFM), and further investigate the fusion of HFM with Spatiotemporal Interest Point (STIP) features for action detection from cluttered videos. In order to effectively and efficiently detect actions, we propose a new approach which combines Gaussian Mixture Models (GMMs) with Branch-and-Bound search to locate interested actions in cluttered videos. The proposed new HFM features and action detection method have been evaluated on the classical KTH dataset and the challenging MSR Action Dataset II which consists of crowded videos with moving people or vehicles in background. Experiment results demonstrate that the proposed method significantly outperforms existing techniques especially for action detection in crowded videos.

Computer Science