Video interaction event analysis method and device base on sequence space-time cube characteristics

Tian Yonghong,Fang Xiaoyu,Wang Yaowei,Huang Tiejun

2014-01-01

Abstract:The invention relates to a video interaction event analysis method and device base on sequence space-time cube characteristics. The method includes the steps of dividing a monitoring video into a plurality of space-time cube sequences on the basis of a detection tracking result of the monitoring video, extracting object tracks, the appearance and local movement descriptors in each space-time cube, forming characteristic segments through the extracted descriptors, reconstructing the characteristic segments in all the space-time cubes to establish the sequence space-time cube characteristics, and conducting interaction event classification detection through the sequence space-time cube characteristics. The device comprises a preprocessing module, a video sequence dividing module, a space-time cube characteristic extraction module, a space-time characteristic reconstruction module and a sequence characteristic classification module. According to the method and the device, high-level semantic layer description is achieved for content of the monitoring video, length-variable sequence characteristic classification is achieved through a multi-core support vector machine based on a dynamic time alignment kernel function, and therefore intelligent detection is achieved for monitoring video stream interaction events.