An ICA Mixture Hidden Markov Model for Video Content Analysis

ZhouJian,ZhangXiao-Ping

IF: 5.859

2008-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In this paper, a new theoretical framework based on hidden Markov model (HMM) and independent component analysis (ICA) mixture model is presented for content analysis of video, namely ICAMHMM. Unli...

What problem does this paper attempt to address?

An ICA Mixture Hidden Markov Model for Video Content Analysis

Jian Zhou,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/tcsvt.2008.2005614

IF: 5.859

2008-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In this paper, a new theoretical framework based on hidden Markov model (HMM) and independent component analysis (ICA) mixture model is presented for content analysis of video, namely ICAMHMM. Unlike the Gaussian mixture observation model commonly used in conventional HMM applications, the observations in the new ICAMHMM are modeled as a mixture of non-Gaussian components. Each non-Gaussian component is formulated by an ICA mixture, reflecting the independence of different components across video frames. In addition, to construct a compact feature space to represent a video frame, ICA is applied on video frames and the ICA coefficients are used to form a compact 2-D feature subspace that makes the subsequent modeling computationally efficient. The model parameters can be identified using supervised learning by the training sequences. The new re-estimation learning formulae of iterative ICAMHMM parameter estimation are derived based on a maximum likelihood function. Employing the identified model, maximum likelihood algorithms are developed to detect and recognize video events. As a case study, golf video sequences are used to test the effectiveness of the proposed algorithm. Experimental results show that the presented method can effectively detect and recognize the recurrent event patterns in video data. The presented new ICAMHMM is generic and can be applied to sequential data analysis in other applications.
Video Event Detection using ICA Mixture Hidden Markov Models

Jian Zhou,Xiao-ping Zhang

DOI: https://doi.org/10.1109/ICIP.2006.312969

2006-01-01

Abstract:In this paper, a framework that combines feature extraction, model learning, and likelihood computation, is presented for video event detection. First, the independent component analysis (ICA) is applied to the raw feature space to extract the spatial features. Then, a framework based on ICA mixture hidden Markov models (ICAMHMM) is used to exploit the spatial and temporal characteristics of the training data. After the model is learnt, the likelihood for a given video sequence is computed and then used to classify the video into a semantic event. Golf video sequences are used for simulations. The results show that the proposed method can effectively detect semantic video events.
Hidden Markov Model Framework Using Independent Component Analysis Mixture Model

Jian Zhou,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/icassp.2006.1661335

2006-01-01

Abstract:This paper describes a novel method for the analysis of sequential data that exhibits strong non-Gaussianities. In particular, we extend the classical continuous hidden Markov model (HMM) by modeling the observation densities as a mixture of non-Gaussian distributions. In order to obtain a parametric representation of the densities, we apply the independent component analysis (ICA) mixture model to the observations such that each non-Gaussian mixture component is associated with a standard ICA. Under this new framework, we develop the re-estimation formulas for the three fundamental HMM problems, namely, likelihood computation, state sequence estimation, and model parameter learning. The simulations also validate the theoretical results
Ice Hockey Shooting Event Modeling with Mixture Hidden Markov Model

Xiaofeng Wang,Xiao-Ping Zhang

DOI: https://doi.org/10.1007/s11042-010-0722-9

IF: 2.577

2011-01-01

Multimedia Tools and Applications

Abstract:In this paper we present a new event analysis framework based on mixture hidden Markov model (HMM) for ice hockey videos. Hockey is a competitive sport and hockey videos are hard to analyze because of the homogeneity of its frame features. However, the temporal dynamics of hockey videos is highly structured. Using the mixture representation of local observations and Markov chain property of hockey event structure, we successfully model the hockey event as a mixture HMM. Based on the mixture HMM, the hockey event could be classified with high accuracy. Two types of mixture HMMs, Gaussian mixture and independent component analysis (ICA) mixture, are compared for the hockey video event classification. The results confirm our analysis that the mixture HMM is a suitable model to deal with videos with intensive activities. The new mixture HMM hockey event model could be a very useful tool for hockey game analysis.
ICA Mixture Hidden Conditional Random Field Model for Sports Event Classification

Xiaofeng Wang,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/iccvw.2009.5457653

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In this paper, a new hidden conditional random field (HCRF) model with independent component analysis (ICA) mixture feature functions is developed for sports event classification. Unlike Hidden Markov Model (HMM), HCRF is a discriminative model without conditional independence assumption of observations, which is more suitable for video content analysis. According to the non-Gaussian property of sports event features, a new feature function using the likelihood of ICA mixture component is proposed to further enhance the HCRF model. The discriminant power of HCRF and representation power of ICA mixture for non-Gaussian distribution are combined. The new model is applied to challenging bowling and golf event classification. The simulation results prove our analysis that the new ICA mixture HCRF outperforms the existing mixture HMM models in term of classification accuracy.
Mrf-Ica Mixture Model for Hyperspectral Imagery Unmixing

Sen Jia,Yuntao Qian

DOI: https://doi.org/10.1142/s0219691307001586

2007-01-01

Abstract:Recently, independent component analysis (ICA) has been used in hyperspectral imagery (HSI) unmixing. It considers the hyperspectral signal from a given pixel as a linear mixture of the constituent spectra (endmember spectra) weighted by the correspondent abundance fractions ( sources). This subpixel-based ICA model has two disadvantages. One is that it is difficult to choose the "mixed" pixels automatically, and the other is that the sources are not statistically independent. As the spatial resolution of HSI data grows higher, we introduce a new substance-based ICA model; that is, distinct substances are regarded as the original sources, and every band image is a linear mixture of them. However, ICA is a very general-purpose statistical technique-it does not take the spatial information into account while unmixing HSI. In this paper, the Markov random field (MRF) model is adopted to incorporate the spatial information into ICA. It is thought of as a powerful tool to model the joint probability distribution of the image pixels based on local spatial interactions. The experimental results demonstrate that the proposed MRF-ICA mixture model provides an effective approach for HSI unmixing.
A novel vector quantization-based video summarization method using independent component analysis mixture model

Junfeng Jiang,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/ICASSP.2011.5946660

2011-01-01

ICASSP

Abstract:In this paper, we present a new independent component analysis mixture vector quantization (ICAMVQ) method to summarize the video content. In particular, independent component analysis (ICA) is applied first to explore the characteristics of video data and build a compact 2D feature space. A new ICAMVQ method is then developed to find the optimized quantization codebook in ICA subspace. The optimal codebook size is determined by Bayes information criterion (BIC). The frames that are the nearest neighbors to the quanta in the ICAMVQ codebook are sampled to summarize the video. A 2D kD-tree is employed to index the feature space and accelerate the nearest-neighbor search. Experimental results show that our method is practically effective and computationally efficient to build a video summarization system.
Spatial-based Bayesian Hidden Markov Models with Dirichlet Mixtures for Video Anomaly Detection

Guojian Luo,Jianfeng Qu,Lina Zhang,Xiaoyu Fang,Yi Zhang,Tong Zhou

DOI: https://doi.org/10.1109/iscc55528.2022.9912983

2022-01-01

Abstract:Increased needs for social security promote the development of video surveillance, appealing to the exigency of real-time detection of anomalous events. Considering the rarity and unpredictability of anomalous events, a classical strategy is to model normal data and detect outliers to the model. As a fundamental generative model for time series data, Hidden Markov models (HMM) have been employed in various fields such as speech recognition and video analysis. In this paper, we propose the use of Bayesian HMMs with Dirichlet mixtures which are arrayed along patched frames with Dirichlet distributions as emission probability functions. These spatially-aligned HMMs evolve in parallel, significantly reducing inference time. Learning algorithm based on Stochastic Variational Inference and Discrete Variable Enumeration is applied to our model for fast and robust inference. Experiments over the public UCSD dataset demonstrate the validity of this approach.
Video Shot Boundary Detection Using Independent Component Analysis

Jian Zhou,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/ICASSP.2005.1415461

2005-01-01

Abstract:Video shot boundary detection is an important early stage of content-based video analysis. In this paper, a new method for shot boundary detection using independent component analysis (ICA) is presented. By projecting video frames from illumination-invariant raw feature space into low dimensional ICA subspace, each video frame is represented by a two-dimensional compact feature vector. An iterative clustering algorithm based on adaptive thresholding is developed to detect cuts and gradual transitions simultaneously in ICA subspace. Experimental results successfully validate the new method and show that it can effectively detect both abrupt transitions and gradual transitions.
An MRF-ICA based algorithm for image separation

Sen Jia,Yuntao Qian

DOI: https://doi.org/10.1007/11539117_57

2005-01-01

Abstract:Separation of sources from one-dimensional mixture signals such as speech has been largely explored. However, two-dimensional sources (images) separation problem has only been examined to a limited extent. The reason is that ICA is a very general-purpose statistical technique, and it does not take the spatial information into account while separating mixture images. In this paper, we introduce Markov random field model to incorporate the spatial information into ICA. MRF is considered as a powerful tool to model the joint probability distribution of the image pixels in terms of local spatial interactions. An MRF-ICA based algorithm is proposed for image separation. It is successfully demonstrated on artificial and real images.
Video Content Categorization Using the Double Decomposition

Youtian Du,Feng Chen,Wenli Xu,Xueming Qian

DOI: https://doi.org/10.1007/s11042-012-1213-y

IF: 2.577

2012-01-01

Multimedia Tools and Applications

Abstract:Video contents contain complex structures due to the variety of the components and events involved. For example, surveillance videos often record multi-object interactions and consist of various scales of motion detail; Web videos are composed of multimodal cues, and each cue generally consists of a variety of scales of information. Generally, video contents comprise two types of the combination of the inherent structures: multi-modality/multi-scale and multi-object /multi-scale. Therefore, in this paper, we propose a new framework for video content modeling, under which video contents are decomposed into multiple interacting processes by double decomposition that aims at each type of combination of structures. To model the resulting processes, we propose a method named double-decomposed hidden Markov models (DDHMMs). DDHMMs contain multiple state chains that correspond to the interacting processes. To make the switching frequency of states in each chain consistent with the scale of the corresponding process, a durational state variable is introduced in DDHMMs. The proposed method performs well in modeling the relations among the interacting processes and the dynamics of each. We discuss the appropriate features under the proposed framework and evaluate DDHMMs in two applications, human motion recognition and web video categorization. The experimental results demonstrate that the double decomposition enhances video categorization performance in both cases.
RICA-MD: A Refined ICA Algorithm for Motion Detection

Chao Zhang,Xiaopei Wu,Jianchao Lu,Xi Zheng,Alireza Jolfaei,Quan Z. Sheng,Dongjin Yu

DOI: https://doi.org/10.1145/3416492

IF: 4.094

2021-01-01

ACM Transactions on Multimedia Computing Communications and Applications

Abstract:With the rapid development of various computing technologies, the constraints of data processing capabilities gradually disappeared, and more data can be simultaneously processed to obtain better performance compared to conventional methods. As a standard statistical analysis method that has been widely used in many fields, Independent Component Analysis (ICA) provides a new way for motion detection by extracting the foreground without precisely modeling the background. However, most existing ICA-based motion detection algorithms use only two-channel data for source separation and simply generate the observation vectors by decomposing and reconstructing the images by row, hence they cannot obtain an integrated and accurate shape of the moving objects in complex scenes. In this article, we propose a refined ICA algorithm for motion detection (RICA-MD), which fuses a larger number of channels than conventional ICA-based motion detection algorithms to provide more effective information for foreground extraction. Meanwhile, we propose four novel methods for generating observation vectors to further cover the diverse motion styles of the moving objects. These improvements enable RICA-MD to effectively deal with slowly moving objects, which are difficult to detect using conventional methods. Our quantitative evaluation in multiple scenes shows that our proposed method is able to achieve a better performance at an acceptable cost of false alarms.
An HMM-based framework for video semantic analysis

Gu Xu,Yu-Fei Ma,Hong-Jiang Zhang,Shi-Qiang Yang

DOI: https://doi.org/10.1109/TCSVT.2005.856903

IF: 5.859

2005-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Video semantic analysis is essential in video indexing and structuring. However, due to the lack of robust and generic algorithms, most of the existing works on semantic analysis are limited to specific domains. In this paper, we present a novel hidden Markove model (HMM)-based framework as a general solution to video semantic analysis. In the proposed framework, semantics in different granularities are mapped to a hierarchical model space, which is composed of detectors and connectors. In this manner, our model decomposes a complex analysis problem into simpler subproblems during the training process and automatically integrates those subproblems for recognition. The proposed framework is not only suitable for a broad range of applications, but also capable of modeling semantics in different semantic granularities. Additionally, we also present a new motion representation scheme, which is robust to different motion vector sources. The applications of the proposed framework in basketball event detection, soccer shot classification, and volleyball sequence analysis have demonstrated the effectiveness of the proposed framework on video semantic analysis.
A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis

Junfeng Jiang,Xiao-Ping Zhang

DOI: https://doi.org/10.1007/978-3-642-14932-0_17

2010-01-01

Abstract:Key frame-based video representation is a procedure to summarize video content by mapping the entire video stream to several representative video frames. However; the existing methods are either computational expensive to extract the key frames at higher levels rather than shot level or ineffective to lay out the key frames sequentially. To overcome the shortcomings, we present a new hierarchical key frame tree-based video representation technique to model the video content hierarchically. Concretely, by projecting video frames from illumination-invariant raw feature space into low dimensional independent component; analysis (ICA) subspace, each video frame is represented by a two-dimensional compact feature vector. A new kD-tree-based method is then employed to extract the key frames at shot level. A hierarchical agglomerative clustering-based method is applied to process the key frames hierarchically. Experimental results show that the proposed method is computationally efficient to model the semantic video content hierarchically.
New Applications For Object Recognition And Affine Motion Estimation By Independent Component Analysis

Lm Zhang,Xm Huang

DOI: https://doi.org/10.1007/978-3-540-28651-6_88

2004-01-01

Abstract:This paper proposes a new scheme based on independent component analysis(ICA) for object recognition with affine transformation and for affine motion estimation between video frames. For different skewed shapes of recognized object, an invariant descriptor can be extracted by ICA, and it can solve some skewed object recognition problems. This method also can be used to estimate the affine motion between two frames, which is important in high compression rate coding such as MPEG4 or MPEG7 standard. Simulation results show that the proposed method has a better performance than other traditional methods in pattern recognition and affine motion estimation.
Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Xin Wei,Chunguang Li

DOI: https://doi.org/10.1016/j.sigpro.2013.04.007

IF: 4.729

2013-01-01

Signal Processing

Abstract:Recently, a representative approach, named mixtures of common factor analyzers (MCFA), was proposed for clustering high-dimensional observed data. Existing model-parameter estimation methods for this approach is based on the maximum likelihood criterion and performed by the expectation-maximization algorithm. In this paper, we consider the MCFA from a Bayesian perspective and propose the Bayesian mixtures of common factor analyzers (BMCFA) model, which replaces the deterministic model parameters in the MCFA by stochastic variables. Then we present a variational inference algorithm for this BMCFA model. Moreover, the proposed BMCFA model and the associated variational inference algorithm are used for clustering the high-dimensional synthetic data, the wine data from the UCI machine learning repository and the gene expression data. Experimental results illustrate that the BMCFA has good generalization capacities, automatically determining the appropriate number of clusters from high-dimensional observed data.
Gaussian Mixture Vector Quantization-Based Video Summarization Using Independent Component Analysis

Junfeng Jiang,Xiao-Ping (Steven) Zhang

DOI: https://doi.org/10.1109/mmsp.2010.5662062

2010-01-01

Abstract:In this paper, we propose a new Gaussian mixture vector quantization (GMVQ)-based method to summarize the video content. In particular, in order to explore the semantic characteristics of video data, we present a new feature extraction method using independent component analysis (ICA) and color histogram difference to build a compact 3D feature space first. A new GMVQ method is then developed to find the optimized quantization codebook. The optimal codebook size is determined by Bayes information criterion (BIC). The video frames that are the nearest-neighbours to the quanta in the GMVQ quantization codebook are sampled to summarize the video content. A kD-tree-based nearest-neighbour search strategy is employed to accelerate the search procedure. Experimental results show that our method is computationally efficient and practically effective to build a content-based video summarization system.
AN HMM BASED ANALYSIS FRAMEWORK FOR SEMANTIC VIDEO EVENTS

You Junyong,Liu Guizhong,Zhang Yaxin

DOI: https://doi.org/10.1007/s11767-006-0117-2

2007-01-01

Abstract:Semantic video analysis plays an important role in the field of machine intelligence and pattern recognition. In this paper, based on the Hidden Markov Model （HMM）, a semantic recognition framework on compressed videos is proposed to analyze the video events according to six low-level features. After the detailed analysis of video events, the pattern of global motion and five features in foreground—the principal parts of videos, are employed as the observations of the Hidden Markov Model to classify events in videos. The applications of the proposed framework in some video event detections demonstrate the promising success of the proposed framework on semantic video analysis.
A new scheme for extraction of affine invariant descriptor and affine motion estimation based on independent component analysis

Xuming Huang,Bin Wang,Liming Zhang

DOI: https://doi.org/10.1016/j.patrec.2004.11.006

IF: 4.757

2005-01-01

Pattern Recognition Letters

Abstract:This paper proposes a new scheme based on independent component analysis (ICA) for object recognition with affine transformation and for affine motion estimation between video frames. For different affine shapes of a recognized object, an invariant descriptor can be extracted by ICA, and it can solve some object recognition problems. This method also can be used to estimate the affine motion between two frames, which is important in high compression rate coding such as MPEG4 or MPEG7 standard. Simulation results show that the proposed method has a better performance than other traditional methods in pattern recognition and affine motion estimation.

An ICA Mixture Hidden Markov Model for Video Content Analysis

An ICA Mixture Hidden Markov Model for Video Content Analysis

Video Event Detection using ICA Mixture Hidden Markov Models

Hidden Markov Model Framework Using Independent Component Analysis Mixture Model

Ice Hockey Shooting Event Modeling with Mixture Hidden Markov Model

ICA Mixture Hidden Conditional Random Field Model for Sports Event Classification

Mrf-Ica Mixture Model for Hyperspectral Imagery Unmixing

A novel vector quantization-based video summarization method using independent component analysis mixture model

Spatial-based Bayesian Hidden Markov Models with Dirichlet Mixtures for Video Anomaly Detection

Video Shot Boundary Detection Using Independent Component Analysis

An MRF-ICA based algorithm for image separation

Video Content Categorization Using the Double Decomposition

RICA-MD: A Refined ICA Algorithm for Motion Detection

An HMM-based framework for video semantic analysis

A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis

New Applications For Object Recognition And Affine Motion Estimation By Independent Component Analysis

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Gaussian Mixture Vector Quantization-Based Video Summarization Using Independent Component Analysis

AN HMM BASED ANALYSIS FRAMEWORK FOR SEMANTIC VIDEO EVENTS

A new scheme for extraction of affine invariant descriptor and affine motion estimation based on independent component analysis