Fast Segmentation for Head-shoulder Video Sequence

Zhaoyang Zhang

2005-01-01

Abstract:Comparing the difference of head-shoulder video sequence segmentation,a new method,based on the maximal gradient region edge clustering,is proposed.Experimental results obtained on some typical MPEG-4 sequences are shown,in order to illustrate the segmentation algorithm performance.

What problem does this paper attempt to address?

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Wen-ming YANG,Qing-min LIAO,Ji-lin Liu

DOI: https://doi.org/10.3969/j.issn.1007-0249.2008.03.021

2008-01-01

Abstract:Automatic segmentation of moving objects in video sequences is a significant technology for implementing emerging object-based video coding standard MPEG-4. A novel algorithm for automatic segmentation of moving objects based on intra-frame image partition is proposed. At first, a binary moving mask image is achieved by gaussianity test based on temporal motion information. Subsequently, the further test is performed by establishing MRF model. Then, an improved watershed algorithm based on nonlinear transform is employed to partition intra-frame image aiming to establish borderlines between objects and background. Finally, moving objects are extracted by performing ratio operation on results of temporal segmentation and intra-frame image partition. Experimental results including of MPEG-4 standard tesing sequences and own-captured finger sequence show that the proposed algorithm is efficient.
Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

Li Mei,Xie Lei,Gao Zhiyong,Liu Haihua

DOI: https://doi.org/10.3969/j.issn.1672-4321.2007.03.016

2007-01-01

Abstract:In the paper,moving object segmentation algorithm based on mean field theory (MFT) using maximum a posteriori estimation of Markov random field (MRF-MAP) is proposed.This algorithm begins with a simply foreground image derived from the difference between two frames,Computing the energy function of Markov random field (MRF) is constructed by applying the MFT.The MRF-MAP which is minimum energy function,is adopted to obtain the label field and extract the moving object.Experimental results are provided using MPEG-4 test sequences.The results show that the new method detects changes accurately and is robust to noise.
A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Ke Xiang,Xuanyin Wang,Songxiao Cao,Xiaojie Fu

DOI: https://doi.org/10.1109/eeesym.2012.6258630

2012-01-01

Abstract:Concerning traditional motion segmenting algorithms, such as TD and GMM, can not meet the actual requirement that not only be robust stability to minor disturbance but also response rapidly while facing abrupt background changes, we propose a novel method named IDGMM to solve this problem by modeling the Inter-frame Differencing image with Gaussian Mixture Models. By taking both the long-term statistical analysis and instantaneous change response into account, this method is able to gain better performances than traditional algorithms. Experimental results on standard video sequences extremely show the effectiveness and robustness of this method.
Video Stream Segmentation Method Based on Video Page

Miao-Liang ZHU,Dong-Hui WANG

DOI: https://doi.org/10.3321/j.issn:1003-9775.2000.08.006

2000-01-01

Abstract:A new method of video stream segmentation based on video page is presented. By defining Color Similarity Region, Light Change Region and Color Change Region, we can identify some corresponding area of two frames where the visual content has been changed, more over we can further determine the similarity of visual contents of two frames. According to the calculating result of similarity metric, we can segment a video stream into video pages. The experiment results show that this method can tolerate wider light change range and can work properly on higher SNR level. Compared with known approaches, this method improves video stream segmentation veracity evidently.
Semantic Video Segmentation Based on Region Boundary Motion Information

YANG Wen-ming,LIU Ji-lin

DOI: https://doi.org/10.3785/j.issn.1008-973x.2008.02.034

2008-01-01

Abstract:In order to implement automatic extraction of the semantic object in video coding standard MPEG-4,a video segmentation algorithm was developed based on the region boundary motion information.By using double opening and closing reconstruction to obtain morphological gradient image in spatial domain,the noise in the original image was restrained.Nonlinear processing integrating threshold transform and scale grades classification was performed to overcome the influence of close texture.Then an improved watershed immersing algorithm was proposed to attain regions and boundaries.Region motion was ascertained according to the region boundary motion information.By using spatio-temporal information to establish region projection operation,final semantic moving object was extracted from video sequences. Simulation shows that the moving objects extracted by the proposed algorithm are complete and exact.
A Segmentation Scheme for Head-Shoulder Video in MPEG Compressed Domain

Liu Long,Han Chongzhao,Wang Zhanhui,Bai Yan

DOI: https://doi.org/10.1007/s11767-004-0109-z

2006-01-01

Journal of Electronics (China)

Abstract:More attention has been paid to the study of video object segmentation in compressed domain these years, which has already led to some practical technology. In this paper, a scheme is put forward for segmentation of head-shoulder video in MPEG (Motion Picture Experts Group) compressed domain. The conception of DCT (Discrete Cosine Transform) feature plane is defined. In the suggested scheme, firstly, the face region is detected by clustering skin-tone DCT feature points in the DCT feature plane. Secondly, the region of head-shoulder is approximately regarded as combination of the head rectangle and shoulder rectangle, and head rectangle is confirmed by double template matching. Thirdly, Canny operator and morphological operation are applied to the region of head-shoulder in feature plane to get the object mask and the region of object mask is rectified by correlation of DCT blocks to get high-quality segmentation.
An Adaptive Frame Skipping and Vop Interpolation Algorithm for Video Object Segmentation

GB Yang,ZY Zhang

IF: 1.019

2004-01-01

Chinese Journal of Electronics

Abstract:Video object segmentation is a key step for the successful use of MPEG-4. However, most of the current available segmentation algorithms are still far away from real-time performance. In order to improve the processing speed, an adaptive frame skipping and VOP interpolation algorithm is proposed in this paper. It adaptively determines the number of skipped frames based on the rigidity and motion complexity of video object. To interpolate the VOPs for skipped frames, a bi-directional projection scheme is adopted. Its principle is to perform a classification of those regions obtained by spatial segmentation for every frame in the sequence. It is valid for both rigid object and non-rigid object and can get good localization of object boundaries. Experimental results show that the proposed approach can improve the processing speed greatly while maintaining visually pleasant results.
Efficient video object segmentation based on Gaussian mixture model and Markov random field

Zhi Liu,Jiandong Gu,Li Quan Shen,Zhaoyang Zhang

DOI: https://doi.org/10.1109/ICOSP.2008.4697298

2008-01-01

Abstract:This paper proposes an efficient video object segmentation approach based on Gaussian mixture model (GMM) and Markov random field (MRF). The user-interested video objects are interactively extracted in the first frame of the video sequence, and each video object and the remaining background are represented by individual GMM, which is initialized based on the region segmentation result used for interactive object extraction. For each following frame, two GMM classification results are respectively generated based on only color feature, and both color feature and position feature, which is compensated by the estimated average position change to adapt to fast moving regions. Based on the initial pixel classification result generated from the two GMM classification results and the corresponding confidence measures, the pixel classification result is refined to obtain a reliable video object segmentation result under the MRF framework. Experimental results on several MPEG-4 test sequences demonstrate the good segmentation performance of the proposed approach.
Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Yu Lu,Zhaoyang Zhang,Zhi Liu,Xuli Shi

DOI: https://doi.org/10.1109/icct.2008.4716180

2008-01-01

Abstract:This paper proposed a novel approach to segment objects from the H.264 compressed video with moving background. At first, the noisy motion vectors are eliminated from the motion field by vector median filtering. Then the predicted motion field reconstructed by backward estimation is used to accumulate the motion field, which is followed by global motion compensation. After that, the hypothesis testing is used for initial region classification. Finally, the graph cuts technique is applied to partition objects by minimizing the energy function formulated by the model of Markov Random Field. The experimental results demonstrate efficient performance and good segmentation quality of the proposed method.
Visual Attention Based Video Object Segmentation in MPEG Compressed Domain

Zuowu Ning,Zhaoyang Zhang,Zhi Liu

DOI: https://doi.org/10.1049/cp:20070210

2007-01-01

Abstract:A novel approach of visual attention based video object segmentation in MPEG compressed domain is proposed in this paper. DCT coefficients and motion vectors (MVs) are firstly parsed from compressed streams. Analysis of the scene texture is then proposed to decide the best appropriate information for region growing. MVs are exploited to perform region growing if texture is complex, otherwise DC coefficients and MVs are used together to perform region growing. Meanwhile, MVs of I frames are calculated by backward projection of MVs of subsequent P frames, then global motion compensation is performed using the MVs of I frames to obtain local MVs. Subsequently statistical region growing is exploited to segment the image into homogeneous regions. Finally an improved attention model is proposed to extract visual attention objects, which is based on position, clearness and local MVs. The attention model makes the segmentation results more accordant with human's perception. The experimental results conducted on standard test sequences demonstrate the efficient, real-time, robust performance of the proposed approach.
An object segmentation method for the color slow-motion videos based on adjacent frames gradual change

Bin Liu,Haojie Li,Xianyong Jia,Hui Zhang,Rui Huang,Zhaoliang Liu,Xu Zhao

DOI: https://doi.org/10.1007/s11042-014-1981-7

IF: 2.577

2014-05-16

Multimedia Tools and Applications

Abstract:Along with the high-speed cameras are more and more widely applied, how to automatically segment the region of interest in the slow-motion video is a new issue. In this paper, a color slow-motion video segmentation method is proposed. The main strategy is based on region growing and pixel color difference. A rapid color similarity computing method is improved and applied for classifying different pixels. An algorithm based on four directions corrosion is proposed to automatically extract the seed points for the serialized video frames. Utilizing this method, the color frames of the slow-motion videos can be segmented in series automatically. Also, the multithreading mode of parallel computing is introduced in the entire segmentation process. This method is not complicated but automatic. The regions of interest in the slow-motion video frames can be segmented clearly. This novel method can provide support to the video related applications.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Efficient motion segmentation for H.264 compressed video

Yu Lu,Zhaoyang Zhang,Zhi Liu,Jianfeng Xu

DOI: https://doi.org/10.1117/12.749985

2007-01-01

Abstract:The H.264 standard is a new state-of-the-art video coding standard with extensive applications. This paper presents a simple and efficient approach for motion segmentation in H.264 compressed video. Several preprocessing steps are used before actual motion segmentation. The raw motion vector (MV) field extracted from H.264 video is first spatially normalized and then accumulated by the forward projection scheme to obtain the dense MV field. The following global motion compensation is performed on the accumulated MV field to acquire the residual MV field. Based on the residual MV field, a hybrid scheme including edge detection and region growing for motion segmentation is proposed. The edge map is used as a mask to guide region growing, which is created by Canny operator based on the magnitude map of residual MV field. At last, hypothesis testing as the major postprocessing technique is exploited to distinguish between the background and different moving objects. Experiment results demonstrate that the high-efficiency performance and good segmentation quality of the proposed approach.
Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

Zhi Liu,Yu Lu,Zhaoyang Zhang

DOI: https://doi.org/10.1016/j.jvcir.2007.02.002

IF: 2.887

2007-01-01

Journal of Visual Communication and Image Representation

Abstract:This paper presents a real-time spatiotemporal segmentation approach to extract video objects in the H.264 compressed domain. The only exploited segmentation cue is the motion vector (MV) field extracted from the H.264 compressed video. MV field is first temporally and spatially normalized and then accumulated by an iteratively backward projection scheme to enhance the salient motion. Then global motion compensation is performed on the accumulated MV field, which is also moderately segmented into different motion-homogenous regions by a modified statistical region growing algorithm. The hypothesis testing using the block residuals of global motion compensation is employed for intra-frame classification of segmented regions, and the projection is exploited for inter-frame tracking of previous video objects. Using the above results of intra-frame classification and inter-frame tracking as input, a correspondence matrix based spatiotemporal segmentation approach is proposed to segment video objects under different situations including appearing and disappearing objects, splitting and merging objects, stopping moving objects, multiple object tracking and scene change in a unified and efficient way. Experimental results for several H.264 compressed video sequences demonstrate the real-time performance and good segmentation quality of the proposed approach.
VIDEO OBJECT SEGMENTATION BASED ON ACCUMULATIVE FRAME DIFFERENCE Author ( s ) :

Bing Leng,Qionghai Dai

2007-01-01

Abstract:This paper addresses the problem of extracting video objects from head−shoulder video sequences. A method based on accumulative frame difference is proposed. First, a preliminary motion analysis is performed to each block of the frame and the blocks with fast moving edges are detected. Then, for each block, we accumulate frame difference with a different amount of frames, based on its motion attributes. After thresholding and post processing, the objects are obtained. Experimental results demonstrate that the proposed method can eliminate the expanded changed region and thus achieves a significantly improved segmentation result.
Automatic Segmentation of Moving Objects in Video Sequences Using Multifeature

王蕾,张旭东

DOI: https://doi.org/10.3969/j.issn.1006-8961.2003.11.021

2003-01-01

Abstract:The video coding standard MPEG-4 enables content-based functionality for various applications. To support this functionality and improve coding efficiency, MPEG-4 decomposes each frame of a video sequence into video object planes (VOPs). The technique is also used in content-based video retrieval and video monitoring system to improve intelligence degree; and its applications are extended to pattern recognition, computer vision et al. Thus, segmentation and tracking of video moving objects become a key related research topic. A novel algorithm for automatic segmentation and tracking of moving objects is proposed in this paper. On the base of different image, we utilize a method of combining Canny edge detection and fourth-orders statistic hypothesis testing in improving the moving areas separation results. Then we use region growing with color information in the moving areas to achieve precise boundary of moving objects; and make use of the last segmentation result, extract edge and color information of moving objects, apply edge model matching and color model matching approach to track the changes of moving objects, and detect temporarily still parts. The experimental results for several video sequences demonstrate that our approach is effective in precise segmentation and detect the temporarily still parts of the video moving objects.
A novel video abstraction method based on fast clustering of the regions of interest in key frames

guanghua song,qingge ji,zheming lu,zhidan fang,zhenhua xie

DOI: https://doi.org/10.1016/j.aeue.2014.03.004

IF: 3.169

2014-01-01

AEU - International Journal of Electronics and Communications

Abstract:Online video nowadays has become one of the top activities for users and has become easy to access. In the meantime, how to manage such huge amount of video data and retrieve them efficiently has become a big issue. In this article, we propose a novel method for video abstraction based on fast clustering of the regions of interest (ROIs). Firstly, the key-frames in each shot are extracted using the average histogram algorithm. Secondly, the saliency and edge maps are generated from each key-frame. According to these two maps, the key points for the visual attention model can be determined. Meanwhile, in order to expand the regions surrounding the key points, several thresholds are calculated from the corresponding key-frame. Thirdly, based on the key points and thresholds, several regions of interest are expanded and thus the main content in each frame is obtained. Finally, the fast clustering method is performed on the key frames by utilizing their ROIs. The performance and effectiveness of the proposed video abstraction algorithm is demonstrated by several experimental results.
Object segmentation based on disparity estimation

Qian Zhang,Suxing Liu,Ping An,Zhaoyang Zhang

DOI: https://doi.org/10.1145/1543834.1544006

2009-01-01

Abstract:Object segmentation plays an important role in multi-view video analysis. In this paper, we present a new object segmentation method for multi-view video in which only the disparity is used for segmentation and the motion estimation is neglected. Firstly, a modified locally adaptive support-weight approach is proposed for disparity estimation. Then, segmentation is realized by mean-shift algorithm. The experimental results show that proposed method could segment the semantically meaningful objects from complex background with high precision.
Video Segmentation Using Multiple Features Based on EM Algorithm

张风超,杨杰,刘尔琦

IF: 1.363

2004-01-01

Journal of Systems Engineering and Electronics

Abstract:Object-based video segmentation is an important issue for many multimedia applications. A video segmentation method based on EM algorithm is proposed. We consider video segmentation as an unsupervised classification problem and apply EM algorithm to obtain the maximum-likelihood estimation of the Gaussian model parameters for model-based segmentation. We simultaneously combine multiple features (motion, color) within a maximum likelihood framework to obtain accurate segment results. We also use the temporal consistency among video frames to improve the speed of EM algorithm. Experimental results on typical MPEG-4 sequences and real scene sequences show that our method has an attractive accuracy and robustness.
A fast region-based image segmentation based on least square method

Gang Chen,Tai Hu,Xiaoyong Guo,Xin Meng

DOI: https://doi.org/10.1109/ICSMC.2009.5346073

2009-01-01

Abstract:Image segmentation is always very important for computer vision and pattern recognition. Moreover, how to fast extract objects from a given image is still a problem for real time image processing. Most of the traditional region-based models depend on global information to converge to minimum error segmentation, but they are always time-consuming, and result in no effective segmentation. In this paper, we propose a region-based model with weight matrix to detect objects fast based on least square method. The basic ideal of our model is to build up a minimum error functional by approximating objects and background of original image with two constants respectively. At the same time, we introduce a weight matrix into the region-based model, which can enhance the weight of objects while reducing the influence from background. Our method can fast converge through alternating iterations under least square method. We also compare it with other region-based methods to show the improvements that can be achieved. Experimental results show the advantages of our method in terms of efficiency in image segmentation without losing accuracy.
An Efficient Compressed Domain Moving Object Segmentation Algorithm Based on Motion Vector Field

Zhi Liu,Li-quan Shen,Zhao-yang Zhang

DOI: https://doi.org/10.1007/s11741-008-0307-2

2008-01-01

Abstract:In this paper an efficient compressed domain moving object segmentation algorithm is proposed, in which the motion vector (MV) field parsed from the compressed video is the only cue used for moving object segmentation. First the MV field is temporally and spatially normalized, and then accumulated by an iterative backward projection to enhance salient motions and alleviate noisy MVs. The accumulated MV field is then segmented into motion-homogenous regions using a modified statistical region growing approach. Finally, moving object regions are extracted in turn based on minimization of the joint prediction error using the estimated motion models of two region sets containing the candidate object region and other remaining regions, respectively. Experimental results on several H.264 compressed video sequences demonstrate good segmentation performance.

Fast Segmentation for Head-shoulder Video Sequence

An algorithm for automatic segmentation of video objects based on intra-frame image partition

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Video Stream Segmentation Method Based on Video Page

Semantic Video Segmentation Based on Region Boundary Motion Information

A Segmentation Scheme for Head-Shoulder Video in MPEG Compressed Domain

An Adaptive Frame Skipping and Vop Interpolation Algorithm for Video Object Segmentation

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Object Segmentation Using Graph Cuts for the H.264 Compressed Video with Moving Background

Visual Attention Based Video Object Segmentation in MPEG Compressed Domain

An object segmentation method for the color slow-motion videos based on adjacent frames gradual change

Efficient motion segmentation for H.264 compressed video

Real-time spatiotemporal segmentation of video objects in the H.264 compressed domain

VIDEO OBJECT SEGMENTATION BASED ON ACCUMULATIVE FRAME DIFFERENCE Author ( s ) :

Automatic Segmentation of Moving Objects in Video Sequences Using Multifeature

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Object segmentation based on disparity estimation

Video Segmentation Using Multiple Features Based on EM Algorithm

A fast region-based image segmentation based on least square method

An Efficient Compressed Domain Moving Object Segmentation Algorithm Based on Motion Vector Field