Upper Body Human Detection and Segmentation in Low Contrast Video

TongRuofeng,XieDi,TangMin

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In the application of extracting human regions from videos, many existing methods may lose their efficacy when illumination varies or the human remains still. To address this problem, we propose a ...

What problem does this paper attempt to address?

Upper Body Human Detection and Segmentation in Low Contrast Video

Ruofeng Tong,Di Xie,Min Tang

DOI: https://doi.org/10.1109/tcsvt.2013.2248285

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In the application of extracting human regions from videos, many existing methods may lose their efficacy when illumination varies or the human remains still. To address this problem, we propose a method in this paper for human region detection and segmentation by constructing a generalized human upper body model. The method mainly consists of two main procedures. First, foreground connected regions are extracted by background subtraction from the current frame and classified through a human upper body model pretrained with a support vector machine to determine whether they are human regions. Second, we assign an energy function to the region contour and apply an energy minimization procedure to evolve the contour when human regions are polluted by background; for example, a change in lighting conditions. After finding the optimal contour, we update the background and repeat the procedures in next frame. This feedback strategy rectifies the mistaken background regions promptly and extracts human regions correctly. Our experimental results demonstrate that the proposed method is robust enough to handle videos of low contrast as well as normal conditions.
Human Body Parsing in Thermal InfraRed Domain

Zeyu Wang,Kai Shen,Dong Wang,Haibin Shen,Kejie Huang

DOI: https://doi.org/10.1109/tce.2024.3438809

2024-01-01

IEEE Transactions on Consumer Electronics

Abstract:Thermal InfraRed (TIR) technology has achieved significant progress, in light of its ability to reflect lighting conditions in dark environments, enhancing its vital role in industrial and consumer electronics. However, current research on TIR image semantic segmentation mainly focuses on urban scenes, while the segmentation of human bodies in the TIR domain remains an under-explored area, which holds considerable promise for applications such as low-light security checks, nocturnal combat scenarios, and human action recognition. In this paper, we introduce a novel computer-vision task—Thermal InfraRed Human Body Parsing, which aims to generate accurate segmentation maps for different parts of human bodies in TIR images. To open up future research in this area, we collect a new dataset called HBTIR, which contains TIR images and corresponding semantic labels of 32 participants in various poses. Furthermore, we propose a novel neural network called HBTIR-Seg, which incorporates an edge-guided attention mechanism specifically tailored for TIR human body imagery. Extensive experiments demonstrate that our method greatly outperforms existing segmentation methods on the HBTIR dataset.
Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

XIANG Gui-shan,WANG Xuan-yin,LIANG Dong-tai

DOI: https://doi.org/10.3969/j.issn.1003-501x.2007.04.010

2007-01-01

Abstract:For fast detecting and tracking human face in real-time video, a method based on the color and character of face was proposed. Moving human-body objects were extracted from video according to temporal differencing and shape information firstly, and then the skin area was segmented based on its Gaussian model established due to the clustering character of skin color in YCbCr color space. After noise was suppressed, the non-face skin area was eliminated according to the geometric characters of face and the color characters of organs in face, and then the face was located in image. According to the face location, the head and shoulder part were centered in video by driving camera using control strategy, so movement tracking was realized. In order to enhance the adaptability for light changes, proper updating strategy for the Gaussion model parameters was proposed. Experiments show that the proposed method performs well in face detection and tracking in both simple background and complex background.
Video Based Head Detection and Tracking Surveillance System

Di Xie,Lu Dang,Ruofeng Tong

DOI: https://doi.org/10.1109/fskd.2012.6234136

2012-01-01

Abstract:In this paper, we present a novel system that acquires clear human face or head in video stream from a single surveillance camera and applies several state-of-the-art computer vision algorithms to generate real-time human head detection and tracking results. The detection results are obtained using histogram of gradients (HoG) feature powered by GPU and the false positives are filtered out by motion and appearance likelihoods. Then all the true positives are tracked by a track algorithm based on earth mover's distance (EMD) and SURF points. Our experiment results show that the proposed system makes it possible to accomplish robust detection and tracking performance in most surveillance scenes.
Human face detection under weak light based on depth information

Guang-jun LIAO,Zhi-fu LI,yu LIU,Yue-ming HU

DOI: https://doi.org/10.13195/j.kzyjc.2013.0815

2014-01-01

Abstract:In order to solve the problem of human face detection under weak light, a quick locating method based on the depth information by Kinect device is proposed. Firstly, 2D Chamfer Match method is used to rapidly preliminary locate the human face, and region-growing algorithm is applied on the preliminary locating face. Then, combined with extended Harr features, the AdaBoost algorithm is used to train the strong classifier under weak light, which realizes the precise face detection. The experiments show that rationally utilizing the depth information to detect the human face under the normal light can reduce the scope of the search window, which accelerates the detection speed, and the proposed method has strong robustness and timeliness.
Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

潘锋,王宣银,王全强

DOI: https://doi.org/10.3785/j.issn.1008-973x.2004.04.003

2004-01-01

Abstract:Aimed at the shortcomings of the traditional visual surveillance system, this paper proposed a series of methods to solve the difficulty in detecting human under complex background. The object was abstracted accurately by combination of edge detection of the difference image and contour tracking to bypass the object shade. Human part shape analysis solved the problem of the human image being easily occluded in practical application. Classifier based on Support Vector Machine(SVM) overcame the disadvantages of overfitting in traditional methods. Experimental results show that this method is strongly robust and highly accurate; and can detect human automatically under complex background; and provides theoretical and technological base for object detection and tracking in the intelligent surveillance system.
Human Contour Extraction Using Level Set

Lin Liu,Sanyuan Zhang,Yin Zhang,Xiuzi Ye

DOI: https://doi.org/10.1109/CIT.2005.127

2005-01-01

Abstract:Human contour information is important for human activity understanding and human motion capture. Traditional human contour extraction methods are based on image morphological operation, but they will fail when the contour information is dim and discontinuous. In this paper, a novel method using level set technique for human contour extraction in video frames with still background is proposed. Firstly the human profile is detected via image difference with background. After appropriate thresholding and morphological operation, the possible human profile region is then found out according to the image projection using the detected region boundary as the initial evolving curve, the accurate human contour is extracted using a modified level set method, experiments show that this method is faster and more efficient than traditional level set methods.
Random Walks Colour Histogram Modification for Human Tracking.

Houqiang Zhao,Ke Xiang,Songxiao Cao,Xuanyin Wang

DOI: https://doi.org/10.1049/iet-cvi.2015.0371

IF: 1.484

2016-01-01

IET Computer Vision

Abstract:Accurate human tracking in surveillance scenes is one of the preliminary requirements for other tasks. However, when the human target is small, the extracted features may not be prominent and thus the tracking performance is unsatisfactory. The colour feature is relatively robust to the change of target size and shape, but it is prone to be affected by the background information. For the above reasons, the authors introduce random walker segmentation into human tracking and determine the background region according to the distribution characteristics of segmentation results. Even if the colour of the target is very similar to that of the background, this algorithm can segment the target. Furthermore, the principal component analysis method is used to distinguish human targets from the background as well. During tracking, the authors prevent the degradation of the target model by adding new target information. In order to overcome the mean‐shift local optimisation problem, the authors search for the candidate target region with the largest weight according to the sum of all probability in each region. Experimental results further show that the authors’ tracking algorithm demonstrates better performance on tracking small human target under some challenging scenes compared with several existing tracking methods.
An Intelligent Surveillance System Base on Accelerated Human and Face Detection

song xiaofeng,xie di,chen deren,zhang weize,tong ruofeng

DOI: https://doi.org/10.1007/978-3-642-03718-4_84

2012-01-01

Abstract:In this paper, we propose a system to acquire high resolution face image of a human in surveillance scene. Firstly, the system detects a full or partially occluded human body in the scene and zooms in to it automatically. And then a face detection and zooming process is running. Finally, a high resolution face image is captured and saved. The system can run real-time as the algorithms are accelerated by multi-core CPU and CPU. Experiments show that the system can capture most high resolution face image of human in the scene and can be implemented in the real surveillance systems. Our system provides an alternative method with better result to acquire high resolution face image comparing to face super-resolution methods.
Robust Human Tracking Via Key Face Information.

Weisheng Li,Xinyi Li,Lifang Zhou

DOI: https://doi.org/10.3837/tiis.2016.10.026

2016-01-01

KSII Transactions on Internet and Information Systems

Abstract:Tracking human body is an important problem in computer vision field. Tracking failures caused by occlusion can lead to wrong rectification of the target position. In this paper, a robust human tracking algorithm is proposed to address the problem of occlusion, rotation and improve the tracking accuracy. It is based on Tracking-Learning-Detection framework. The key auxiliary information is used in the framework which motivated by the fact that a tracking target is usually embedded in the context that provides useful information. First, face localization method is utilized to find key face location information. Second, the relative position relationship is established between the auxiliary information and the target location. With the relevant model, the key face information will get the current target position when a target has disappeared. Thus, the target can be stably tracked even when it is partially or fully occluded. Experiments are conducted in various challenging videos. In conjunction with online update, the results demonstrate that the proposed method outperforms the traditional TLD algorithm, and it has a relatively better tracking performance than other state-of-the-art methods.
Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Su-rong YAN,De-ren CHEN

DOI: https://doi.org/10.3969/j.issn.1001-3695.2009.09.094

2009-01-01

Abstract:This paper proposed a novel scheme for automatic video objects detection and segmentation by fully exploiting both inter-frame temporal information and intra-frame spatial information from video stream.In the proposed method,detected the initial motion regions by using a time-weighted temporal window,and segmented many approximately homogenous color-texture regions by improved watershed and spatial similarity criterion,built further merging results of temporal and spatial segment available on majority rule,refining them was based on spatial coherency and temporal continuity eventually.The outputs show that the proposed scheme is robust and gets fine boundary of objects.Furthermore,it is adaptable to high-speed and low-speed objects in indoor and outdoor scene by training and adjusting few parameters.
Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Yi Li,Xun Liu,Sanyuan Zhang,Xiuzi Ye

DOI: https://doi.org/10.1016/j.neucom.2015.07.123

IF: 6

2016-01-01

Neurocomputing

Abstract:Building recognition is a crucial and still challenging problem in computer vision and pattern recognition field, especially in human articulate body recognition. In this paper, we present a novel formulation for detecting articulated human bodies from high-resolution monitoring images. Firstly, we use a coarse detection process to detect the human object patches from monitoring images. To build a descriptor which contain color frequency information based on histograms of oriented gradient method. Then, a linear support vector machine was used to speed up detecting large image patches which contain the object joints. Secondly, towards an efficient detection, a refinement classification method is proposed to determine the patches that actually contain objects. Finally, to increase the size of image patches in order that the whole human objects can be included, an accelerated and improved salient mask is used to improve the performance of the dense scale-invariant feature transform descriptor. Experimental results on three datasets demonstrated our method effectiveness.
Human Segmentation Based on Disparity Map and GrabCut

Dongge Gu,Yong Zhao,Yule Yuan,Gang Hu

DOI: https://doi.org/10.1109/cvrs.2012.6421235

2012-01-01

Abstract:Human segmentation plays an important role in vision analysis due to its importance for applications such as 3D pose estimation, human behavior analysis, body parameter estimation and image compositing. In this paper, we present a new human segmentation method that can segment human from the complex background environment without using background subtraction like algorithms and motion estimation algorithms. Initially, semi-global stereo matching algorithm was used to get the coarse disparity map. Then GrabCut was used on the disparity space image to get the human's coarse silhouette. After some erosion morphology operations, the silhouette obtained from the disparity space image was used as the input marks for the GrabCut, which was used on the color image to get accurate human segmentation. Results show that the proposed method can have a good performance.
Robust Human Detection with Super-Pixel Segmentation and Random Ferns Classification Using RGB-D Camera

Luchao Tian,Mingchen Li,Guyue Zhang,Jingwen Zhao,Yan Qiu Chen

DOI: https://doi.org/10.1109/icme.2017.8019303

2017-01-01

Abstract:Efficient and robust detection of humans has received great attention during the past few decades. This paper presents a two-staged approach for human detection in RGB-D images. As the traditional sliding window-based methods for target localization are often time-consuming, we propose to use the super-pixel method in depth data to efficiently locate the plausible head-top locations in the first stage. In the second stage, we propose to use Random Ferns to seek the features by combining information from different image spaces, which can select the most discriminative features and compute simple and fast Local Binary Features (LBFs) allowing for real-time applications. We evaluate our method on three publicly available challenging datasets taken by a Kinect camera. Experimental results demonstrate that the proposed approach can robustly detect humans in complicated environments.
RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

Jun Wu,Cailiang Kuang,Kai Zeng,Wenjing Qiao,Fan Zhang,Xiaobo Zhang,Zhisheng Xu

DOI: https://doi.org/10.1007/978-3-319-48896-7_70

2016-01-01

Abstract:Human action recognition is an important topic and it has been widely applied in human-computer interaction. This work aims at human pose recognition based on RGB-D camera data streams for patients in a supine position (for example, with limb movement disorders), where bed backgrounds are misinterpreted as part of the human body. The target human limb poses include both upper and lower limbs’ movements. A novel framework for human limb movement recognition in a supine position is investigated and developed. The main steps include human region locating, limb detection and segmentation, limb labeling and limb movement tracking. Based on the tracking information on human bones by the RGB-D camera, human body region detection is executed according to the depth information. Further, this system is able to solve the problem of the human limb label confusions for left and right limbs due to their occlusion cases. Our proposed tracking algorithm achieves accurate positioning of the human body, and it provides reliable mid-level data for tracking human limbs. Experiment results show that four human limbs in supine positions are able to be located successfully. It is valuable and promising in the field of medical rehabilitation.
Person Re-identification Based on Body Segmentation.

Hua Jiang,Liang Zhang

DOI: https://doi.org/10.1007/978-981-10-7302-1_39

2017-01-01

Abstract:Person re-identification is a difficult problem to solve in the process of video analysis of non-overlapping multi-camera surveillance system. A new algorithm of person re-identification is proposed in the base of the human segmentation parts in this article. First, the human body segmentation is achieved based on the depth of bone points. Second, the optimal key frame is selected by using the scoring strategy for all parts of the same human multi-frame images segmentation. Different weights for the global color feature and the HOG feature is assigned. Third, all the characteristics are combined to establish a human target model, and EMD (Earth Movers Distance) distance is used to determine the similarity between the targets. The Kinect REID and BIWI RGBD-ID databases are used in the experiments. The results show that the proposed method has stronger robustness and a higher recognition rate.
Real-Time Human Segmentation Using Pose Skeleton Map

Xi Chen,Ziqiang Zhou,Ying Ying,Donglian Qi

DOI: https://doi.org/10.23919/ChiCC.2019.8865151

2019-01-01

Abstract:In this paper, an algorithm for real-time human segmentation is proposed. This algorithm uses connection relations of human joints provided by pose estimation as prior knowledge which brings striking enhancement for the accuracy of human segmentation. High-quality segmentation results can be produced with real-time speed dealing with large range of human pose under complicated scenes.
Fast Human Detection in RGB-D Images Based on Color-Depth Joint Feature Learning.

Zhan Hu,Haizhou Ai,Haibing Ren,Yimin Zhang

DOI: https://doi.org/10.1109/icip.2016.7532360

2016-01-01

Abstract:Human detection in RGB-D images is an important yet very challenging task in computer vision. In this paper, we propose a novel human detection approach in RGB-D images, which integrates ROI (region-of-interest) generation, depth-size relationship estimation and a human detector. Our approach has the following advantages: 1) ROI generation and depth-size relationship estimation take full advantage of color and depth information to fast reject about 70% negative samples while maintaining a high recall rate; 2) the cascade-structured human detector can seamlessly concatenate features extracted from both color and depth images; and 3) our method can detect human at a speed of more than 30 fps on 640 χ 480 images on a single laptop CPU without any GPU acceleration. Experiments on challenging public datasets demonstrate the effectiveness of our method.
FAST SEGMENTATION OF HUMAN BODY COMPONENTS BASED ON FACE DETECTION AND KEY POINT RECOGNITION

Ma Xuan,Yang Ruoyu

DOI: https://doi.org/10.3969/j.issn.1000-386x.2013.01.070

2013-01-01

Abstract:Segmentation of human body components is used to detect the human bodies in static images or video frames.It separates the human body into individual regions such as the head,limbs,legs and etc.,and is an important basis in regard to the follow-up researches including the precise three-dimensional human body reconstruction and motion recognition.We present a new segmentation algorithm for human body components,which is mainly for images of human body without overlapped limbs.First,we use face detection technology to quickly locate the approximate position of the human body.Then we obtain accurate body contour by Canny edge detection.Finally we design and implement the efficient storage and retrieval method in orthogonal list format,and achieve the body components segmentation which is based on finding key points of contour.Experiments show that this method has good real-time property and accuracy.
Physical Blob Detector and Multi-Channel Color Shape Descriptor for Human Detection.

Guyue Zhang,Jun Liu,Ye Liu,Jingwen Zhao,Luchao Tian,Yan Qiu Chen

DOI: https://doi.org/10.1016/j.jvcir.2018.01.013

IF: 2.887

2018-01-01

Journal of Visual Communication and Image Representation

Abstract:Human detection is a very important research problem due to its relevance to a wide range of applications. This paper proposes a new method for human detection in RGB-D images. Based on the observation that human head often forms a distinguishable blob-like region in depth image and its physical size and height are in well-known ranges, we propose a physical blob detector to efficiently locate candidate human regions. Since color information and 3D physical structure information are both important cues for characterizing human upper body, we propose to incorporate these two sources of information and construct a novel Multi-Channel Color Shape Descriptor (MCSD) to further verify the candidate regions. The experimental results on four publicly available datasets consistently show that the proposed method can reliably detect humans in RGB-D video in real time.

Upper Body Human Detection and Segmentation in Low Contrast Video

Upper Body Human Detection and Segmentation in Low Contrast Video

Human Body Parsing in Thermal InfraRed Domain

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Video Based Head Detection and Tracking Surveillance System

Human face detection under weak light based on depth information

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

Human Contour Extraction Using Level Set

Random Walks Colour Histogram Modification for Human Tracking.

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

Robust Human Tracking Via Key Face Information.

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Human Segmentation Based on Disparity Map and GrabCut

Robust Human Detection with Super-Pixel Segmentation and Random Ferns Classification Using RGB-D Camera

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

Person Re-identification Based on Body Segmentation.

Real-Time Human Segmentation Using Pose Skeleton Map

Fast Human Detection in RGB-D Images Based on Color-Depth Joint Feature Learning.

FAST SEGMENTATION OF HUMAN BODY COMPONENTS BASED ON FACE DETECTION AND KEY POINT RECOGNITION

Physical Blob Detector and Multi-Channel Color Shape Descriptor for Human Detection.