Robust Automatic Tracking of Skin-Colored Objects with Level Set based Occlusion Handling

Liang-Guo Zhang,Xilin Chen,Chunli Wang,Wen Gao
2008-01-01
Abstract:The automatic detection and tracking of multiple skin-colored objects in videos plays important roles in gestural human-computer inter- action, such as in gesture and sign language recognition. In this paper, we propose a hybrid tracking framework, which consistently combines the blob based temporal data association and the level set based spa- tial occlusion handling through online shape learning, to track variable number of skin-colored objects. Blob based data association can provide rapid and accurate tracking when there's no occlusion; while level set based occlusion handling can recover the occluded shape as precisely as possible. In this way, the robust complete region tracking to preserve and provide much more useful information for future high-level vision tasks is guaranteed. We demonstrate the effectiveness and efficiency of this approach by experimenting on several video sequences with complex motion patterns.
What problem does this paper attempt to address?