An Integrative Approach to Robust Hand Detection Using CPM-YOLOv3 and RGBD Camera in Real Time.

Muhammad Raza,Vachiraporn Ketsoi,Haopeng Chen
DOI: https://doi.org/10.1109/ispa-bdcloud-sustaincom-socialcom48970.2019.00161
2019-01-01
Abstract:Innovative methods to interact with electronic devices are attracting researchers attentions, and many applications of Human Computer Interaction have been developed in recent years. Hand detection under different illuminations and backgrounds is crucial for tasks such as, actions recognition, gestures recognition and hand-based interaction with wearable devices. Many existing methods are able to detect the human hand precisely, but the task still remains challenging due to environment complexity, different invariants, processing time, and accuracy. It is required for an application to recognize the human hand precisely for proper interaction with the wearable devices. This paper proposed a robust and a compact method for hand detection by employing you only look once (YOLO) and convolutional pos machines (CPM). This paper consists of two parts, network training and testing. In the first part, Oxford hand dataset is used to train a neural network. This dataset has various hand images under different invariants, and backgrounds. Afterwards, images are captured using a digital camera in real-time and then human hands are detected using a trained neural network. In addition, detected hands, positions and orientations are calculated accordance with defined active zone parameters and a depth sensor. Our trained neural network is dubbed as HHDNet, an abbreviation for human hand detection network. The HHDNet is tested under different environment conditions, and experimental results showed that the accuracy and the frame rate of the proposed model are superior than others state of the art methods.
What problem does this paper attempt to address?