Abstract:The development of the Internet of Things (IoT) stimulates many research works related to Multimedia Communication Systems (MCS), such as human face detection and tracking. This trend drives numerous progressive methods. Among these methods, the deep learning-based methods can spot face patch in an image effectively and accurately. Many people consider face tracking as face detection, but they are two different techniques. Face detection focuses on a single image, whose shortcoming is obvious, such as unstable and unsmooth face position when adopted on a sequence of continuous images; computing is expensive due to its heavy reliance on Convolutional Neural Networks (CNNs) and limited detection performance on the edge device. To overcome these defects, this paper proposes a novel face tracking strategy by combining CNN and optical flow, namely, C-OF, which achieves an extremely fast, stable, and long-term face tracking system. Two key things for commercial applications are the stability and smoothness of face positions in a sequence of image frames, which can provide more probability for face biological signal extraction, silent face antispoofing, and facial expression analysis in the fields of IoT-based MCS. Our method captures face patterns in every two consequent frames via optical flow to get rid of the unstable and unsmooth problems. Moreover, an innovative metric for measuring the stability and smoothness of face motion is designed and adopted in our experiments. The experimental results illustrate that our proposed C-OF outperforms both face detection and object tracking methods.

A Face Tracking Framework Based on Convolutional Neural Networks and Kalman Filter

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Robust Human Tracking Via Key Face Information.

Video Based Head Detection and Tracking Surveillance System

Convolutional Neural Network Using Kalman Filter for Human Detection and Tracking on RGB-D Video

A Real-Time and Long-Term Face Tracking Method Using Convolutional Neural Network and Optical Flow in IoT-Based Multimedia Communication Systems

A Recursive Framework for Automatic Face Tracking

An Unsupervised Real-Time Tracking and Recognition Framework in Videos

Human face detection and tracking based on supervised learning

Real-Time Face Tracking and Recognition in Video Sequence

Research on face tracking Algorithm Based on Detection and Supervision Tracking

A Real Time Face Tracking System Based on Multiple Information Fusion.

Robust Real-Time Face Tracking And Modeling From Video

A Multi-Faces Tracking and Recognition Framework for Surveillance System

Robust face detection and tracking under natural conditions

Improved Anti-Occlusion Tracking Algorithm Based on Face Detection

Hand real-time tracking method based on neural network and Kalman filter

Real-Time Facial Features Tracker With Motion Estimation And Feedback

Detection based visual tracking with convolutional neural network.

Detecting facial landmarks in the video based on a hybrid framework

Towards A Robust and Real-time Face Detection and Tracking Framework.