Abstract:As one of the most preferred forms of Human-Computer Interaction (HCI) nowadays, speech-based HCI enables people to communicate verbally with machines, leveraging technologies such as speech recognition and speech synthesis. Current paradigm of speech-based HCI focus on the content of speech only, failing to comprehend deeper pointing information in voice interaction. In particular, when encountering scenarios with multiple smart voice devices around, if people intend to interact with a certain device, the lack of extra pointing information (like the role played by the direction of eye gaze) would cause unintended response from the other devices, resulting in poor interaction experience during HCI. Hence, an interesting problem is: Is it possible for the devices to be aware of the orientation of human voice with only the acoustic speech signals? There is little research studying this topic, except for very a few primary works with much room for improvement. The main challenge of this study lies in capturing the concealed orientation information embedded within the speech signal, while simultaneously maintaining the scheme's practicality and high precision. In this paper, we propose Oriennet, for identifying the orientation of human voice. With a series of features intentionally designed in view of the indoor voice propagation model and mouth radiation pattern, as well as the application of attention mechanism, Oriennet achieve 95% accuracy in terms of judging whether people are facing the device or not. Even for the fine-grained task of classifying people's specific orientation from 8 different directions, our work achieved an accuracy of 74%, far outperforming the existed works. We have validated the robustness of Oriennet under various conditions (noisy environment; different people, rooms, languages, locations; fewer microphones), demonstrating its promising applicability in real-life scenarios.

Human Face Orientation Detection Using Power Spectrum Based Measurements

Study on the Performance of Moments As Invariant Descriptors for Practical Face Recognition Systems

Orientation Analysis for Rotated Human Face Detection

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

Accurate Estimation of Human Body Orientation from Rgb-D Sensors

Image Orientation Detection With Integrated Human Perception Cues (Or Which Way Is Up)

Human Orientation Estimation under Partial Observation

Side Face Features' Biometrics for Sasang Constitution

Selecting Optimal Orientations of Gabor Wavelet Filters for Facial Image Analysis

Eigen-Harmonics Faces: Face Recognition under Generic Lighting

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model

Orientation Detection Based on Wireless Channel Sensing

Human Face Detection Based on Hausdorff Distance

Voice Orientation Recognition: New Paradigm of Speech-Based Human-Computer Interaction

Face Orientation Detection in Video Stream Based on Harr-Like Feature and LQV Classifier for Civil Video Surveillance

Face Recognition based on Oriented Complex Wavelets and FFT

Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset

Efficient Human Face Recognition Based on Shape and Texture

Recognition of human periodic movements from unstructured information using a motion-based frequency domain approach

3D face recognition using eigen-spectrum on the flattened facial surface

HOS Image Similarity Measure for Human Face Recognition