Abstract:Far-field speech recognition is a challenging task that conventionally uses signal processing beamforming to attack noise and interference problem. But the performance has been found usually limited due to heavy reliance on environmental assumption. In this paper, we propose a unified multichannel far-field speech recognition system that combines the neural beamforming and transformer-based Listen, Spell, Attend (LAS) speech recognition system, which extends the end-to-end speech recognition system further to include speech enhancement. Such framework is then jointly trained to optimize the final objective of interest. Specifically, factored complex linear projection (fCLP) has been adopted to form the neural beamforming. Several pooling strategies to combine look directions are then compared in order to find the optimal approach. Moreover, information of the source direction is also integrated in the beamforming to explore the usefulness of source direction as a prior, which is usually available especially in multi-modality scenario. Experiments on different microphone array geometry are conducted to evaluate the robustness against spacing variance of microphone array. Large in-house databases are used to evaluate the effectiveness of the proposed framework and the proposed method achieve 19.26\% improvement when compared with a strong baseline.

A Novel Beam Search Algorithm Of Speech Recognition For Voice Command Control

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Design and implementation of a speaker recognition system

An Efficient Layer-Wised Beam Pruning Algorithm for Large Vocabulary Continuous Speech Recognition System

A two-layer lexical tree based beam search in continuous Chinese speech recognition

Reducing time-synchronous beam search effort using stage based look-ahead and language model rank based pruning

Navigating the Minefield of MT Beam Search in Cascaded Streaming Speech Translation

Research on continuous Chinese speech recognition system and knowledge based search strategies

Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition

Efficient Embedded Speech Recognition for Very Large Vocabulary Mandarin Car-Navigation Systems

A Token-Wise Beam Search Algorithm for RNN-T

Efficient graph search algorithm for embedded speech recognition

Realtime viterbi searching for practical telephone speech recognition systems

ON CHINESE CONTINUOUS SPEECH RECOGNITION SYSTEM AND KNOWLEDGE BASED SEARCH STRATEGIES SONG Zhanjiang

Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff

Study of speech recognition system based on private automatic branch exchange

A Study of Learning Based Beamforming Methods for Speech Recognition

Improved algorithm with duration information for continuous speech recognition

Novel Efficient Algorithms in Speech / Speaker Recognition

Enabling Beam Search for Language Model-Based Text-to-Speech Synthesis

A unified multichannel far-field speech recognition system: combining neural beamforming with attention based end-to-end model