Abstract:Most current very low bit rate VLBR speech coding systems use hidden Markov model HMM based speech recognition and synthesis techniques. This allows transmission of information such as phonemes segment by segment; this decreases the bit rate. However, an encoder based on a phoneme speech recognition may create bursts of segmental errors; these would be further propagated to any suprasegmental such as syllable information coding. Together with the errors of voicing detection in pitch parametrization, HMM-based speech coding leads to speech discontinuities and unnatural speech sound artifacts. In this paper, we propose a novel VLBR speech coding framework based on neural networks NNs for end-to-end speech analysis and synthesis without HMMs. The speech coding framework relies on a phonological subphonetic representation of speech. It is designed as a composition of deep and spiking NNs: a bank of phonological analyzers at the transmitter, and a phonological synthesizer at the receiver. These are both realized as deep NNs, along with a spiking NN as an incremental and robust encoder of syllable boundaries for coding of continuous fundamental frequency F0. A combination of phonological features defines much more sound patterns than phonetic features defined by HMM-based speech coders; this finer analysis/synthesis code contributes to smoother encoded speech. Listeners significantly prefer the NN-based approach due to fewer discontinuities and speech artifacts of the encoded speech. A single forward pass is required during the speech encoding and decoding. The proposed VLBR speech coding operates at a bit rate of approximately 360 bits/s.

Techniques Of Very Low Bit-Rate Speech Coding

Research on real time low bit-rate speech coding

Research on Speech Coding Algorithm at Very Low Bit Rate for Narrow-Band Communication

2 kbps-2.4 kbps low complexity interpolative vocoder

Research on MBE Algorithm at Bit Rate 800 Bps-2.4 Kbps Vocoder

2kbps∼2.4kbps Low Complexity Interpolative Vocoder

In-band Tone Signal Coding in the Low-Bit-rate Speech Vocoder

Research on Low Delay Low Bit Rate Speech Coding Algorithm

High Efficient Quantization of the Energy Parameter in 0.6 Kb/s Vocoders

CQNV: A combination of coarsely quantized bitstream and neural vocoder for low rate speech coding

An Improved Method for Scalable Video Coding at Low Bit Rates

Mode-based Quantization of LP Parameters for Very Low Bit Rate Vocoder

8kbit/S Low Delay Speech Coding Algorithm With Adaptive Codebook

A 2.4kbps Vocoder Based on Waveform Interpolation

Efficient LSP Quantization Algorithm for Very Low Bit Rate Speech Coding

Composition of Deep and Spiking Neural Networks for Very Low Bit Rate Speech Coding

A Low-Complexity 2400b/s Vocoder

LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec

Implementation of High Quality 0.6 Kb/s Vocoder System Based on TMS320VC55x

Joint Source-Channel Coding and Modulation Scheme for Low-Bit-rate Speech

Variable-bitrate Speech Coding Using Time Scale Modification