Abstract:Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER) than original ASR outputs. Previous works usually use a sequence-to-sequence model to correct an ASR output sentence autoregressively, which causes large latency and cannot be deployed in online ASR services. A straightforward solution to reduce latency, inspired by non-autoregressive (NAR) neural machine translation, is to use an NAR sequence generation model for ASR error correction, which, however, comes at the cost of significantly increased ASR error rate. In this paper, observing distinctive error patterns and correction operations (i.e., insertion, deletion, and substitution) in ASR, we propose FastCorrect, a novel NAR error correction model based on edit alignment. In training, FastCorrect aligns each source token from an ASR output sentence to the target tokens from the corresponding ground-truth sentence based on the edit distance between the source and target sentences, and extracts the number of target tokens corresponding to each source token during edition/correction, which is then used to train a length predictor and to adjust the source tokens to match the length of the target sentence for parallel generation. In inference, the token number predicted by the length predictor is used to adjust the source tokens for target sequence generation. Experiments on the public AISHELL-1 dataset and an internal industrial-scale ASR dataset show the effectiveness of FastCorrect for ASR error correction: 1) it speeds up the inference by 6-9 times and maintains the accuracy (8-14% WER reduction) compared with the autoregressive correction model; and 2) it outperforms the popular NAR models adopted in neural machine translation and text edition by a large margin.

FLAS: Fast and High-Throughput Algorithm for PacBio Long-Read Self-Correction.

Fec: a Fast Error Correction Method Based on Two-Rounds Overlapping and Caching.

HALC: High throughput algorithm for long read error correction

MECAT: an ultra-fast mapping, error correction and de novo assembly tool for single-molecule sequencing reads

MECAT: fast mapping, error correction, and de novo assembly for single-molecule sequencing reads

MECAT: an ultra-fast mapping, error correction and<i>de novo</i>assembly tool for single-molecule sequencing reads

Scalable long read self-correction and assembly polishing with multiple sequence alignment

MEC: Misassembly Error Correction in Contigs Based on Distribution of Paired-End Reads and Statistics of GC-contents

MEC: Misassembly Error Correction in Contigs Using a Combination of Paired-End Reads and GC-contents

Integration of Hybrid and Self-Correction Method Improves the Quality of Long-Read Sequencing Data.

Fast and Accurate Assembly of Nanopore Reads Via Progressive Error Correction and Adaptive Read Selection

ARAMIS: From systematic errors of NGS long reads to accurate assemblies

A Parallel Algorithm for Error Correction in High-Throughput Short-Read Data on CUDA-enabled Graphics Hardware.

FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition

MapReduce for Accurate Error Correction of Next-Generation Sequencing Data

Efficient assembly of nanopore reads via highly accurate and intact error correction

De novo diploid genome assembly using long noisy reads

MAECI: A Pipeline for Generating Consensus Sequence with Nanopore Sequencing Long-read Assembly and Error Correction

CASA: An Energy-Efficient and High-Speed CAM-based SMEM Seeding Accelerator for Genome Alignment

PECC: Correcting Contigs Based on Paired-End Read Distribution

diploid genome assembly using long noisy reads