The Viterbi Algorithm: A Personal History

G. David Forney Jr

DOI: https://doi.org/10.48550/arXiv.cs/0504020

2005-04-29

Abstract:The story of the Viterbi algorithm (VA) is told from a personal perspective. Applications both within and beyond communications are discussed. In brief summary, the VA has proved to be an extremely important algorithm in a surprising variety of fields.

Information Theory

What problem does this paper attempt to address?

Novel approach to the survivor memory management in Viterbi decoder VLSI design

Yan Han,Jiaoying Shi

1996-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:There are two traditional techniques for the realization of survivor memory unit in the Viterbi decoder-register exchange (RE) and trace back (TB) method. RE is not practical for the Viterbi decoder with a large number of trellis states due to the very complicated interconnections. TB needs a large quantity of buffers and has a long decoding delay. In this paper the register/three-state-gate trace back method is presented which combines the advantages of both RE and TB and overcomes their disadvantages. It's very suitable for VLSI implementation.
Implementation of Window-based Soft-Output-Viterbi Algorithm

彭丹丹,周振东,王匡

DOI: https://doi.org/10.3969/j.issn.1007-0249.2004.03.030

2004-01-01

Abstract:The paper presented an analysis of the mechanism of soft-output-Viterbi-algorithm and the extraction of soft-information. For practical implementation, a more general scheme of slide-window soft-output-Viterbi-algorithm is proposed. By adjusting its slide-window parameters, it can reduce the complexity of the algorithm as much as possible meanwhile the performance nearly remains the same as the decoding scheme based on the non-slide-window SOVA.
Implementation of Serial Viterbi Decoding Based on FPGA

陈春霞,王匡

DOI: https://doi.org/10.3969/j.issn.1000-3428.2003.14.066

2003-01-01

Abstract:Viterbi algorithm is applicable to decoding of convolutional codes. The hardware consumption of parallel Viterbi decoding shows exponential increase with the increase of constraint length of convolutional codes, which limits its hardware implementation. In this paper, the FPGA implementation of a serial Viterbi decoding architecture is presented. Suitable for decoding convolutional codes with long constraint length, this architecture saves hardware resource without performance deterioration.
A new VLSI design for Viterbi decoder based on ASIP

Zhiqiang Yi,Yuanxin Xu,Yun Li,Kuang Wang

DOI: https://doi.org/10.1109/ICCCAS.2002.1179065

2002-01-01

Abstract:Trellis Code Modulation (TCM) has been widely used because it can obtain 2.55∼7.37 dB coding gain without bandwidth expansion or reduction of the effective information rates. Since Viterbi decoder plays an important role in the realization of HDTV system, we conduct the research and development on integration of Viterbi decoder. This paper proposes a new VLSI design of Viterbi decoder using ASIPs based on hardware/software co-design idea. It reduces the total design time and enhances the reliability of VLSI. We have successfully used this method for the design of Viterbi decoder in the ASTC-HDTV receiver chip.
A Neural Network Approach To Viterbi Algorithm Based On Mfa

Sy Sun,Jl Zheng,Z Qi

2002-01-01

Abstract:The Viterbi algorithm can be realized by selecting the code sequence, which has minimum Hamming distance through the trellis from the received sequence. In fact, the problem is similar to the well-known Traveling Salesman Problem (TSP). Performing the Viterbi algorithm decoding of convolutional codes is shown to be equivalent to finding a global minimum of the energy function associated with a neural network. In this paper, a neural network approach based on the Mean Field Annealing (MFA) is presented to solve the Viterbi algorithm in the digital communication. The energy function required by MFA is formulated. A computer simulation is given to demonstrate the effectiveness and validity of the proposed approach.
Circuit design of a 8-state 32QAM Viterbi decoder

Yan Han,Kuang Wang,Qingdong Yao

1996-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:Trellis Coded Modulation (TCM) has been widely used because it can obtain 2.55-7.37 dB coding gain without bandwidth expansion or reduction of the effective information rates. Since Viterbi Decoder (VD) plays an important role in the realization of HDTV system, the research and development on integration of VDs were conducted. factors which affect the performance of VDs and their solutions was studied. A completed VLSI circuit design for an 8-state 32QAM VD (30,000 gates in scale) is also reported.
Design technique of Viterbi decoder in satellite communication

Ying Li,Weijun Lu,Dunshan Yu,Xing Zhang

DOI: https://doi.org/10.1049/cp:20070108

2007-01-01

Abstract:By analyzing the well-known Viterbi algorithm, a Viterbi decoder especially used in satellite communication system is presented. In this paper, the design technique of each part has been discussed. The decoder adopts 4 butterfly units in part- parallel calculation structure with concise interconnection, which is implemented with Xilinx Virtex-II 2V1000- 5BGS575 FPGA (field programmable gate array). The design delays 54 clock periods and costs 501 slices.
A Fast ACSU Architecture for Viterbi Decoder Using T-algorithm

Jinjin He,Huaping Liu,Zhongfeng Wang

DOI: https://doi.org/10.1109/acssc.2009.5470119

2009-01-01

Abstract:Modern digital communication systems usually employ convolutional codes with large constraint length for good decoding performance, which leads to large complexity and power consumption in Viterbi decoders. It is essential to use T-algorithm in Viterbi decoders to prune significant portions of the trellis states to dramatically reduce power consumption. However, the operation of searching for the best path metrics in the add-compare-select loop in T-algorithm significantly limits the clock speed. In this paper, we propose an efficient architecture based on pre-computation for Viterbi decoders incorporating T-algorithm. Through optimization at both algorithm level and architecture level, the new architecture greatly shortens the long critical path introduced by the conventional T-algorithm. The design example provided in this work demonstrates more than twice improvement in clock speed with negligible computation overhead while maintaining decoding performance.
High-Throughput and Memory-Efficient Parallel Viterbi Decoder for Convolutional Codes on GPU

Alireza Mohammadidoost,Matin Hashemi

DOI: https://doi.org/10.48550/arXiv.2011.09337

2020-11-18

Distributed, Parallel, and Cluster Computing

Abstract:This paper describes a parallel implementation of Viterbi decoding algorithm. Viterbi decoder is widely used in many state-of-the-art wireless systems. The proposed solution optimizes both throughput and memory usage by applying optimizations such as unified kernel implementation and parallel traceback. Experimental evaluations show that the proposed solution achieves higher throughput compared to previous GPU-accelerated solutions.
ViterbiNet: A Deep Learning Based Viterbi Algorithm for Symbol Detection

Nir Shlezinger,Nariman Farsad,Yonina C. Eldar,Andrea J. Goldsmith

DOI: https://doi.org/10.1109/twc.2020.2972352

IF: 10.4

2020-05-01

IEEE Transactions on Wireless Communications

Abstract:Symbol detection plays an important role in the implementation of digital receivers. In this work, we propose ViterbiNet, which is a data-driven symbol detector that does not require channel state information (CSI). ViterbiNet is obtained by integrating deep neural networks (DNNs) into the Viterbi algorithm. We identify the specific parts of the Viterbi algorithm that depend on the channel model, and design a DNN to implement only those computations, leaving the rest of the algorithm structure intact. We then propose a meta-learning based approach to train ViterbiNet online based on recent decisions, allowing the receiver to track dynamic channel conditions without requiring new training samples for every coherence block. Our numerical evaluations demonstrate that the performance of ViterbiNet, which is ignorant of the CSI, approaches that of the CSI-based Viterbi algorithm, and is capable of tracking time-varying channels without needing instantaneous CSI or additional training data. Moreover, unlike conventional Viterbi detection, ViterbiNet is robust to CSI uncertainty, and it can be reliably implemented in complex channel models with constrained computational burden. More broadly, our results demonstrate the conceptual benefit of designing communication systems that integrate DNNs into established algorithms.

telecommunications,engineering, electrical & electronic
An Improved Viterbi Algorithm for a Class of Optimal Binary Convolutional Codes

Zita Abreu,Julia Lieb,Michael Schaller

2024-07-25

Abstract:The most famous error-decoding algorithm for convolutional codes is the Viterbi algorithm. In this paper, we present a new reduced complexity version of this algorithm which can be applied to a class of binary convolutional codes with optimum column distances called k-partial simplex convolutional codes.

Information Theory
Two decoding algorithms for tailbiting codes

R.Y. Shao,Shu Lin,M.P.C. Fossorier

DOI: https://doi.org/10.1109/tcomm.2003.818084

IF: 6.166

2003-10-01

IEEE Transactions on Communications

Abstract:The paper presents two efficient Viterbi decoding-based suboptimal algorithms for tailbiting codes. The first algorithm, the wrap-around Viterbi algorithm (WAVA), falls into the circular decoding category. It processes the tailbiting trellis iteratively, explores the initial state of the transmitted sequence through continuous Viterbi decoding, and improves the decoding decision with iterations. A sufficient condition for the decision to be optimal is derived. For long tailbiting codes, the WAVA gives essentially optimal performance with about one round of Viterbi trial. For short- and medium-length tailbiting codes, simulations show that the WAVA achieves closer-to-optimum performance with fewer decoding stages compared with the other suboptimal circular decoding algorithms. The second algorithm, the bidirectional Viterbi algorithm (BVA), employs two wrap-around Viterbi decoders to process the tailbiting trellis from both ends in opposite directions. The surviving paths from the two decoders are combined to form composite paths once the decoders meet in the middle of the trellis. The composite paths at each stage thereafter serve as candidates for decision update. The bidirectional process improves the error performance and shortens the decoding latency of unidirectional decoding with additional storage and computation requirements. Simulation results show that both proposed algorithms effectively achieve practically optimum performance for tailbiting codes of any length.

telecommunications,engineering, electrical & electronic
A High Speed Viterbi Circuit Implementation for WLAN System

LIU Xiao-ying,WANG Yi,WANG Xin-an

DOI: https://doi.org/10.3969/j.issn.1673-629x.2008.01.003

2008-01-01

Abstract:Viterbi algorithm is widely used in decoding.In this paper,a Viterbi decoder circuit for wireless local area network(WLAN) applications is presented.It works in the multi-rate 802.11a WLAN system with different code rates at the speed of 100MHz.For the high speed requirement of 802.11a standard,parallel architecture in ACS and SMU were used in our design,and also improved the architecture of SMU to reduce the decoding latency.A modified method of path metric normalization is applied which make the algorithm easier to implement.
Locate: Low-Power Viterbi Decoder Exploration using Approximate Adders

Rajat Bhattacharjya,Biswadip Maity,Nikil Dutt

2023-04-07

Abstract:Viterbi decoders are widely used in communication systems, natural language processing (NLP), and other domains. While Viterbi decoders are compute-intensive and power-hungry, we can exploit approximations for early design space exploration (DSE) of trade-offs between accuracy, power, and area. We present Locate, a DSE framework that uses approximate adders in the critically compute and power-intensive Add-Compare-Select Unit (ACSU) of the Viterbi decoder. We demonstrate the utility of Locate for early DSE of accuracy-power-area trade-offs for two applications: communication systems and NLP, showing a range of pareto-optimal design configurations. For instance, in the communication system, using an approximate adder, we observe savings of 21.5% area and 31.02% power with only 0.142% loss in accuracy averaged across three modulation schemes. Similarly, for a Parts-of-Speech Tagger in an NLP setting, out of 15 approximate adders, 7 report 100% accuracy while saving 22.75% area and 28.79% power on average when compared to using a Carry-Lookahead Adder in the ACSU. These results show that Locate can be used synergistically with other optimization techniques to improve the end-to-end efficiency of Viterbi decoders for various application domains.

Hardware Architecture
Design and implementation of a high-speed and area-efficient viterbi decoder

Hao Yang,Xiaolang Yan

DOI: https://doi.org/10.1109/ICSICT.2006.306631

2007-01-01

Abstract:A high-speed and area-efficient Viterbi Decoder is presented in the paper, and a new survivor path structure including RAM blocks and trace-back decode circuit is proposed. The survivor path memory is consist of 4 single-port RAM blocks, which reduces the chip's area comparing to the dual-port RAM structure; and a simple trace-back decoder circuit is implemented to get high speed. Only 2300 LEs are used in the Altera Stratix FPGA device to implement this design, and its speed is up to 163 MHz. The proposed Viterbi Decoder can be introduced to the digital communication systems that need high speed such as DTV or HDTV broadcast. © 2006 IEEE.
An efficient viterbi algorithm on DBNs

Wei Hu,Yimin Zhang,Qian Diao,Shan Huang

DOI: https://doi.org/10.21437/eurospeech.2003-694

2003-01-01

Abstract:DBNs (Dynamic Bayesian Networks) [1] are powerful tool in modeling time-series data, and have been used in speech recognition recently [2,3,4]. The “decoding” task in speech recognition means to find the viterbi path [5](in graphical model community, “viterbi path” has the same meaning as MPE “Most Probable Explanation”) for a given acoustic observations. In this paper we describe a new algorithm utilizes a new data structure “backpointer”, which is produced in the “marginalization” procedure in probability inference. With these backpointers, the viterbi path can be found in a simple backtracking. We first introduce the concept of backpointer and backtracking; then give the algorithm to compute the viterbi path for DBNs based on backpointer and backtracking. We prove that the new algorithm is correct, faster and more memory saving comparison with old algorithm. Several experiments are conducted to demonstrate the effectiveness of the algorithm on several well known DBNs. We also test the algorithm on a real world DBN model that can recognize continuous digit numbers.
A Constructive Proof of the Existence of Viterbi Processes

Jüri Lember,Alexey Alexandrovich Koloydenko

DOI: https://doi.org/10.1109/tit.2010.2040897

IF: 2.5

2010-04-01

IEEE Transactions on Information Theory

Abstract:Since the early days of digital communication, hidden Markov models (HMMs) have now been also routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. In an HMM $(X_{t},Y_{t})_{t\geq 1}$, observations $X_{1},X_{2},\ldots$ are assumed to be conditionally independent given a Markov process $Y_{1},Y_{2},\ldots$, which itself is not observed; moreover, the conditional distribution of $X_{t}$ depends solely on $Y_{t}$. Central to the theory and applications of HMM is the Viterbi algorithm to find a maximum a posteriori probability (MAP) estimate $v(x_{1:T})=(v_{1},v_{2},\ldots, v_{T})$ of $Y_{1:T}$ given observed data $x_{1:T}$. Maximum a posteriori paths are also known as the Viterbi paths, or alignments. Recently, attempts have been made to study behavior of the Viterbi alignments when $T\to \infty$. Thus, it has been shown that in some cases a well-defined limiting Viterbi alignment exists. While innovative, these attempts have relied on rather strong assumptions and involved proofs which are existential. This work proves the existence of infinite Viterbi alignments in a more constructive manner and for a very general class of HMMs.

computer science, information systems,engineering, electrical & electronic
On-line Viterbi Algorithm and Its Relationship to Random Walks

Rastislav Šrámek,Broňa Brejová,Tomáš Vinař

DOI: https://doi.org/10.1007/978-3-540-74126-8_23

2007-04-01

Abstract:In this paper, we introduce the on-line Viterbi algorithm for decoding hidden Markov models (HMMs) in much smaller than linear space. Our analysis on two-state HMMs suggests that the expected maximum memory used to decode sequence of length $n$ with $m$-state HMM can be as low as $\Theta(m\log n)$, without a significant slow-down compared to the classical Viterbi algorithm. Classical Viterbi algorithm requires $O(mn)$ space, which is impractical for analysis of long DNA sequences (such as complete human genome chromosomes) and for continuous data streams. We also experimentally demonstrate the performance of the on-line Viterbi algorithm on a simple HMM for gene finding on both simulated and real DNA sequences.

Data Structures and Algorithms
Design of a High-Speed Viterbi Decoder

Pan Chang-yong

2004-01-01

Abstract:The implementation of a high-speed Viterbi decoder of the (2,1,7) convolutional code is described. Not only a parallel structure is used in designing the Add-Compare-Slect(ACS) unit, but also a series of simplified measures are a dopted. The maximal data output speed of this decoder is 160Mbps.
Design of a High-Performance Reusable Viterbi Decoder

ZHU Sheng,YANG Hua-zhong,DONG Zai-wang

DOI: https://doi.org/10.3969/j.issn.1004-3365.2005.02.029

2005-01-01

Abstract:A high performance reusable Viterbi decoder is designed. Radix-4-pipeline, trace-forward, same-address-write-back and memory-manage techniques are used to improve its performance, area and power. Under PE architecture, the convolution code, the number of PE, the depth of trace-back, etc, can be all adjustable. Based on TSMC's 0.18 μm CMOS process, a punctured 64-state (4,1,6) Viterbi decoder is successfully simulated and synthesized, which has 30 000 gates, with a throughput of 12.5 Mbps and 15 mW power.With ST's 0.13 μm CMOS process, the same performance is achieved, with only 4.7 mW power. The Viterbi decoder has been used in our DAB receiver chip.

The Viterbi Algorithm: A Personal History

Novel approach to the survivor memory management in Viterbi decoder VLSI design

Implementation of Window-based Soft-Output-Viterbi Algorithm

Implementation of Serial Viterbi Decoding Based on FPGA

A new VLSI design for Viterbi decoder based on ASIP

A Neural Network Approach To Viterbi Algorithm Based On Mfa

Circuit design of a 8-state 32QAM Viterbi decoder

Design technique of Viterbi decoder in satellite communication

A Fast ACSU Architecture for Viterbi Decoder Using T-algorithm

High-Throughput and Memory-Efficient Parallel Viterbi Decoder for Convolutional Codes on GPU

ViterbiNet: A Deep Learning Based Viterbi Algorithm for Symbol Detection

An Improved Viterbi Algorithm for a Class of Optimal Binary Convolutional Codes

Two decoding algorithms for tailbiting codes

A High Speed Viterbi Circuit Implementation for WLAN System

Locate: Low-Power Viterbi Decoder Exploration using Approximate Adders

Design and implementation of a high-speed and area-efficient viterbi decoder

An efficient viterbi algorithm on DBNs

A Constructive Proof of the Existence of Viterbi Processes

On-line Viterbi Algorithm and Its Relationship to Random Walks

Design of a High-Speed Viterbi Decoder

Design of a High-Performance Reusable Viterbi Decoder