Joint Estimation of Linear and Non-linear Signal-to-Noise Ratio Based on Neural Networks

F. J. Vaquero Caballero,David Ives,Qunbi Zhuge,Maurice O'Sullivan,Seb J. Savory

DOI: https://doi.org/10.1364/ofc.2018.m2f.4

2018-01-01

Abstract:A novel technique estimating ASE and non-linear SNR is presented. Our method is evaluated by simulations obtaining a std error of 0.23 dB for both ASE and non-linear SNR.

What problem does this paper attempt to address?

Joint Channel Estimation and Data Recovery of Communication Systems with Sub-Nyquist Receiver.

Feibai Zhu,An Liu,Vincent K. N. Lau

DOI: https://doi.org/10.1109/icc.2015.7248719

2015-01-01

Abstract:Consider a multicarrier communication scenario where both the information (data) and channel have sparse structure. To exploit such sparse structure, we propose to use a receiver working at sampling rate much lower than Nyquist rate (sub-Nyquist sampling) to acquire the data corrupted by noise as well as multipath channel. With the sub-Nyquist rate samples, the joint channel estimation and data recovery is formulated as a sparse maximum likelihood estimation (MLE) problem which maximizes the associated non-concave likelihood function under the sparsity constraints on channel and data. This Sparse MLE framework is proved to provide solutions with bounded error w.r.t. the true value of channel and data under certain restricted isometry property (RIP) conditions. We propose an alternating sparse matching pursuit (ASMP) algorithm to solve the non-convex Sparse MLE problem. We also establish the sufficient conditions for ASMP to converge to solution with bounded error under certain restricted isometry property (RIP) conditions. Simulations show that when sparse structure is exploited, a low rate sub-Nyquist receiver using ASMP performs nearly as well as a Nyquist rate receiver.
Neural Network based Linear and Nonlinear Noise Estimation

F. J. Caballero,D. Ives,C. Laperle,D. Charlton,Q. Zhuge,M. O'sullivan,S. Savory

2018-01-01

Abstract:Operators are pressured to maximize the achieved capacity over deployed links. This can be obtained by operating in the weakly nonlinear regime, requiring a precise understanding of the transmission conditions. Ideally, optical transponders should be capable of estimating the regime of operation from the received signal and feeding that information to the upper management layers to optimizate the transmission characteristics, however this estimation is challenging. This paper addresses this problem by estimating the linear and nonlinear SNR from the received signal. This estimation is performed by obtaining features of two distinctive effects: nonlinear phase noise and second-order statistical moments. A small neural network is trained to estimate the SNRs from the extracted features. Over extensive simulations covering 19,800 sets of realistic fibre transmissions, we verified the accuracy of the proposed techniques. Employing both approaches simultaneously gave a measured performances of 0.04 and 0.20 dB of std error for the linear and nonlinear SNR, respectively.
Machine Learning Based Linear and Nonlinear Noise Estimation

F. J. Vaquero Caballero,D. J. Ives,C. Laperle,D. Charlton,Q. Zhuge,M. O'Sullivan,Seb J. Savory

DOI: https://doi.org/10.1364/jocn.10.000d42

IF: 4.508

2018-01-01

Journal of Optical Communications and Networking

Abstract:Operators are pressured to maximize the achieved capacity over deployed links. This can be obtained by operating in the weakly nonlinear regime, requiring a precise understanding of the transmission conditions. Ideally, optical transponders should be capable of estimating the regime of operation from the received signal and feeding that information to the upper management layers to optimize the transmission characteristics; however, this estimation is challenging. This paper addresses this problem by estimating the linear and nonlinear signal-to-noise ratio (SNR) from the received signal. This estimation is performed by obtaining features of two distinct effects: nonlinear phase noise and second-order statistical moments. A small neural network is trained to estimate the SNRs from the extracted features. Over extensive simulations covering 19,800 sets of realistic fiber transmissions, we verified the accuracy of the proposed techniques. Employing both approaches simultaneously gave measured performances of 0.04 and 0.20 dB of standard error for the linear and nonlinear SNRs, respectively.
Fiber Nonlinear Noise-to-Signal Ratio Monitoring Using Artificial Neural Networks

A. S. Kashi,Qunbi Zhuge,John C. Cartledge,Andrzej Borowiec,Douglas Charlton,Charles Laperle,Maurice O'Sullivan

DOI: https://doi.org/10.1109/ECOC.2017.8345880

2017-01-01

Abstract:An artificial neural network model to estimate fiber nonlinear noise-to-signal ratio based on amplitude noise covariance of received symbols is proposed. Standard deviation of 0.2 dB is obtained in simulation, and estimation error of <;0.6 dB is verified in experiment.
Artificial Neural Networks for Fiber Nonlinear Noise Estimation

Aazar Saadaat Kashi,Qunbi Zhuge,John Cartledge,Andrzej Borowiec,Douglas Charlton,Charles Laperle,Maurice O'Sullivan

DOI: https://doi.org/10.1364/acpc.2017.su1b.6

2017-01-01

Abstract:OSNR monitoring techniques are reviewed and a use of machine learning to estimate the nonlinear noise and thereby monitor the OSNR is described. High monitoring accuracy is demonstrated for a wide range of link conditions using an artificial neural network.
Sequential joint signal detection and signal-to-noise ratio estimation

M. Fauß,K. G. Nagananda,A. M. Zoubir,H. V. Poor

DOI: https://doi.org/10.48550/arXiv.1701.05297

2017-01-19

Abstract:The sequential analysis of the problem of joint signal detection and signal-to-noise ratio (SNR) estimation for a linear Gaussian observation model is considered. The problem is posed as an optimization setup where the goal is to minimize the number of samples required to achieve the desired (i) type I and type II error probabilities and (ii) mean squared error performance. This optimization problem is reduced to a more tractable formulation by transforming the observed signal and noise sequences to a single sequence of Bernoulli random variables; joint detection and estimation is then performed on the Bernoulli sequence. This transformation renders the problem easily solvable, and results in a computationally simpler sufficient statistic compared to the one based on the (untransformed) observation sequences. Experimental results demonstrate the advantages of the proposed method, making it feasible for applications having strict constraints on data storage and computation.

Information Theory
Nonlinear Signal-to-Noise Ratio Estimation in Coherent Optical Fiber Transmission Systems Using Artificial Neural Networks

Aazar Saadaat Kashi,Qunbi Zhuge,John C. Cartledge,S. Ali Etemad,Andrzej Borowiec,Douglas W. Charlton,Charles Laperle,Maurice O'Sullivan

DOI: https://doi.org/10.1109/jlt.2018.2873949

IF: 4.7

2018-01-01

Journal of Lightwave Technology

Abstract:For high symbol rate fiber optic networks, the estimation and monitoring of time varying link performance parameters are critical for delivering optimal network performance. In this paper, a method is presented for estimating the nonlinear signal-to-noise ratio ${\text{(SNR}}_{{\text{nl}}})$ using an artificial neural network (ANN). The ANN is trained with the fiber nonlinearity induced amplitude noise covariance and phase noise correlation extracted from received symbols. The data used for training are simulation results for a 34.5 Gbaud dual polarization 16-ary quadrature amplitude modulation signal transmitted over a wide range of link configurations with varying fiber types and number of wavelength division multiplexed channels. Using 734 input-output sets, high accuracy is demonstrated for training, testing, and validation for simulation data with a maximum normalized root-mean-square error of 0.37% for ${\text{SNR}}_{{\text{nl}}}$. Validation using experimental data exhibits less than 0.25 dB deviation from the true ${\text{SNR}}_{{\text{nl}}}$ for estimates obtained with varying fiber length and launch power.
Frame-Level Signal-to-Noise Ratio Estimation Using Deep Learning

Hao Li,DeLiang Wang,Xueliang Zhang,Guanglai Gao

DOI: https://doi.org/10.21437/interspeech.2020-2475

2020-01-01

Abstract:This study investigates deep learning based signal-to-noise ratio (SNR) estimation at the frame level. We propose to employ recurrent neural networks (RNNs) with long short-term memory (LSTM) in order to leverage contextual information for this task. As acoustic features are important for deep learning algorithms, we also examine a variety of monaural features and investigate feature combinations using Group Lasso and sequential floating forward selection. By replacing LSTM with bidirectional LSTM, the proposed algorithm naturally leads to a long-term SNR estimator. Systematical evaluations demonstrate that the proposed SNR estimators significantly outperform other frame-level and long-term SNR estimators.
FPGA-based Implementation of Artificial Neural Network for Nonlinear Signal-to-Noise Ratio Estimation

Lei Liu,Xiaomin Liu,Zhiqun Zhai,Yiwen Wu,Hexun Jiang,Lilin Yi,Weisheng Hu,Qunbi Zhuge

DOI: https://doi.org/10.1364/oecc.2021.t2b.4

2021-01-01

Abstract:We propose a FPGA-based artificial neural network (ANN) architecture with flexible degree of parallelism (DOP) for nonlinear signal-to-noise ratio (SNR) estimation. Considering the trade-off between resource usage and computational speed, the architecture shows flexibility and efficiency of resources allocation in the FPGA design. © 2021 The Author(s)
A Grey-box Model for Estimating Nonlinear SNR in Optical Networks Based on Physics-guided Neural Networks

Xiaomin Liu,Lei Liu,Huazhi Lun,Yihao Zhang,Lilin Yi,Weisheng Hu,Qunbi Zhuge

DOI: https://doi.org/10.1364/acpc.2021.m5i.1

2021-01-01

Abstract:Based on physics-guided neural network, we design the features and loss function for estimating nonlinear SNR. With 1603 examples from simulations, a shallow neural network can have a higher accuracy and a better physical consistency.
Joint Optimization of the Module and Sign of the Spectral Real Part Based on CRN for Speech Denoising

Zilu Guo,Xu,Zhongfu Ye

DOI: https://doi.org/10.21437/interspeech.2022-778

2022-01-01

Abstract:Recently some novel techniques have utilized sophisticated algorithms to correct phase or use phase information by processing real- and image-part respectively or simultaneously in the STFT domain. However, neural networks can not process a complex-valued feature, i.e., the STFT of a noisy speech. Therefore, these methods estimating the STFT of a clean signal can only obtain sub-optimal solutions. To avoid tackling complex-value operations, we formulate that only the real part of 2K-point STFT is utilized as the feature that holds all signal information. Therefore, speech enhancement in the STFT domain turns into a real-valued task. However, it is hard for the network to estimate the correct sign. Consequently, we develop an estimator to predict the real part sign and a decoder to estimate the targeted real part's mask. Then, we devise some experiments to evaluate our model over kinds of metrics. The results indicate that our model outperforms several state-of-the-art (SOTA) models.
Low Noise Non-Linear Equalization Using Neural Networks and Belief Propagation

Etsushi Yamazaki,Nariman Farsad,Andrea Goldsmith

DOI: https://doi.org/10.48550/arXiv.1905.04893

2019-05-15

Abstract:Nonlinearities can be introduced into communication systems by the physical components such as the power amplifier, or during signal propagation through a nonlinear channel. These nonlinearities can be compensated by a nonlinear equalizer at the receiver side. The nonlinear equalizer also operates on the additive noise, which can lead to noise enhancement. In this work we evaluate this trade-off between distortion reduction and noise-enhancement via nonlinear equalization techniques. We first, evaluate the trade-off between nonlinearity compensation and noise enhancement for the Volterra equalizer, and propose a method to determine the training SNR that optimizes this performance trade-off. We then propose a new approach for nonlinear equalization that alternates between neural networks (NNs) for nonlinearity compensation, and belief propagation (BP) for noise removal. This new approach achieves a 0.6 dB gain compared to the Volterra equalizer with the optimal training SNR, and a 1.7 dB gain compared to a system with no nonlinearity compensation.

Signal Processing,Information Theory
Neural Network Training for OSNR Estimation -- From Prototype to Product

Andrew D. Shiner,Mohammad E. Mousa-Pasandi,Meng Qiu,Michael A. Reimer,Eui Young Park,Michael Hubbard,Qunbi Zhuge,Francisco J. Vaquero Caballero,Maurice O'Sullivan

DOI: https://doi.org/10.48550/arXiv.2003.02333

2020-03-05

Abstract:A method for in-service OSNR measurement with a coherent transceiver is presented and experimentally verified. A neural network is employed to identify and remove the nonlinear noise contribution to the estimated OSNR.

Signal Processing
Joint Neural Network Equalizer and Decoder

Weihong Xu,Zhiwei Zhong,Yair Be'ery,Xiaohu You,Chuan Zhang

DOI: https://doi.org/10.48550/arXiv.1807.02040

2018-07-05

Abstract:Recently, deep learning methods have shown significant improvements in communication systems. In this paper, we study the equalization problem over the nonlinear channel using neural networks. The joint equalizer and decoder based on neural networks are proposed to realize blind equalization and decoding process without the knowledge of channel state information (CSI). Different from previous methods, we use two neural networks instead of one. First, convolutional neural network (CNN) is used to adaptively recover the transmitted signal from channel impairment and nonlinear distortions. Then the deep neural network decoder (NND) decodes the detected signal from CNN equalizer. Under various channel conditions, the experiment results demonstrate that the proposed CNN equalizer achieves better performance than other solutions based on machine learning methods. The proposed model reduces about $2/3$ of the parameters compared to state-of-the-art counterparts. Besides, our model can be easily applied to long sequence with $\mathcal{O}(n)$ complexity.

Signal Processing,Information Theory
Joint Estimation of DOA and Range for Near-Field Sources in the Presence of Far-Field Sources and Alpha-Stable Noise

Tao Liu,Mengjia Wang,Hao Feng,Shengyang Luan,Jiacheng Zhang

DOI: https://doi.org/10.1109/lsp.2024.3356412

2024-02-02

IEEE Signal Processing Letters

Abstract:This work presents an effective and robust methodology to achieve the joint estimation of direction-of-arrival (DOA) and range. One or more near-field sources are the signals of interest. Far-field sources and alpha-stable noise are additive interferences and will be removed in two steps. First, alpha-stable noise is suppressed into Gaussian or sub-Gaussian noise through a proposed mathematical limiter. Then, the near-field sources are separated from the mixed sources according to the specific technique. The two steps involve three key technologies, including noise reduction, sparse reconstruction, and subspace decomposition. In the experiments, we design an assessment standard for missing detection in data calculation, which is of utmost importance to demonstrate the novel methodology's superiority compared to the other existing competitive ones.

engineering, electrical & electronic
Recurrent Neural Networks and Acoustic Features for Frame-Level Signal-to-Noise Ratio Estimation.

Hao Li,DeLiang Wang,Xueliang Zhang,Guanglai Gao

DOI: https://doi.org/10.1109/taslp.2021.3107617

2021-01-01

Abstract:It is important to know the presence and the relative level of background noise for many speech processing tasks. Frame-level signal-to-noise ratio (SNR) provides a measure of instantaneous noise level of a noisy signal, and its estimation has been researched for decades. This problem can be approached from a supervised learning perspective by predicting SNR from features of noisy speech. In this study, we introduce a deep learning algorithm for frame-level SNR estimation. The proposed algorithm employs recurrent neural networks (RNNs) with long short-term memory (LSTM) to leverage contextual information. We also systematically examine a range of acoustic features and investigate feature combinations using Group Lasso and sequential floating forward selection (SFFS). The proposed algorithm naturally leads to an utterance-level SNR estimator. Systematical evaluations show that the proposed algorithm provides an accurate estimate of frame-level SNR, as well as utterance-level SNR, under different noise conditions, outperforming other estimators.
Signal-Dependent Noise Estimation for a Real-Camera Model via Weight and Shape Constraints

Heng Yao,Mian Zou,Chuan Qin,Xinpeng Zhang

DOI: https://doi.org/10.1109/TMM.2021.3056879

IF: 7.3

2022-01-01

IEEE Transactions on Multimedia

Abstract:Most computer vision algorithms require parameter adjustment according to the image noise level. Conventionally, the additive white Gaussian noise (AWGN) model is widely used in most noise estimation algorithms; however, this assumption does not hold in the real world where the noise from cameras is more complex, and it is more appropriate to assume the signal-dependent noise (SDN) model. In this paper, we focus on the SDN model while considering the nonlinear radiometric calibration inside an actual camera, and propose an algorithm to efficiently estimate the noise level function (NLF), which is defined as the noise standard deviation with respect to image intensity. First, the input image is divided into overlapping patches, and noise samples are estimated in the linear transform domain. The confidence levels of the noise samples and the prior of the camera response function are then employed as constraints for the recovery of the NLF. Finally, the noise samples and constraints are represented in a convex optimization problem. The experimental results using both real and synthetic noisy images demonstrate the superiority of the proposed method. In addition, the estimated NLFs are incorporated into two well-known denoising schemes, non-local means and BM3D, and shows significant improvements in denoising SDN-polluted images.
The Estimation of Signal Source Number at Low SNR

李南君,魏平

DOI: https://doi.org/10.3969/j.issn.1674-2230.2009.01.004

2009-01-01

Abstract:A modified method for estimating the signal source number at low SNR is proposed,which based on the orthogonal ability between eigenvectors and steering vectors.This method mainly brings a better criterion to eliminate noise,and with the conventional method of bind beam forming,the proposed modified method is get for estimating the number of sources based on array signal process. The result of simulation based on MATLAB shows that not only under equal power signals but also under not equal power signals,the modified method has better performances than original method,especially at low SNR.
A Blind SNR Estimation Method for Radar Signals

Hong Shu Liao,Lu Gan,Ping Wei

DOI: https://doi.org/10.1049/cp.2009.0169

2009-01-01

Abstract:A blind signal-to-noise ratio (SNR) estimation algorithm is proposed which is based on eigenvalue decomposition of the covariance matrix of received signal and the weighted- average information criterion (WIC). The algorithm can correctly estimate the SNR of linear frequency-modulated (LFM) signal and phase coding signal at low input SNR without prior information of the modulation type and it is insensitive to sample size. Simulation results show the MSE of estimated SNR is less than 0.5 dB for ranging from -10 dB to 10 dB.
Joint and Accurate OSNR Estimation and Modulation Format Identification Scheme Using the Feature-Based ANN

Qian Xiang,Yanfu Yang,Qun Zhang,Yong Yao

DOI: https://doi.org/10.1109/jphot.2019.2929913

IF: 2.4

2019-01-01

IEEE Photonics Journal

Abstract:A joint and accurate optical signal-to-noise ratio (OSNR) estimation and modulation formats identification (MFI) scheme based on the artificial neural network (ANN) is proposed and demonstrated via both simulation and the experiment system. The proposed scheme employs ANN to estimate OSNR and modulation formats from the OSNR and modulation formats dependent features, kurtosis, and amplitude variance. Simulation results show that the proposed scheme can achieve high OSNR estimation and MFI accuracy over wide OSNR ranges for the commonly used modulation formats such as QPSK, 8 quadratic-amplitude modulation (QAM), 16QAM, and 64QAM. Meanwhile, experimental results also indicate that the mean OSNR estimation errors are 0.15 dB, 0.41 dB, and 0.49 dB for QPSK, 8QAM, and 16QAM over wide ranges OSNR of 10-17 dB, 14-20 dB, and 17-25 dB, respectively. Additionally, 100% MFI accuracy for the commonly used modulation formats in our scheme is also confirmed experimentally. Compared with the convolutional neural network and the deep neural network, the proposed scheme shows comparable estimation and identification performance, and needs less computational resource. Therefore, our scheme can be considered an attractive technique for joint OSNR estimation and MFI in future reconfigurable optical networks.

Joint Estimation of Linear and Non-linear Signal-to-Noise Ratio Based on Neural Networks

Joint Channel Estimation and Data Recovery of Communication Systems with Sub-Nyquist Receiver.

Neural Network based Linear and Nonlinear Noise Estimation

Machine Learning Based Linear and Nonlinear Noise Estimation

Fiber Nonlinear Noise-to-Signal Ratio Monitoring Using Artificial Neural Networks

Artificial Neural Networks for Fiber Nonlinear Noise Estimation

Sequential joint signal detection and signal-to-noise ratio estimation

Nonlinear Signal-to-Noise Ratio Estimation in Coherent Optical Fiber Transmission Systems Using Artificial Neural Networks

Frame-Level Signal-to-Noise Ratio Estimation Using Deep Learning

FPGA-based Implementation of Artificial Neural Network for Nonlinear Signal-to-Noise Ratio Estimation

A Grey-box Model for Estimating Nonlinear SNR in Optical Networks Based on Physics-guided Neural Networks

Joint Optimization of the Module and Sign of the Spectral Real Part Based on CRN for Speech Denoising

Low Noise Non-Linear Equalization Using Neural Networks and Belief Propagation

Neural Network Training for OSNR Estimation -- From Prototype to Product

Joint Neural Network Equalizer and Decoder

Joint Estimation of DOA and Range for Near-Field Sources in the Presence of Far-Field Sources and Alpha-Stable Noise

Recurrent Neural Networks and Acoustic Features for Frame-Level Signal-to-Noise Ratio Estimation.

Signal-Dependent Noise Estimation for a Real-Camera Model via Weight and Shape Constraints

The Estimation of Signal Source Number at Low SNR

A Blind SNR Estimation Method for Radar Signals

Joint and Accurate OSNR Estimation and Modulation Format Identification Scheme Using the Feature-Based ANN