

Random Signals and LTI-Systems
🏃🏻 Getting Started Guide
This document can be executed directly on the Bohrium Notebook. To begin, click the Connect button located at the top of the interface, then select the digital-signal-processing:Digital-Signal-Processing-Lecture Image and choose your desired machine configuration to proceed.
📖 Source
This Notebook is from a famous Signal Processing Lecture. The notebooks constitute the lecture notes to the masters course Digital Signal Processing read by Sascha Spors, Institute of Communications Engineering, Universität Rostock.
This jupyter notebook is part of a collection of notebooks on various topics of Digital Signal Processing. Please direct questions and suggestions to Sascha.Spors@uni-rostock.de.
Auto-Correlation Function
The auto-correlation function (ACF) of the output signal of an LTI system is derived. It is assumed that the input signal is a wide-sense stationary (WSS) real-valued random process and that the LTI system has a real-valued impulse repsonse .
Introducing the output relation of an LTI system into the definition of the ACF and rearranging terms yields
where the ACF of the deterministic impulse response is commonly termed as filter ACF. This is related to the link between ACF and convolution. The relation above is known as the Wiener-Lee theorem. It states that the ACF of the output of an LTI system is given by the convolution of the input signal's ACF with the filter ACF . For a system which just attenuates the input signal with , the ACF at the output is given as .
Example - System Response to White Noise
Let's assume that the wide-sense ergodic input signal of an LTI system with impulse response is normal distributed white noise. Introducing and into the Wiener-Lee theorem yields
The example is evaluated numerically for and

Exercise
- Derive the theoretic result for by calculating the filter-ACF .
- Why is the estimated ACF of the output signal not exactly equal to its theoretic result ?
- Change the number of samples
L
and rerun the example. What changes?
Solution: The filter-ACF is given by . The convolution of two rectangular signals results in a triangular signal. Taking the time reversal into account yields
for even . The estimated ACF differs from its theoretic value due to the statistical uncertainties when using random signals of finite length. Increasing its length L
lowers the statistical uncertainties.
Cross-Correlation Function
The cross-correlation functions (CCFs) and between the in- and output signal of an LTI system are derived. As for the ACF it is assumed that the input signal originates from a wide-sense stationary real-valued random process and that the LTI system's impulse response is real-valued, i.e. .
Introducing the convolution into the definition of the CCF and rearranging the terms yields
The CCF between in- and output is given as the time-reversed impulse response of the system convolved with the ACF of the input signal.
The CCF between out- and input is yielded by taking the symmetry relations of the CCF and ACF into account
The CCF between out- and input is given as the impulse response of the system convolved with the ACF of the input signal.
For a system which just attenuates the input signal , the CCFs between input and output are given as and .
System Identification by Cross-Correlation
The process of determining the impulse response or transfer function of a system is referred to as system identification. The CCFs of an LTI system play an important role in the estimation of the impulse response of an unknown system. This is illustrated in the following.
The basic idea is to use a specific measurement signal as input signal to the system. Let's assume that the unknown LTI system is excited by white noise. The ACF of the wide-sense stationary input signal is then given as . According to the relation derived above, the CCF between out- and input for this special choice of the input signal becomes
For white noise as input signal , the impulse response of an LTI system can be estimated by estimating the CCF between its out- and input signals. Using noise as measurement signal instead of a Dirac impulse is beneficial since its crest factor is limited.
Example
The application of the CCF to the identification of a system is demonstrated. The system is excited by wide-sense ergodic normal distributed white noise with . The ACF of the in- and output, as well as the CCF between out- and input is estimated and plotted.



Exercise
- Why is the estimated CCF not exactly equal to the true impulse response of the system?
- What changes if you change the number of samples
N
of the input signal?
Solution: The derived relations for system identification hold for the case of a wide-sense ergodic input signal of infinite duration. Since we can only numerically simulate signals of finite duration, the observed deviations are a result of the resulting statistical uncertainties. Increasing the length N
of the input signal improves the estimate of the impulse response.
Copyright
This notebook is provided as Open Educational Resource. Feel free to use the notebook for your own purposes. The text is licensed under Creative Commons Attribution 4.0, the code of the IPython examples under the MIT license. Please attribute the work as follows: Sascha Spors, Digital Signal Processing - Lecture notes featuring computational examples.



