Abstract:Problems of linear system identification have closed-form solutions, e.g., using least-squares or maximum-likelihood methods on input-output data. However, already the seemingly simplest problems of nonlinear system identification present more difficulties related to the optimisation of the furrowed error surface. Those cases include the Hammerstein plant with typically a bilinear model representation based on polynomial or Fourier expansion of its nonlinear element. Wiener plants induce actual nonlinearity in the parameters, which further complicates the optimisation. Neural network models and related optimisers are, however, well-prepared to represent and solve nonlinear problems. Unfortunately, the available data for nonlinear system identification might be too diverse to support accurate and consistent model representation. This diversity may refer to different impulse responses and nonlinear functions that arise in different measurements of (different) plants. We therefore propose multikernel neural network models to represent nonlinear plants with a subset of trainable weights shared between different measurements and another subset of plant-specific (i.e., multikernel) weights to adhere to the characteristics of specific measurements. We demonstrate that in this way we can fit neural network models to the diverse data which cannot be done with some standard methods of nonlinear system identification. For model testing, the subset of shared weights of the entire trained model is reused to support the identification and representation of unseen plant measurements, while the plant-specific model weights are readjusted to specifically meet the test data.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in interference cancellation applications, how to effectively identify and model multiplant nonlinear systems, especially when the available data set contains different impulse responses and nonlinear functions in different measurement results, how to ensure the accuracy and consistency of the model.
### Problem Background
1. **Linear System Identification**: Linear system identification problems usually have closed - form solutions, such as using the least - squares method or maximum - likelihood estimation. However, nonlinear system identification problems are more complex, especially when difficulties are encountered in optimizing the error surface.
2. **Types of Nonlinear Systems**:
- **Hammerstein Plants**: Their nonlinear elements are usually represented based on polynomial or Fourier expansion.
- **Wiener Plants**: The parameters have actual nonlinearity, which further increases the optimization difficulty.
3. **Advantages and Challenges of Neural Networks**: Although neural network models and their optimizers can well represent and solve nonlinear problems, the data used for nonlinear system identification may be too diverse, resulting in difficulty in obtaining accurate and consistent model representations.
### Solutions Proposed in the Paper
To address the above problems, the author proposes a framework based on multikernel neural networks, aiming to represent shared and plant - specific behaviors. Specifically:
- **Shared Weights**: A part of the trainable weights are shared among different measurements to capture general features.
- **Specific Weights**: Another part of the weights are specific to each plant (i.e., multikernel weights) to adapt to the characteristics of specific measurements.
Through this method, the neural network model can better fit diverse data and maintain good generalization ability when testing new plant measurements. In addition, this method has been verified in practical application scenarios such as acoustic echo cancellation (AEC) and self - interference cancellation (SIC).
### Key Innovation Points
1. **Multikernel Neural Network**: Combines shared weights and specific weights, and can perform effective model representation among different plants.
2. **Flexible Model Architecture**: Applicable to different types of nonlinear system structures (such as Wiener, Hammerstein, etc.).
3. **Verification in Practical Applications**: Experimental verification has been carried out through real - data sets (such as the AEC challenge database and the WLAN toolbox), demonstrating its effectiveness in actual interference cancellation tasks.
In summary, this paper aims to solve the challenges brought by data diversity in nonlinear system identification and proposes a multikernel neural network framework to improve the accuracy and generalization ability of the model.