Abstract:This article introduces the deep neural network method into the field of high-dimensional microwave modeling. Deep learning is nowadays highly successful in solving complex and challenging pattern recognition and classification problems. This article investigates the use of deep neural networks to solve microwave modeling problems that are much more challenging than that solved by the previous shallow neural networks. The most commonly used activation function in the existing deep neural network is the rectified linear unit (ReLU), which is a piecewise hard switch function. However, such a ReLU is not suitable for microwave modeling where the input–output relationships are smooth and continuous. In this article, we propose a new deep neural network to perform high-dimensional microwave modeling. A smooth ReLU is proposed for the new deep neural network. The proposed deep neural network employs both the sigmoid function and the smooth ReLU as activation functions. The new deep neural network can represent the smooth input–output relationship that is required for microwave modeling. An advanced three-stage deep learning algorithm is proposed to train the new deep neural network model. This algorithm can determine the number of hidden layers with sigmoid functions and those with smooth ReLUs in the training process. It can also overcome the vanishing gradient problem for training the deep neural network. The proposed deep neural network technique can solve microwave modeling problems in a higher dimension than the previous neural network method, i.e., shallow neural network method. Two high-dimensional parameter-extraction modeling examples of microwave filters are presented to demonstrate the proposed deep neural network technique.

Modeling and Optimization of Microwave Circuits and Devices Using Wavelet Neural Networks

Neural Network Inverse Modeling and Applications to Microwave Filter Design

Neural Network-Based Surrogate Model for Inverse Design of Metasurfaces

Behavioral Modeling of Wideband RF Power Amplifiers Using Complex-valued Wavelet Networks

Recent advances in neural network‐based inverse modeling techniques for microwave applications

Advanced Extrapolation Technique for Neural-Based Microwave Modeling and Design

Deep Neural Network Technique for High-Dimensional Microwave Modeling and Applications to Parameter Extraction of Microwave Filters

EM Optimization of Microwave Filter based on Long Short-Term Memory- Feedforward Neural Network and Transfer Functions

End‐to‐end Inverse Modeling and Optimization for Filters Based on Artificial Neural Network

A Wiener-Type Dynamic Neural Network Approach to the Modeling of Nonlinear Microwave Devices

A deep neural network based tuning technique of lossy microwave coupled resonator filters

Artificial neural networks for RF and microwave design - from theory to practice

Artificial Neural Networks for Microwave Computer-Aided Design: The State of the Art

WaveY-Net: Physics-augmented deep learning for high-speed electromagnetic simulation and optimization

EM-Based Optimization of Microwave Circuits Using Artificial Neural Networks: The State-of-the-Art

A Learning-Based Methodology for Microwave Passive Component Design

An Efficient Hybrid Sampling Method for Neural Network-Based Microwave Component Modeling and Optimization

A Fast Surrogate Model-Based Algorithm Using Multilayer Perceptron Neural Networks for Microwave Circuit Design

Parametric Modeling of EM Behavior of Microwave Components Using Combined Neural Networks and Pole-Residue-Based Transfer Functions

A Novel Modeling Approach for All-Dielectric Metasurfaces Using Deep Neural Networks