Abstract:This article introduces the deep neural network method into the field of high-dimensional microwave modeling. Deep learning is nowadays highly successful in solving complex and challenging pattern recognition and classification problems. This article investigates the use of deep neural networks to solve microwave modeling problems that are much more challenging than that solved by the previous shallow neural networks. The most commonly used activation function in the existing deep neural network is the rectified linear unit (ReLU), which is a piecewise hard switch function. However, such a ReLU is not suitable for microwave modeling where the input–output relationships are smooth and continuous. In this article, we propose a new deep neural network to perform high-dimensional microwave modeling. A smooth ReLU is proposed for the new deep neural network. The proposed deep neural network employs both the sigmoid function and the smooth ReLU as activation functions. The new deep neural network can represent the smooth input–output relationship that is required for microwave modeling. An advanced three-stage deep learning algorithm is proposed to train the new deep neural network model. This algorithm can determine the number of hidden layers with sigmoid functions and those with smooth ReLUs in the training process. It can also overcome the vanishing gradient problem for training the deep neural network. The proposed deep neural network technique can solve microwave modeling problems in a higher dimension than the previous neural network method, i.e., shallow neural network method. Two high-dimensional parameter-extraction modeling examples of microwave filters are presented to demonstrate the proposed deep neural network technique.

A deep neural network based tuning technique of lossy microwave coupled resonator filters

Coupling Matrix Extraction for Microwave Filter Design Using Neural Networks

Design of multilayer triangular substrate integrated waveguide filter in LTCC

A Novel Ltcc Multilayer Siw Linear Phase Filter

Broadband Filter Based on Stub-Loaded Ridge Substrate Integrated Waveguide (SIW) in Low Temperature Cofired Ceramic (LTCC)

Substrate Integrated Waveguide Filter with Flat Passband Based on Complex Couplings

End‐to‐end Inverse Modeling and Optimization for Filters Based on Artificial Neural Network

Computer-Aided Tuning of Highly Lossy Microwave Filters Using Complex Coupling Matrix Decomposition and Extraction.

Deep Neural Network Technique for High-Dimensional Microwave Modeling and Applications to Parameter Extraction of Microwave Filters

Neural Network Inverse Modeling and Applications to Microwave Filter Design

Deep Neural Network-Based Inverse Design of a Novel Reconfigurable Multi-Tap Optical Filter

EM Optimization of Microwave Filter based on Long Short-Term Memory- Feedforward Neural Network and Transfer Functions

A Learning-Based Methodology for Microwave Passive Component Design

An Efficient Geometric Parameter Optimization Method for Microstrip Bandpass Filter Based on One-Dimensional Convolutional Neural Network

Millimeter-wave Micromachined Filter Design by Artificial Neural Network Modeling Technique

A Fast Surrogate Model-Based Algorithm Using Multilayer Perceptron Neural Networks for Microwave Circuit Design

Modeling of LTCC Filter Using Space-Mapping Neural Network Method

A Multi-scale Deep Neural Network Technique for Surrogate Modeling of Microwave Components

Modeling and Optimization of Microwave Circuits and Devices Using Wavelet Neural Networks

Recent advances in neural network‐based inverse modeling techniques for microwave applications