Abstract:This article introduces the deep neural network method into the field of high-dimensional microwave modeling. Deep learning is nowadays highly successful in solving complex and challenging pattern recognition and classification problems. This article investigates the use of deep neural networks to solve microwave modeling problems that are much more challenging than that solved by the previous shallow neural networks. The most commonly used activation function in the existing deep neural network is the rectified linear unit (ReLU), which is a piecewise hard switch function. However, such a ReLU is not suitable for microwave modeling where the input–output relationships are smooth and continuous. In this article, we propose a new deep neural network to perform high-dimensional microwave modeling. A smooth ReLU is proposed for the new deep neural network. The proposed deep neural network employs both the sigmoid function and the smooth ReLU as activation functions. The new deep neural network can represent the smooth input–output relationship that is required for microwave modeling. An advanced three-stage deep learning algorithm is proposed to train the new deep neural network model. This algorithm can determine the number of hidden layers with sigmoid functions and those with smooth ReLUs in the training process. It can also overcome the vanishing gradient problem for training the deep neural network. The proposed deep neural network technique can solve microwave modeling problems in a higher dimension than the previous neural network method, i.e., shallow neural network method. Two high-dimensional parameter-extraction modeling examples of microwave filters are presented to demonstrate the proposed deep neural network technique.

Inverse Modeling of Filter Using One-Dimensional Convolutional Neural Network

1-D Multi-Channel CNN with Transfer Functions for Inverse Electromagnetic Behaviors Modeling and Design Optimization of High-Dimensional Filters

Neural Network Inverse Modeling and Applications to Microwave Filter Design

End‐to‐end Inverse Modeling and Optimization for Filters Based on Artificial Neural Network

Modeling of EMI Filter by Means of Recurrent Neural Network with Encoding Layer

Multichannel Wavelet Kernel Network for High Dimensional Inverse Modeling of Microwave Filters

Fourier Subspace-Based Deep Learning Method for Inverse Design of Frequency Selective Surface

Deep Neural Network Technique for High-Dimensional Microwave Modeling and Applications to Parameter Extraction of Microwave Filters

Artificial Neural Network for Dimensionality Reduction and Its Application to Microwave Filters Inverse Modeling

Neural Network-Based Surrogate Model for Inverse Design of Metasurfaces

Modeling of LTCC Filter Using Space-Mapping Neural Network Method

Shape Modeling of Microstrip Filters Based on Convolutional Neural Network

Coupling Matrix Extraction of Microwave Filters by Using One-Dimensional Convolutional Autoencoders

Recent advances in neural network‐based inverse modeling techniques for microwave applications

A Learning-Based Methodology for Microwave Passive Component Design

A Multi-scale Deep Neural Network Technique for Surrogate Modeling of Microwave Components

Deep Neural Network-Based Inverse Design of a Novel Reconfigurable Multi-Tap Optical Filter

An Efficient Geometric Parameter Optimization Method for Microstrip Bandpass Filter Based on One-Dimensional Convolutional Neural Network

Coupling Matrix Extraction for Microwave Filter Design Using Neural Networks

Fast Multi-Physics Simulation of Microwave Filters Via Deep Hybrid Neural Network