Abstract:This article introduces the deep neural network method into the field of high-dimensional microwave modeling. Deep learning is nowadays highly successful in solving complex and challenging pattern recognition and classification problems. This article investigates the use of deep neural networks to solve microwave modeling problems that are much more challenging than that solved by the previous shallow neural networks. The most commonly used activation function in the existing deep neural network is the rectified linear unit (ReLU), which is a piecewise hard switch function. However, such a ReLU is not suitable for microwave modeling where the input–output relationships are smooth and continuous. In this article, we propose a new deep neural network to perform high-dimensional microwave modeling. A smooth ReLU is proposed for the new deep neural network. The proposed deep neural network employs both the sigmoid function and the smooth ReLU as activation functions. The new deep neural network can represent the smooth input–output relationship that is required for microwave modeling. An advanced three-stage deep learning algorithm is proposed to train the new deep neural network model. This algorithm can determine the number of hidden layers with sigmoid functions and those with smooth ReLUs in the training process. It can also overcome the vanishing gradient problem for training the deep neural network. The proposed deep neural network technique can solve microwave modeling problems in a higher dimension than the previous neural network method, i.e., shallow neural network method. Two high-dimensional parameter-extraction modeling examples of microwave filters are presented to demonstrate the proposed deep neural network technique.

High-Dimensional Inverse Modeling Technique Using Multivalued Deep Neural Network for Parameter Extraction of Microwave Filters

Deep Neural Network Technique for High-Dimensional Microwave Modeling and Applications to Parameter Extraction of Microwave Filters

Artificial Neural Network for Dimensionality Reduction and Its Application to Microwave Filters Inverse Modeling

Multichannel Wavelet Kernel Network for High Dimensional Inverse Modeling of Microwave Filters

Neural Network Inverse Modeling and Applications to Microwave Filter Design

Recent advances in neural network‐based inverse modeling techniques for microwave applications

End‐to‐end Inverse Modeling and Optimization for Filters Based on Artificial Neural Network

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

Inverse Modeling of Filter Using One-Dimensional Convolutional Neural Network

Fourier Subspace-Based Deep Learning Method for Inverse Design of Frequency Selective Surface

Advanced Deep Neural Network Technique for Microwave Parametric Modeling

Modeling of EMI Filter by Means of Recurrent Neural Network with Encoding Layer

1-D Multi-Channel CNN with Transfer Functions for Inverse Electromagnetic Behaviors Modeling and Design Optimization of High-Dimensional Filters

Deep Neural Network-Based Inverse Design of a Novel Reconfigurable Multi-Tap Optical Filter

Deep Neural Network-Based Surrogate-Assisted Inverse Optimization for High-Speed Interconnects

Fast Multi-Physics Simulation of Microwave Filters Via Deep Hybrid Neural Network

Advanced Extrapolation Technique for Neural-Based Microwave Modeling and Design

A Multi-scale Deep Neural Network Technique for Surrogate Modeling of Microwave Components

Parallel Decomposition Approach to Wide-Range Parametric Modeling With Applications to Microwave Filters

A deep neural network based tuning technique of lossy microwave coupled resonator filters

MDLI-Net: Model-Driven Learning Imaging Network for High-Resolution Microwave Imaging with Large Rotating Angle and Sparse Sampling