An introduction to deep learning for electromagnetics

Marco Salucci,Maokun Li,Xudong Chen,Andrea Massa

2022-01-01

Abstract:This chapter provided a gentle introduction to DL, recalling the most used terms in this field as well as describing some of the most widespread architectures in the recent literature and their applications in EM.

What problem does this paper attempt to address?

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

He Ming Yao,Lijun Jiang,Wei E. I. Sha

DOI: https://doi.org/10.1109/lawp.2020.2995455

IF: 4.2

2020-01-01

IEEE Antennas and Wireless Propagation Letters

Abstract:This letter proposes a novel deep learning (DL) approach to resolve the electromagnetic inverse scattering (EMIS) problems. The conventional approaches of resolving EMIS problems encounter assorted difficulties, such as high contrast, high computational cost, inevitable intrinsic nonlinearity, and strong ill-posedness. To surmount these difficulties, a novel DL approach is proposed based on a novel complex-valued deep fully convolutional neural network structure. The proposed complex-valued deep learning model for solving EMIS problems composes of an encoder network and its corresponding decoder network, followed by a final pixel-wise regression layer. The complex-valued encoder network extracts feature fragments from received scattered field data, while the role of the complex-valued decoder network is mapping the feature fragments to retrieve the final contrasts (permittivities) of dielectric scatterers. Hence, the proposed deep learning model functions as an "heterogeneous" transformation process, where measured scattering field data is converted into the corresponding contrasts of scatterers. As a consequence, the EMIS problem could be resolved accurately even for extremely high-contrast targets. Numerical benchmarks have illustrated the feasibility and accuracy of our proposed approach. The proposed approach opens a novel path for the deep learning-based real-time quantitative microwave imaging for high-contrast scatterers.
Concluding remarks, open challenges, and future trends

Marco Salucci,Maokun Li

2022-01-01

Abstract:Throughout this book, we have seen how deep learning (DL) has recently become a very active research field in many electromagnetic (EM) engineering applications [1-4]. DL algorithms are sophisticated machine learning (ML) techniques that try to mimic human brains to learn how to accurately solve a given task with extraordinary efficiency, robustness, and reliability [5-8]. However, their application to EM problems is nowadays in its very early stages and their development is significantly less mature than in other fields (e.g., speech, image, and text recognition).In this concluding chapter, we try to summarize the main pros and cons of DL, together with the main challenges that still need to be solved in such an emerging research field. Finally, some future trends are briefly discussed as well, hopefully fostering future research in using this very powerful paradigm to address paramount challenges in many EM-related areas.
DNNs as Applied to Electromagnetics, Antennas, and Propagation - A Review

Andrea Massa,Davide Marcantonio,Xudong Chen,Maokun Li,Marco Salucci

DOI: https://doi.org/10.1109/LAWP.2019.2916369

IF: 4.2

2019-01-01

IEEE Antennas and Wireless Propagation Letters

Abstract:A review of the most recent advances in deep learning (DL) as applied to electromagnetics (EM), antennas, and propagation is provided. It is aimed at giving the interested readers and practitioners in EM and related applicative fields some useful insights on the effectiveness and potentialities of deep neural networks (DNNs) as computational tools with unprecedented computational efficiency. The r...
An End-to-End Neural Network for Complex Electromagnetic Simulations

Menglin Zhai,Yaobo Chen,Longting Xu,Wen-Yan Yin

DOI: https://doi.org/10.1109/lawp.2023.3294499

2023-01-01

Abstract:Although many numerical methods can accurately solve time-domain electromagnetic (EM) simulation problems, such as finite-difference time-domain (FDTD), the computational demands are usually significant for complex scenarios. In this letter, we investigate the feasibility of applying deep learning technology to accurately solving EM forward simulations. Based on an end-to-end neural network framework, a convolutional neural network is used to extract features of scatters, and a long short-term memory neural network is used to predict EM distributions. To ensure the accuracy of the framework, especially when dealing with complicated phenomena, principal component analysis is employed to compress data sets before training. Numerical experiments show that the proposed scheme can predict EM field distributions efficiently and accurately for complex scenarios containing scatters of different materials, locations, geometrical shapes, and random numbers. The average relative mean square error is around 8. 05e−5 for scenarios with certain number of scatters and 2.25e−4 for random number of scatters respectively, which outperforms other neural network frameworks. Meanwhile, compared with FDTD, the time speedup is around 1528 times.
Machine Learning Methodology Review for Computational Electromagnetics

He Ming Yao,Lijun Jiang,Huan,Wei E. Sha

DOI: https://doi.org/10.23919/aces48530.2019.9060439

2019-01-01

Abstract:While machine learning is revolutionizing every corner of modern technologies, we have been attempting to explore whether machine learning methods could be used in computational electromagnetic (CEM). In this paper, five efforts in line with this direction are reviewed. They include forward methods such as the method of moments (MoM) solved by the artificial neural network training process, FDTD PML (perfectly matched layer) using the hyperbolic tangent basis function (HTBF), etc. There are also inverse problems that use the deep ConvNets for the effective source reconstruction and subwavelength imaging in the far-field. Benchmarks are provided to demonstrate the feasibility of all explorations. The reviewed works are attempting to open the new path for employing machine learning in the modern CEM.
Deep Learning: A Powerful Framework for the Real-Time Solution of Inverse Scattering Problems

Andrea Massa,Xudong Chen,Maokun Li,Alessandro Polo,Pietro Rosatti,Marco Salucci

DOI: https://doi.org/10.1109/aps/ursi47566.2021.9704174

2021-01-01

Abstract:This work deals with the real-time retrieval of the electromagnetic ( $EM$ ) properties of an inaccessible domain starting from non-invasive measurements. Within this context, deep learning ( $DL$ ) is rapidly emerging as a powerful paradigm to solve inverse scattering ( $IS$ ) and imaging problems on a pixel-basis with unprecedented computational efficiency and accuracy. Accordingly, the main principles and fundamental aspects of the most diffused deep neural network ( $DNN$ ) architectures [i.e., convolutional neural networks ( $CNN\mathrm{s}$ )] are briefly summarized, and an overview of the most recent works in this promising field of research is given. Paramount unsolved challenges are finally discussed to indicate some possible lines-of-research to overcome current limitations of $DL$ strategies as applied to $IS$ and imaging.
Deep learning techniques for electromagnetic forward modeling

Tao Shan,Maokun Li

2022-01-01

Abstract:In this chapter, we introduce the approaches of applying deep learning techniques to electromagnetic forward modeling. These approaches are divided into three types: fully data-driven forward modeling, deep learning-assisted forward modeling, and physics inspired forward modeling. In fully data-driven forward modeling, the deep neural networks demonstrate powerful learning capacity and approximating ability to learn and abstract the inner physical laws from the massive training data. In deep learning-assisted forward modeling, the learning tasks of the deep neural networks are simplified and made explicit based on the physical or mathematical models. Thus, the performance of the deep neural networks is further improved and the forward modeling assisted by deep learning boasts better computational efficiency and precision. The physics-inspired forward modeling focuses on the inner reasoning of the deep neural networks to enable effective deep learning models for electromagnetics. The design and training of the deep neural networks are guided, motivated, or inspired by the mathematical or physical models for better robustness and interpretability.
Application of Deep Learning in Near Field of EMI Scanning

Dong-Hao Han,Xing-Chang Wei

DOI: https://doi.org/10.1109/aces-china62474.2024.10699607

2024-01-01

Abstract:In this paper, we present a brief summary of two implementations of deep learning in the field of near-field scanning technology for electromagnetic interference (EMI), specifically focusing on the near field to near field transformation and near field to far field transformation. Sufficient data is acquired through a randomly distributed dipoles array for deep learning training purposes. These two applications demonstrate significant potential in the EMI domain and offer innovative solutions for addressing EMI challenges.
Deep architectures

Marco Gori,Alessandro Betti,Stefano Melacci

DOI: https://doi.org/10.1016/b978-0-32-389859-1.00012-x

IF: 5.414

2024-01-01

Machine Learning

Abstract:In this chapter, we give foundations on feedforward neural networks and incorporate some new recent developments on deep learning. This is a central topic in machine learning both for foundational and applicative implications. From the foundational side, it has been the subject of a multifacet analysis involving, among others, computational geometry, circuit theory, circuit complexity, approximation theory, optimization theory, and statistics. The impact that feedforward networks have been experiencing, however, is likely to be due mostly to their application in an impressive number of different domains.

computer science, artificial intelligence
Deep Learning: An Introduction for Applied Mathematicians

Catherine F. Higham,Desmond J. Higham

DOI: https://doi.org/10.1137/18M1165748

IF: 10.2

2019-11-06

SIAM Review

Abstract:Multilayered artificial neural networks are becoming a pervasive tool in a host of application fields. At the heart of this deep learning revolution are familiar concepts from applied and computati...

mathematics, applied
Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Omar Khatib,Simiao Ren,Jordan Malof,Willie J. Padilla

DOI: https://doi.org/10.1002/adfm.202101748

IF: 19

2021-05-28

Advanced Functional Materials

Abstract:<p>Deep neural networks (DNNs) are empirically derived systems that have transformed traditional research methods, and are driving scientific discovery. Artificial electromagnetic materials (AEMs)—including electromagnetic metamaterials, photonic crystals, and plasmonics—are research fields where DNN results valorize the data driven approach; especially in cases where conventional methods have failed. In view of the great potential of deep learning for the future of artificial electromagnetic materials research, the status of the field with a focus on recent advances, key limitations, and future directions is reviewed. Strategies, guidance, evaluation, and limits of using deep networks for both forward and inverse AEM problems are presented.</p>

materials science, multidisciplinary,chemistry, physical,physics, applied, condensed matter,nanoscience & nanotechnology
Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions

Mohammad Mustafa Taye

DOI: https://doi.org/10.3390/computers12050091

2023-04-25

Computers

Abstract:In recent years, deep learning (DL) has been the most popular computational approach in the field of machine learning (ML), achieving exceptional results on a variety of complex cognitive tasks, matching or even surpassing human performance. Deep learning technology, which grew out of artificial neural networks (ANN), has become a big deal in computing because it can learn from data. The ability to learn enormous volumes of data is one of the benefits of deep learning. In the past few years, the field of deep learning has grown quickly, and it has been used successfully in a wide range of traditional fields. In numerous disciplines, including cybersecurity, natural language processing, bioinformatics, robotics and control, and medical information processing, deep learning has outperformed well-known machine learning approaches. In order to provide a more ideal starting point from which to create a comprehensive understanding of deep learning, also, this article aims to provide a more detailed overview of the most significant facets of deep learning, including the most current developments in the field. Moreover, this paper discusses the significance of deep learning and the various deep learning techniques and networks. Additionally, it provides an overview of real-world application areas where deep learning techniques can be utilised. We conclude by identifying possible characteristics for future generations of deep learning modelling and providing research suggestions. On the same hand, this article intends to provide a comprehensive overview of deep learning modelling that can serve as a resource for academics and industry people alike. Lastly, we provide additional issues and recommended solutions to assist researchers in comprehending the existing research gaps. Various approaches, deep learning architectures, strategies, and applications are discussed in this work.
Deep Learning with Attention Mechanism for Electromagnetic Inverse Scattering

Lizhen Yang,Han Wang,Mingjie Pang,Yankai Jiang,Hai Lin

DOI: https://doi.org/10.1109/ap-s/usnc-ursi47032.2022.9886637

2022-01-01

Abstract:In this paper, a new deep learning technique is investigated to improve the solution of electromagnetic inverse scattering problems (ISPs). The basic idea of this technique is to introduce the attention mechanism to U-Net. By doing this, the deep learning model can automatically learn to focus on target areas of the measured scattered field matrix. In this way, the proposed technique can offer higher accuracy and faster convergence compared with the traditional deep learning networks. Numerical results validate the efficacy of the proposed technique.
An Introduction to Deep Learning in Medical Physics: Advantages, Potential, and Challenges

Chenyang Shen,Dan Nguyen,Zhiguo Zhou,Steve B. Jiang,Bin Dong,Xun Jia

DOI: https://doi.org/10.1088/1361-6560/ab6f51

IF: 3.5

2020-01-01

Physics in Medicine and Biology

Abstract:As one of the most popular approaches in artificial intelligence, deep learning (DL) has attracted a lot of attention in the medical physics field over the past few years. The goals of this topical review article are twofold. First, we will provide an overview of the method to medical physics researchers interested in DL to help them start the endeavor. Second, we will give in-depth discussions on the DL technology to make researchers aware of its potential challenges and possible solutions. As such, we divide the article into two major parts. The first part introduces general concepts and principles of DL and summarizes major research resources, such as computational tools and databases. The second part discusses challenges faced by DL, present available methods to mitigate some of these challenges, as well as our recommendations.
Physics-Informed Deep Learning for Time-Domain Electromagnetic Radiation Problem

Yingze Ge,Liangshuai Guo,Maokun Li

DOI: https://doi.org/10.1109/imbioc52515.2022.9790302

2022-01-01

Abstract:We explore the application of physics-informed deep learning to solve time-domain electromagnetic problems. This method takes advantage of the differentiability of neural networks and fully integrated with first principles. Compared to traditional approach, there is no need of discretization. Numerical experiment verifies the accuracy of this scheme.
An Introduction to Neural Networks and Deep Learning

Heung-Il Suk

DOI: https://doi.org/10.1016/b978-0-12-810408-8.00002-x

2017-01-01

Abstract:Artificial neural networks, conceptually and structurally inspired by neural systems, are of great interest along with deep learning, thanks to their great successes in various fields including medical imaging analysis. In this chapter, we describe the fundamental concepts and ideas of (deep) neural networks and explain algorithmic advances to learn network parameters efficiently by avoiding overfitting. Specifically, this chapter focuses on introducing (i) feed-forward neural networks, (ii) gradient descent-based parameter optimization algorithms, (iii) different types of deep models, (iv) technical tricks for fast and robust training of deep models, and (v) open source deep learning frameworks for quick practice.
Machine Learning in Electromagnetics with Applications to Biomedical Imaging: A Review

Maokun Li,Rui Guo,Ke Zhang,Zhichao Lin,Fan Yang,Shenheng Xu,Xudong Chen,Andrea Massa,Aria Abubakar

DOI: https://doi.org/10.1109/map.2020.3043469

IF: 3.179

2021-01-01

IEEE Antennas and Propagation Magazine

Abstract:Biomedical imaging is a relevant noninvasive technique aimed at generating an image of the biological structure under analysis. The arising visual representation of the characteristics of the object is affected by both the measurement process and reconstruction algorithm. This procedure can be considered as a hybridization of data information, measurement physics, and prior information.
Deep-Learning-Equipped Iterative Solution of Electromagnetic Scattering from Dielectric Objects

Bo-Wen Xue,Rui Guo,Mao-Kun Li,Sheng Sun,Xiao-Min Pan

DOI: https://doi.org/10.1109/tap.2023.3264701

IF: 5.7

2023-01-01

IEEE Transactions on Antennas and Propagation

Abstract:Deep-learning (DL)-equipped iterators are developed to accelerate the iterative solution of electromagnetic scattering problems. In proposed iterators, DL blocks consisting of U-nets are employed to replace the nonlinear process of the traditional iterators, i.e., the conjugate gradient (CG) method and the generalized minimal residual (GMRES) method. New implementations of the complex-valued batch normalization in the U-net are proposed and investigated in terms of the DL-equipped iterators. Numerical results show that the DL-equipped iterators outperform their traditional counterparts in terms of computational time under comparable accuracy since the phase information of the currents, fields, and permittivity is properly handled.
An Introduction to Deep Learning for the Physical Layer

Timothy O’Shea,Jakob Hoydis,Timothy O'Shea

DOI: https://doi.org/10.1109/tccn.2017.2758370

IF: 6.359

2017-12-01

IEEE Transactions on Cognitive Communications and Networking

Abstract:We present and discuss several novel applications of deep learning for the physical layer. By interpreting a communications system as an autoencoder, we develop a fundamental new way to think about communications system design as an end-to-end reconstruction task that seeks to jointly optimize transmitter and receiver components in a single process. We show how this idea can be extended to networks of multiple transmitters and receivers and present the concept of radio transformer networks as a means to incorporate expert domain knowledge in the machine learning model. Lastly, we demonstrate the application of convolutional neural networks on raw IQ samples for modulation classification which achieves competitive accuracy with respect to traditional schemes relying on expert features. This paper is concluded with a discussion of open challenges and areas for future investigation.

An introduction to deep learning for electromagnetics

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

Concluding remarks, open challenges, and future trends

DNNs as Applied to Electromagnetics, Antennas, and Propagation - A Review

An End-to-End Neural Network for Complex Electromagnetic Simulations

Machine Learning Methodology Review for Computational Electromagnetics

Deep Learning: A Powerful Framework for the Real-Time Solution of Inverse Scattering Problems

Deep learning techniques for electromagnetic forward modeling

Application of Deep Learning in Near Field of EMI Scanning

Deep architectures

Deep Learning: An Introduction for Applied Mathematicians

Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions

Deep Learning with Attention Mechanism for Electromagnetic Inverse Scattering

An Introduction to Deep Learning in Medical Physics: Advantages, Potential, and Challenges

Physics-Informed Deep Learning for Time-Domain Electromagnetic Radiation Problem

An Introduction to Neural Networks and Deep Learning

Machine Learning in Electromagnetics with Applications to Biomedical Imaging: A Review

Deep-Learning-Equipped Iterative Solution of Electromagnetic Scattering from Dielectric Objects

An Introduction to Deep Learning for the Physical Layer