Automated Multilayer Neural Network Structure Adaptation Method With l_1 Regularization for Microwave Modeling

Weicong Na,Ke Liu,Wanrong Zhang,Feng Feng,Hongyun Xie,Dongyue Jin
DOI: https://doi.org/10.1109/lmwc.2022.3153058
IF: 3
2022-01-01
IEEE Microwave and Wireless Components Letters
Abstract:Artificial neural network (ANN) model development for microwave components principally includes two parts of work, i.e., data sampling and model structure adaptation. In existing various ANN modeling methods, the model structure adaptation process mainly focuses on adjusting the number of neurons within each hidden layer of ANN while keeping the number of layers unchanged. To make the ANN modeling process more flexible and efficient, an automated multilayer neural network structure adaptation method with <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.748ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 752.4 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-6C" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="422" y="-213"></use></g></svg></span> regularization is proposed in this letter. We propose a new ANN model structure combining multilayer perceptron (MLP) and additional connections between the output layer and each hidden layer/input layer. A new training scheme with <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.748ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 752.4 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-6C" x="0" y="0"></use> <use transform="scale(0.707)" xlink:href="#MJMAIN-31" x="422" y="-213"></use></g></svg></span> regularization is proposed to automatically determine the final model structure with user-desired model accuracy. Using the proposed model structure adaptation method, both the number of layers and the number of neurons within each layer of the final ANN model can be adaptively determined to address different needs for different microwave modeling problems. The proposed method is demonstrated by two microwave filter modeling examples in which the model development process achieves a time saving of at least 40% over existing methods.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs></svg>
engineering, electrical & electronic
What problem does this paper attempt to address?