A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

Ling Zhang,Da Li,Jiayi He,Bhyrav Mutnury,Bo Pu,Xiao-Ding Cai,Chulsoon Hwang,Jun Fan,James Drewniak,Er-Ping Li
DOI: https://doi.org/10.1109/emcsi39492.2022.9889587
2022-01-01
Abstract:Deep neural networks (DNNs) have been widely adopted in modeling electromagnetic compatibility (EMC) problems, but the training data acquisition is usually timeconsuming through various simulators. This paper presents a powerful approach using an ensemble of DNNs to effectively reduce the training data size in DNN-based modeling problems. A batch of training data with the largest uncertainties is selected using active learning through the variance among the ensemble of DNNs. Subsequently, a greedy sampling algorithm is applied to select a data subset using diversity. Thus, the proposed method can achieve both uncertainty and diversity in data selection. By averaging the outputs of the DNN ensemble, the prediction error can be further reduced. Simple mathematical functions are used to validate the proposed method, and a high-dimensional stripline modeling problem also demonstrates the effectiveness of this DNN-ensemble approach. The proposed method is task agnostic and can be used in other surrogate modeling problems with DNNs.
What problem does this paper attempt to address?