Application of Important Direction Sampling in Simulation Low Detection Efficiency Problems

李铁柱,陈伯显

DOI: https://doi.org/10.3969/j.issn.0258-0934.2004.03.016

2004-01-01

Abstract:Important direction sampling is an effective variance reduction technique for low detection efficiency problems. Useing statistical estimator, this technique is also adapted to deep-penetration problems.

What problem does this paper attempt to address?

Application of an Improved Adaptive Importance Sampling Method in Extreme Hydrological Analysis

TONG Yang-bin,XU Yue-ping

DOI: https://doi.org/10.3969/j.issn.1000-6788.2012.10.028

2012-01-01

Abstract:This paper proposes an improved adaptive importance sampling method that can be used for variables following a GEV distribution.The L-moment method is employed to build the relationship between sample statistics and distribution parameters.In the case study,the 24-hour design storm of Yungang Basin in Zhejiang Province is considered,and the probability of extreme precipitation is calculated for two rainfall gauge stations,Jinzhuling and Xianrentan.The results show that the proposed method performs well in simulating extreme rainfall,and the iterative number decreases as the number of samples increases.Compared with traditional MC simulation,the improved adaptive importance sampling method has better efficiency.Besides,this method has huge potential to be used for other distributions.
A modified importance sampling scheme for the estimation of detection system performance

S.L. Smith,G.C. Orsak

DOI: https://doi.org/10.1109/26.380183

IF: 6.166

1995-02-01

IEEE Transactions on Communications

Abstract:For many modern detection systems, analytic expressions for the probability of false alarm and/or probability of error are not available. Monte Carlo simulations have often been used as a direct means of estimating these quantities. A technique known as importance sampling can provide a significant reduction in the variance of such estimates. A number of importance sampling biasing z densities have been shown to be effective for problems of interest. A method for further improving the accuracy of importance sampling estimates is presented. This technique utilises additional information available in the simulation to adapt the standard importance sampling estimate based upon specific realizations of the biased inputs. This new methodology is easily implemented and results in an appreciable improvement in the accuracy of the estimator in all examples considered.<>

telecommunications,engineering, electrical & electronic
Improving Importance Sampling Method in Structural Reliability

WL JIN,E LUZ

DOI: https://doi.org/10.1016/0029-5493(94)90222-4

IF: 1.7

1994-01-01

Nuclear Engineering and Design

Abstract:Based on comparing with some existing variance reduced techniques for sampling, an improving importance sampling method for failure probability calculation, which combines the importance sampling technique with the conditional expectation variance reduced technique, is shown in this paper. This improving method can ensure the validation of every sampling simulation procedure, avoid the complicated optimization procedure, and improve the precision and efficiency of simulation estimation.
An Auto-Importance Sampling Method for Deep Penetration Problems

Junli LI,Chunyan LI,Zhen WU,Zhi ZENG,Rui QIU

DOI: https://doi.org/10.15669/pnst.2.732

2011-01-01

Progress in Nuclear Science and Technology

Abstract:For many traditional radiation shielding problems as well as medical and nuclear well-logging applications, it has long been recognized that the analog Monte Carlo is inefficient, which are known especially in deep penetration problems.This arises from the fact that the particles have little chance of contributing to the solution far from the source when using analog procedures.Numerous variance reduction techniques have grown up to overcome this inefficiency.However, there are still some limitations.A further difficulty lies in the potential for biased results due to the misuse of variance reduction techniques or the statistical convergence of Monte Carlo results.Responding to these difficulties, a new variance reduction technique called "auto-importance sampling method" is proposed in this paper.In the new method, the geometry space is divided into sub-spaces by fictitious surfaces.On the fictitious surfaces, fictitious particles are created according to the importance distribution automatically and then they are transported.The particles' number is increased on each fictitious surface.With this method, it is unnecessary to make pre-calculations to test different parameters for the variance reduction technique, or to make another calculation to get the importance distribution.Two examples are simulated with the new method.It can be seen that the new variance reduction technique is very easy to use and the computational efficiency achieved is very encouraging.
DOA Estimation Based on Sparse Signal Recovery Utilizing Double-Threshold Sigmoid Penalty.

Hanbing Wang,Hui Li,Bin Li

DOI: https://doi.org/10.1155/2015/287915

2015-01-01

Journal of Electrical and Computer Engineering

Abstract:This paper proposes a new algorithm based on sparse signal recovery for estimating the direction of arrival (DOA) of multiple sources. The problem model we build is about the sample covariance matrix fitting by unknown source powers. We enhance the sparsity by the double-threshold sigmoid penalty function which can approximate thel0norm accurately. Our method can distinguish closely spaced sources and does not need the knowledge of the number of the sources. In addition, our method can also perform well in low SNR. Besides, our method can handle more sources accurately than other methods. Simulations are done to certify the great performance of the proposed method.
Sampling Inspection Schemes for Continuous Lot Spatial Data

Zhenhua WANG,Xiaohua TONG,Dan LIANG,Huan XIE

DOI: https://doi.org/10.3969/j.issn.0253-374x.2010.05.021

2010-01-01

Abstract:Based on empirical data, acceptance number(c) is calculated by inverse Poisson. A new method is used to calculate sample size n, which uses lot size N and acceptable quality level of process average (AQL). The scheme of continuous spatial data with large lot size is designed (N, n, c). At last, the spatial data schemes, designed on the basis of the developed algorithm, are compared with those designed on the basis of the percent sampling inspection and table. Comparison results verify the merits and the implementary conditions of the developed algorithm.
DOA Estimation of Incoherently Distributed Sources Using Importance Sampling Maximum Likelihood

Tao Wu,Zhenghong Deng,Xiaoxiang Hu,Ao Li,Jiwei Xu

DOI: https://doi.org/10.23919/jsee.2022.000070

IF: 1.363

2022-01-01

Journal of Systems Engineering and Electronics

Abstract:In this paper, an importance sampling maximum likeli-hood (ISML) estimator for direction-of-arrival (DOA) of incohe-rently distributed (ID) sources is proposed. Starting from the maxi-mum likelihood estimation description of the uniform linear array (ULA), a decoupled concentrated likelihood function (CLF) is pre-sented. A new objective function based on CLF which can obtain a closed-form solution of global maximum is constructed according to Pincus theorem. To obtain the optimal value of the objective function which is a complex high-dimensional integral, we propose an importance sampling approach based on Monte Carlo random calculation. Next, an importance function is de-rived, which can simplify the problem of generating random vec-tor from a high-dimensional probability density function (PDF) to generate random variable from a one-dimensional PDF. Com-pared with the existing maximum likelihood (ML) algorithms for DOA estimation of ID sources, the proposed algorithm does not require initial estimates, and its performance is closer to Cramer-Rao lower bound (CRLB). The proposed algorithm performs bet-ter than the existing methods when the interval between sources to be estimated is small and in low signal to noise ratio (SNR) scenarios.
On the theory of importance sampling applied to the analysis of detection systems

G. Orsak,B. Aazhang

DOI: https://doi.org/10.1109/26.20113

IF: 6.166

1989-04-01

IEEE Transactions on Communications

Abstract:Detection systems are designed to operate with optimal or nearly optimal probability of a wrong decision. Analytical solutions of the performance of these systems have been very difficult to obtain. Monte Carlo simulations are often the most tractable method of estimating performance. However, in systems with small probability of error, this technique requires very large amounts of computer time. A technique known as importance sampling substantially reduces the number of simulation trials needed, for a given accuracy, over the standard Monte Carlo method. The theory and application of the importance sampling method in Monte Carlo simulation is considered in a signal detection context. A general method of applying this technique to the optimal detection problem is given. Results show that in cases examined, the gain is approximately proportional to the inverse of the error probability. Applications of the proposed method are not limited to optimum detection systems; analysis, leading to a measure of the gain in using this biasing scheme, shows that in all optimal systems considered, less than 100 trials is needed to achieve estimates with 45% confidence, even for extremely small error probabilities.<>

telecommunications,engineering, electrical & electronic
Vector-angle Geometric Mapping-Based Directional Importance Sampling Method for Reliability Analysis

Wang Junfeng,Chen Jiqing,Zhou Yunjiao,Lan Fengchong,Liu Qingshan

DOI: https://doi.org/10.1007/s00158-022-03217-w

IF: 4.279

2022-01-01

Structural and Multidisciplinary Optimization

Abstract:In reliability analysis, the probability density function (PDF) of the directional importance sampling method is based on a multi-dimensional vector (i.e., multivariate), thus it is inefficient to obtain the important directional vectors (IDVs) by sampling each dimensional component randomly. In this paper, an efficient solution approach of vector-angle geometric mapping is proposed. Firstly, the angles between IDVs and the design point position vector are set as the important direction angles (IDAs) in the standard Gaussian space. By exploring the geometric relationship between IDVs and IDAs, the PDF of multi-dimensional IDV can be converted into the PDF of one-dimensional IDA, following which, the cumulative distribution function of IDA is derived by integration. Further, the cumulative distribution is sampled uniformly using the Latin hypercube technique, and then the uniform IDAs are generated by inversion. Finally, the IDVs are shown by geometric mapping of the IDAs. The research results show that the PDF of IDA is jointly determined by the two parameters, dimensionality and reliability index. Therefore, the distribution characteristics of IDA can be explored and diagrammatically represented, and the obtained IDVs can be used repeatedly for other reliability analysis with the same mentioned parameters to improve the computational efficiency. The applicability, accuracy, and robustness of the proposed approach are proved on illustrative examples, battery pack and truss structure engineering applications.
Importance Sampling in Performance Evaluation of Long Range Dependence Network Traffic

金志刚,舒炎泰,王继东

DOI: https://doi.org/10.3969/j.issn.1004-731x.2002.01.037

2002-01-01

Abstract:This paper proposes the importance sampling technology for performance evaluation of computer networks. The importance sampling theory and the typical algorithm in network simulation are discussed. Given a queue fed by a FARIMA process, the simulation results show that the long range dependence of traffic gives rise to the overflow of queue. The importance sampling significantly reduces the time of simulation. The simulation results are accordance with the analysis result by large deviation technology and other analysis result.
A review of Importance Sampling research

GUO Ying,AI Bo,ZHONG Zhang-dui

DOI: https://doi.org/10.3969/j.issn.1672-2892.2011.05.017

2011-01-01

Abstract:As an effective fast simulation technique in Monte Carlo simulation,Importance Sampling algorithm aims to reduce the variance of a given simulation estimator,so as to reduce the number of simulation samples and the simulation time.In this paper,a short overview of Importance Sampling research is presented,the purpose of research on Importance Sampling and the corresponding basic theory are introduced briefly.Then the Importance Density function is summarized,and some typical application results of Importance Sampling are given.Finally,some crucial issues are proposed for future study.
Compressive Sampling Method Using Resolution Limit on Direction Estimation for MIMO Radar

Peng Yuxing,Chen Haowen,Xu Yi,Wang Hongqiang,Li Xiang

DOI: https://doi.org/10.1016/j.proeng.2012.01.512

2012-01-01

Procedia Engineering

Abstract:In this paper, the direction estimation using compressive sampling (CS) method is investigated for direction finding (DF) multiple-input multiple-output (MIMO) radar, since the direction angles of targets can construct a sparse vector in the angle space. It is obvious that dividing the angle space is very important for this method. Thus, we derive the resolution limit, which is employed in dividing the angle space. Finally, the simulated results validate that the resolution limit is important to the division of angle space.
New variance reduction techniques for Monte-Carlo calculation based on first-collision source method

Zhanpeng Huang,Liangzhi Cao,Qingming He,Hongchun Wu

DOI: https://doi.org/10.1080/00223131.2022.2057367

IF: 1.126

2022-04-11

Journal of Nuclear Science and Technology

Abstract:A new variance-reduction method, called the first-collision source (FCS) method, is proposed to optimize Monte-Carlo source sampling to reduce variance in deep-penetration problems. In the FCS method, Monte-Carlo samples source particles from the first-collision source distribution rather than the original source distribution. The first-collision source is generated from the original source through a transport process and a scatter process, thus it has wider phase space distribution compared with the original source. Sampling from the first-collision source is capable of obtaining source particles near the aim phase space (specific space area, energy segment, and angle segment which are most related to the aim response) to increase particle popularity in aim phase space. Moreover, a new method called the FCS-CADIS method has also been proposed to further improve the sampling efficiency and performance of variance reduction. The FCS-CADIS method combines the FCS method and the Consistent Adjoint Driven Importance Sampling (CADIS) method. Both of the FCS method and the FCS-CADIS method have been implemented in the hybrid Monte-Carlo-Deterministic particle-transport code NECP-MCX. Three problems are used to assess the performance of the FCS method and the FCS-CADIS method. The results show satisfactory improvement of Monte-Carlo calculation efficiency.

nuclear science & technology
Sampling Method for IDS in High Bandwidth Network

宁卓,龚俭,顾文杰

DOI: https://doi.org/10.3321/j.issn:1000-436x.2009.11.004

2009-01-01

Abstract:A novel sampling method,IDSampling,was developed to solve the performance unbalance problem that IDS could not scale well in G+bit/s link,which was adaptive with the consumption of the memory bottleneck.With the help of the heuristic messages,such as the entropy of the single-packet flow and the flow length,IDSampling applied the simple sampling strategy based on the entropy of the single-packet flow when the large-scale anomaly occurred,or another complicated one instructed by the feedback of the rear detection results by default.In both cases IDSampling tried to guaran-tee the equal security with detection cost as low as it could.The results of experiment show that ①IDSampling keeps IDS effective by cutting off its load significantly when it is overloaded,at the same time it can guarantee the detection accuracy of the large-scale attack;②Comparing with the other two overwhelming sampling methods,the random packet sampling and the random flow sampling,the number of attack packets sampled by IDSampling is higher than that of the former two,the number outweighs the former two one order of magnitude especially in the large-scale anomaly case.
A WEIGHT-BOUNDED IMPORTANCE SAMPLING METHOD FOR VARIANCE REDUCTION

Tenchao Yu,Linjun Lu,Jinglai Li

DOI: https://doi.org/10.1615/int.j.uncertaintyquantification.2019029511

IF: 1.544

2019-01-01

International Journal for Uncertainty Quantification

Abstract:Importance sampling (IS) is an important technique to reduce the estimation variance in Monte Carlo simulations. In many practical problems, however, the use of IS method may result in unbounded variance, and thus fail to provide reliable estimates. To address the issue, we propose a method which can prevent the risk of unbounded variance; the proposed method performs the standard IS for the integral of interest in a region only in which the IS weight is bounded and use the result as an approximation to the original integral. It can be verified that the resulting estimator has a finite variance. Moreover, we also provide a normality test based method to identify the region with bounded IS weight (termed as the safe region) from the samples drawn from the standard IS distribution. With numerical examples, we demonstrate that the proposed method can yield rather reliable estimate when the standard IS fails, and it also outperforms the defensive IS, a popular method to prevent unbounded variance.
An Importance Sampling Method with Applications to Rare Event Probability

Yue Qiu,Hong Zhou,Yueqin Wu

DOI: https://doi.org/10.1109/wcica.2008.4593574

2007-01-01

Abstract:It usually takes long time to simulate rare event using traditional Monte Carlo method, while importance sampling techniques can effectively reduce the simulation time and improve simulation efficiency. A new implementation for importance sampling method to estimate rare event probability in simulation models is proposed in this paper, in which the classical exponential change of measure is adopted to construct the family of importance sampling distributions, and the optimal importance sampling distribution is obtained by minimizing the variance of importance sampling estimator. Numerical experiment has been conducted and the result indicates that the method can effectively estimate the rare event probability.
Two-dimensional Direction Finding Algorithm Based on Single-channel Sequential Sampling with Circular Array

MENG Xianghao,LUO Jingqing,WU Shilong

DOI: https://doi.org/10.3969/j.issn.1008-1194.2011.04.013

2011-01-01

Abstract:Aiming at the disadvantages of large amount of computation and low direction-finding accuracy of some direction finding algorithms based on single-channel,a two-dimensional direction finding algorithm based on single-channel sequential sampling with circular array was put forward in this paper.The method took the equivalence of the sampled data obtained by the antennas of circular array to the sampled data of every antenna synchronously,and then signals' DOA was estimated by equivalent weighted MUSIC algorithm.Computer simulation proved that this method had high direction-finding accuracy,and the performance was equal to the multi-channel direction finding algorithms.
An Efficient TDOA and FDOA Based Source Localization Algorithm Via Importance Sampling

Yunlong Wang,Ying Wu,Yuan Shen

DOI: https://doi.org/10.1109/iccchina.2017.8330494

2017-01-01

Abstract:The location and velocity information gives crucial impacts and supports in many applications. In this paper, we address the the problem of source localization based on time-difference-of-arrival (TDOA) and frequency-difference-of-arrival (FDOA) measurements. The nonlinear and nonconvex maximum likelihood estimation can be approximated by Monte Carlo importance sampling technique. We derive the importance function analogous to Gaussian distribution based on Fisher information matrix (FIM) where the global convergence can be guaranteed with sufficient samples. Then we consider the source localization under sensor location uncertainties. The localization information of both sensors and source is jointly estimated by importance sampling. The simulation results illustrate that the proposed method is superior than other existing methods and it can attain the Cramér-Rao lower bound at moderate noise levels.
A Novel Directional Simulation Method for Estimating Failure Possibility

Xia Jiang,Zhenzhou Lu,Michael Beer

DOI: https://doi.org/10.1016/j.ast.2024.109627

IF: 5.457

2024-01-01

Aerospace Science and Technology

Abstract:Failure possibility plays a crucial role in assessing the safety level of structures under fuzzy uncertainty. However, the traditional fuzzy simulation method suffers from computational inefficiency as it requires a large number of samples for accurate estimation. To address this issue, a directional simulation method is proposed to improve the efficiency of estimating failure possibility. The directional simulation method reformulates the failure possibility estimation into two key steps: the generation of direction samples and the estimation of conditional failure possibility under each direction sample in the polar coordinate system of the standard fuzzy space. To ensure direction uniformity, these direction samples are generated by adopting a good lattice point set based on stratified sampling on the unit hypercube. The conditional failure possibility under each direction sample is estimated by solving the minimum root of a nonlinear equation. The proposed method effectively reduces the dimensionality of the fuzzy input and greatly improves the computational efficiency. To further enhance efficiency, an adaptive Kriging model is embedded into the directional simulation method to reduce the number of performance function evaluations. Four examples are performed to illustrate the accuracy and efficiency of the proposed method. The results highlight the superiority of the directional simulation method over the traditional fuzzy simulation method, offering substantial improvements in computational efficiency while maintaining high estimation accuracy.
Estimation of 2-D Direction for MIMO Radar by Compressive Sampling Method Using Resolution Limit

Peng, Yuxing,Wang, Hongqiang,Chen, Haowen,Li, Xiang

DOI: https://doi.org/10.1049/cp.2012.1726

2012-01-01

Abstract:In this paper, the compressive sampling (CS) method is used for two-dimensional (2-D) direction finding (DF) multiple-input multiple-output (MIMO) radar, since the direction angles of targets can construct a sparse vector in the angle space. It is obvious that dividing the angle space is very important for this method. Thus, we derive the resolution limit, which is employed in dividing the angle space. Finally, the simulated results validate that the resolution limit is important to the division of angle space when using CS algorithm. (4 pages)

Application of Important Direction Sampling in Simulation Low Detection Efficiency Problems

Application of an Improved Adaptive Importance Sampling Method in Extreme Hydrological Analysis

A modified importance sampling scheme for the estimation of detection system performance

Improving Importance Sampling Method in Structural Reliability

An Auto-Importance Sampling Method for Deep Penetration Problems

DOA Estimation Based on Sparse Signal Recovery Utilizing Double-Threshold Sigmoid Penalty.

Sampling Inspection Schemes for Continuous Lot Spatial Data

DOA Estimation of Incoherently Distributed Sources Using Importance Sampling Maximum Likelihood

On the theory of importance sampling applied to the analysis of detection systems

Vector-angle Geometric Mapping-Based Directional Importance Sampling Method for Reliability Analysis

Importance Sampling in Performance Evaluation of Long Range Dependence Network Traffic

A review of Importance Sampling research

Compressive Sampling Method Using Resolution Limit on Direction Estimation for MIMO Radar

New variance reduction techniques for Monte-Carlo calculation based on first-collision source method

Sampling Method for IDS in High Bandwidth Network

A WEIGHT-BOUNDED IMPORTANCE SAMPLING METHOD FOR VARIANCE REDUCTION

An Importance Sampling Method with Applications to Rare Event Probability

Two-dimensional Direction Finding Algorithm Based on Single-channel Sequential Sampling with Circular Array

An Efficient TDOA and FDOA Based Source Localization Algorithm Via Importance Sampling

A Novel Directional Simulation Method for Estimating Failure Possibility

Estimation of 2-D Direction for MIMO Radar by Compressive Sampling Method Using Resolution Limit