Meteor Head Echo Detection at Multiple High‐Power Large‐Aperture Radar Facilities via a Convolutional Neural Network Trained on Synthetic Radar Data

T. Hedges,N. Lee,S. Elschot

DOI: https://doi.org/10.1029/2023ja032204

2024-03-30

Journal of Geophysical Research Space Physics

Abstract:Journal of Geophysical Research: Space Physics, Volume 129, Issue 4, April 2024.

astronomy & astrophysics

What problem does this paper attempt to address?

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

Zhihui Cao,Wenwei Fang,Yuying Song,Lai He,Chunyi Song,Zhiwei Xu

DOI: https://doi.org/10.1109/TGRS.2021.3113302

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Multitarget detection is very challenging, especially when targets are densely distributed. In conventional constant false alarm rate (CFAR) detection algorithms, the detection threshold is determined based on a pre-estimated background level (BL). However, interfering targets inevitably lead to inaccurate BL estimation, resulting in degraded detection performance. In our previous work, a new solution was developed and verified to be effective; in that solution, compressed sensing (CS)-based detector performs target detection without relying on BL estimation, and a subsequent CFAR regulation processor achieves the desired false alarm rate based on the statistical information of the reduced samples obtained by removing the detected targets and adjacent guard cells from the original samples. However, for scenes with a high target density, the CS-based detector suffers from performance degradation while acquiring the correlation between linear measurements of the signal and the sensing matrix due to the high local signal sparsity. To address this shortcoming, this article proposes a deep neural network (DNN)-based detector that further improves the detection performance by converting the target detection into a problem of peak sequence classification of frequency intensity (FI) measurements from radar. A DNN detector trained on augmented simulated data shows excellent generalization ability for deployment in real scenes. In addition, to achieve better computational efficiency, a Taylor-series-based approximate maximum likelihood estimator with an explicit expression is applied in the CFAR regulation process for the first time. Both simulation and field tests are performed to verify the superiority of the proposed algorithm over conventional algorithms.
High Resolution Point Clouds from mmWave Radar

Akarsh Prabhakara,Tao Jin,Arnav Das,Gantavya Bhatt,Lilly Kumari,Elahe Soltanaghaei,Jeff Bilmes,Swarun Kumar,Anthony Rowe

DOI: https://doi.org/10.48550/arXiv.2206.09273

IF: 3.7

2022-06-18

Robotics

Abstract:This paper explores a machine learning approach for generating high resolution point clouds from a single-chip mmWave radar. Unlike lidar and vision-based systems, mmWave radar can operate in harsh environments and see through occlusions like smoke, fog, and dust. Unfortunately, current mmWave processing techniques offer poor spatial resolution compared to lidar point clouds. This paper presents RadarHD, an end-to-end neural network that constructs lidar-like point clouds from low resolution radar input. Enhancing radar images is challenging due to the presence of specular and spurious reflections. Radar data also doesn't map well to traditional image processing techniques due to the signal's sinc-like spreading pattern. We overcome these challenges by training RadarHD on a large volume of raw I/Q radar data paired with lidar point clouds across diverse indoor settings. Our experiments show the ability to generate rich point clouds even in scenes unobserved during training and in the presence of heavy smoke occlusion. Further, RadarHD's point clouds are high-quality enough to work with existing lidar odometry and mapping workflows.
Deep Convolutional Neural Network for Meteorology Target Detection in Airborne Weather Radar Images

Chaopeng Yu,Wei Xiong,Xiaoqing Li,Lei Dong

DOI: https://doi.org/10.23919/jsee.2023.000142

2023-01-01

Abstract:Considering the problem that the scattering echo images of airborne Doppler weather radar are often reduced by ground clutters, the accuracy and confidence of meteorology target detection are reduced. In this paper, a deep convolutional neural network (DCNN) is proposed for meteorology target detection and ground clutter suppression with a large collection of airborne weather radar images as network input. For each weather radar image, the corresponding digital elevation model (DEM) image is extracted on basis of the radar antenna scanning parameters and plane position, and is further fed to the network as a supplement for ground clutter suppression. The features of actual meteorology targets are learned in each bottle-neck module of the proposed network and convolved into deeper iterations in the forward propagation process. Then the network parameters are updated by the back propagation iteration of the training error. Experimental results on the real measured images show that our proposed DCNN outperforms the counterparts in terms of six evaluation factors. Meanwhile, the network outputs are in good agreement with the expected meteorology detection results (labels). It is demonstrated that the proposed network would have a promising meteorology observation application with minimal effort on network variables or parameter changes.
Development and Interpretation of a Neural Network-Based Synthetic Radar Reflectivity Estimator Using GOES-R Satellite Observations

Kyle A. Hilburn,Imme Ebert-Uphoff,Steven D. Miller

DOI: https://doi.org/10.48550/arXiv.2004.07906

2020-04-17

Abstract:The objective of this research is to develop techniques for assimilating GOES-R Series observations in precipitating scenes for the purpose of improving short-term convective-scale forecasts of high impact weather hazards. Whereas one approach is radiance assimilation, the information content of GOES-R radiances from its Advanced Baseline Imager (ABI) saturates in precipitating scenes, and radiance assimilation does not make use of lightning observations from the GOES Lightning Mapper (GLM). Here, a convolutional neural network (CNN) is developed to transform GOES-R radiances and lightning into synthetic radar reflectivity fields to make use of existing radar assimilation techniques. We find that the ability of CNNs to utilize spatial context is essential for this application and offers breakthrough improvement in skill compared to traditional pixel-by-pixel based approaches. To understand the improved performance, we use a novel analysis methodology that combines several techniques, each providing different insights into the network's reasoning. Channel withholding experiments and spatial information withholding experiments are used to show that the CNN achieves skill at high reflectivity values from the information content in radiance gradients and the presence of lightning. The attribution method, layer-wise relevance propagation, demonstrates that the CNN uses radiance and lightning information synergistically, where lightning helps the CNN focus on which neighboring locations are most important. Synthetic inputs are used to quantify the sensitivity to radiance gradients, showing that sharper gradients produce a stronger response in predicted reflectivity. Finally, geostationary lightning observations are found to be uniquely valuable for their ability to pinpoint locations of strong radar echoes.

Atmospheric and Oceanic Physics,Machine Learning
Target recognition algorithm based on HRRP time-spectrogram feature and multi-scale asymmetric convolutional neural network

YUN Tao,PAN Quan,HAO Yuhang,XU Rong

DOI: https://doi.org/10.1051/jnwpu/20234130537

2023-08-01

Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University

Abstract:Authors: , , and . Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University Vol. 41 , page 537 Published online: 01/08/2023 Keywords: 雷达目标识别 ; 逆合成孔径雷达 ; 高分辨率距离像 ; 卷积神经网络 ; radar target recognition ; inverse synthetic aperture radar ; high range resolution profile ; convolutional neural network.
Weather Radar Echo Extrapolation Method Based on Deep Learning

Fugui Zhang,Can Lai,Wanjun Chen

DOI: https://doi.org/10.3390/atmos13050815

IF: 3.11

2022-05-17

Atmosphere

Abstract:In order to forecast some high intensity and rapidly changing phenomena, such as thunderstorms, heavy rain, and hail within 2 h, and reduce the influence brought by destructive weathers, this paper proposes a weather radar echo extrapolation method based on deep learning. The proposed method includes the design and combination of the data preprocessing, convolutional long short-term memory (Conv-LSTM) neuron and encoder–decoder model. We collect eleven thousand weather radar echo data in high spatiotemporal resolution, these data are then preprocessed before they enter the neural network for training to improve the data's quality and make the training better. Next, the neuron integrates the structure and the advantages of convolutional neural network (CNN) and long short-term memory (LSTM), called Conv-LSTM, is applied to solve the problem that the full-connection LSTM (FC-LSTM) cannot extract the spatial information of input data. This operation replaced the full-connection structure in the input-to-state and state-to-state parts so that the Conv-LSTM can extract the information from other dimensions. Meanwhile, the encoder–decoder model is adopted due to the size difference of the input and output data to combine with the Conv-LSTM neuron. In the neural network training, mean square error (MSE) loss function weighted according to the rate of rainfall is added. Finally, the matrix "point-to-point" test method, including the probability of detection (POD), critical success index (CSI), false alarm ratio (FAR) and spatial test method contiguous rain areas (CRA), is used to examine the radar echo extrapolation's results. Under the threshold of 30 dBZ, at the time of 1 h, we achieved 0.60 (POD), 0.42 (CSI) and 0.51 (FAR), compared with 0.42, 0.28 and 0.58 for the CTREC algorithm, and 0.30, 0.24 and 0.71 for the TITAN algorithm. Meanwhile, at the time of 1 h, we achieved 1.35 (total MSE ) compared with 3.26 for the CTREC algorithm and 3.05 for the TITAN algorithm. The results demonstrate that the radar echo extrapolation method based on deep learning is obviously more accurate and stable than traditional radar echo extrapolation methods in near weather forecasting.

environmental sciences,meteorology & atmospheric sciences
Radar Composite Reflectivity Reconstruction Based on FY-4A Using Deep Learning

Ling Yang,Qian Zhao,Yunheng Xue,Fenglin Sun,Jun Li,Xiaoqiong Zhen,Tujin Lu

DOI: https://doi.org/10.3390/s23010081

IF: 3.9

2022-12-23

Sensors

Abstract:Weather radars are commonly used to track the development of convective storms due to their high resolution and accuracy. However, the coverage of existing weather radar is very limited, especially in mountainous and ocean areas. Geostationary meteorological satellites can provide near global coverage and near real-time observations, which can compensate for the lack of radar observations. In this paper, a deep learning method was used to estimate the radar composite reflectivity from observations of China's new-generation geostationary meteorological satellite FY-4A and topographic data. The derived radar reflectivity products from satellite observations can be used over regions without radar coverage. In general, the deep learning model can reproduce the overall position, shape, and intensity of the radar echoes. In addition, evaluation of the reconstruction radar observations indicates that a modified model based on the attention mechanism (Attention U-Net model) has better performance than the traditional U-Net model in terms of all statistics such as the probability of detection (POD), critical success index (CSI), and root-mean-square error (RMSE), and the modified model has stronger capability on reconstructing details and strong echoes.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
The MS-RadarFormer: A Transformer-Based Multi-Scale Deep Learning Model for Radar Echo Extrapolation

Huantong Geng,Fangli Wu,Xiaoran Zhuang,Liangchao Geng,Boyang Xie,Zhanpeng Shi

DOI: https://doi.org/10.3390/rs16020274

IF: 5

2024-01-11

Remote Sensing

Abstract:As a spatial–temporal sequence prediction task, radar echo extrapolation aims to predict radar echoes' future movement and intensity changes based on historical radar observations. Two urgent issues still need to be addressed in deep learning radar echo extrapolation models. First, the predicted radar echo sequences often exhibit echo-blurring phenomena. Second, over time, the output echo intensities from the model gradually weaken. In this paper, we propose a novel model called the MS-RadarFormer, a Transformer-based multi-scale deep learning model for radar echo extrapolation, to mitigate the two above issues. We introduce a multi-scale design in the encoder–decoder structure and a Spatial–Temporal Attention block to improve the precision of radar echoes and establish long-term dependencies of radar echo features. The model uses a non-autoregressive approach for echo prediction, avoiding accumulation errors during the recursive generation of future echoes. Compared to the baseline, our model shows an average improvement of 15.8% in the critical success index (CSI), an average decrease of 8.3% in the false alarm rate (FAR), and an average improvement of 16.2% in the Heidke skill score (HSS).

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Dual adaptive differential threshold method for automated detection of faint and strong echo features in radar observations of winter storms

Laura M. Tomkins,Sandra E. Yuter,Matthew A. Miller

DOI: https://doi.org/10.5194/amt-17-3377-2024

IF: 4.184

2024-06-04

Atmospheric Measurement Techniques

Abstract:Radar observations of winter storms often exhibit locally enhanced linear features in reflectivity, sometimes labeled as snow bands. We have developed a new, objective method for detecting locally enhanced echo features in radar data from winter storms. In comparison to convective cells in warm season precipitation, these features are usually less distinct from the background echo and often have more fuzzy or feathered edges. This technique identifies both prominent, strong features and more subtle, faint features. A key difference from previous radar reflectivity feature detection algorithms is the combined use of two adaptive differential thresholds, one that decreases with increasing background values and one that increases with increasing background values. The algorithm detects features within a snow rate field rather than reflectivity and incorporates an underestimate and overestimate of feature areas to account for uncertainties in the detection. We demonstrate the technique on several examples from the US National Weather Service operational radar network. The feature detection algorithm is highly customizable and can be tuned for a variety of data sets and applications.

meteorology & atmospheric sciences
Super-Resolution Radar Imaging with Sparse Arrays Using a Deep Neural Network Trained with Enhanced Virtual Data

Christian Schuessler,Marcel Hoffmann,Martin Vossiek

DOI: https://doi.org/10.1109/JMW.2023.3285610

2023-06-16

Abstract:This paper introduces a method based on a deep neural network (DNN) that is perfectly capable of processing radar data from extremely thinned radar apertures. The proposed DNN processing can provide both aliasing-free radar imaging and super-resolution. The results are validated by measuring the detection performance on realistic simulation data and by evaluating the Point-Spread-function (PSF) and the target-separation performance on measured point-like targets. Also, a qualitative evaluation of a typical automotive scene is conducted. It is shown that this approach can outperform state-of-the-art subspace algorithms and also other existing machine learning solutions. The presented results suggest that machine learning approaches trained with sufficiently sophisticated virtual input data are a very promising alternative to compressed sensing and subspace approaches in radar signal processing. The key to this performance is that the DNN is trained using realistic simulation data that perfectly mimic a given sparse antenna radar array hardware as the input. As ground truth, ultra-high resolution data from an enhanced virtual radar are simulated. Contrary to other work, the DNN utilizes the complete radar cube and not only the antenna channel information at certain range-Doppler detections. After training, the proposed DNN is capable of sidelobe- and ambiguity-free imaging. It simultaneously delivers nearly the same resolution and image quality as would be achieved with a fully occupied array.

Signal Processing,Computer Vision and Pattern Recognition,Robotics
HRPnet: High-Dimensional Feature Mapping for Radar Space Target Recognition

Jian Dong,Qingqing She,Feifei Hou

DOI: https://doi.org/10.1109/jsen.2024.3361926

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:Deep learning has made significant progress in the field of radar space target recognition. However, deep neural networks require significant amounts of data to train network parameters, posing challenges in achieving non-cooperative target recognition. Therefore, it is of practical significance to research a fast and accurate target recognition method with limited radar data. In this paper, we propose a novel radar space target recognition network based on high-dimensional feature maps, called HRPnet, which fully utilizes high-resolution range profile (HRRP), radar cross section (RCS), and polarization (POL) data obtained from the radar. First, a sparse auto encoder (SAE) is employed to conduct deep feature extraction on the three types of data. Second, the Gramian angular field (GAF) transformation is employed to obtain two-dimensional representation of HRRP, RCS, and POL data, respectively. These two-dimensional maps are then integrated to construct high-dimensional feature maps. Third, a feature map convolutional neural networks (FMCNN) is designed for high-dimensional feature map classification and target recognition. Experimental results indicate that the proposed HRPnet outperforms existing methods in terms of recognition accuracy and noise resistance, particularly in the case of limited sample size.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Research on Radar Echo Extrapolation Method by Fusing Environment Grid Point Field Information

Yanqin Wen,Jun Zhang,Di Wang,Cong Wang,Ping Wang

DOI: https://doi.org/10.3390/atmos14060980

IF: 3.11

2023-06-06

Atmosphere

Abstract:Short-term extrapolation by weather radar observations is one of the main tools for making weather forecasts. Recently, deep learning has been gradually applied to radar extrapolation techniques, achieving significant results. However, for radar echo images containing strong convective systems, it is difficult to obtain high-quality results with long-term extrapolation. Additionally, there are few attempts and discussions to incorporate environmental factors governing the occurrence and development of convective storms into the training process. To demonstrate the positive effect of environmental factors on radar echo extrapolation tasks, this paper designs a three-dimensional convolutional neural network. The paper outlines the processing steps for matching radar echo images with environmental data in the spatio–temporal dimension. Additionally, it develops an experimental study on the effectiveness of seven physical elements and their combinations in improving the quality of radar echo extrapolation. Furthermore, a loss function is adopted to guide the training process of the model to pay more attention to strong convective systems. The quantitative statistical evaluation shows the critical success index (CSI) of our model's prediction is improved by 3.42% (threshold = 40 dBZ) and 2.35% (threshold = 30 dBZ) after incorporating specific environmental field data. Two representative cases indicate that environmental factors provide essential information about convective systems, especially in predicting the birth, extinction, merging, and splitting of convective cells.

environmental sciences,meteorology & atmospheric sciences
TEDR: A spatiotemporal attention radar extrapolation network constrained by optical flow and distribution correction

Junkai Liu,Xinwei Qian,Lu Peng,Dan Lou,Yiwen Li

DOI: https://doi.org/10.1016/j.atmosres.2024.107702

IF: 5.965

2024-09-29

Atmospheric Research

Abstract:In recent years, deep learning has been widely applied to meteorological radar extrapolation due to the shortcomings of traditional optical flow methods in predicting the genesis and dissipation of radar echoes. However, it still faces challenges in addressing issues of clarity and overall intensity attenuation caused by uncertainty. This study implemented a dual-path spatiotemporal attention network that integrates optical flow techniques by employing intra-frame static attention and inter-frame dynamic attention, which could simulate motion fields and the overall intensity distribution of radar echoes separately. Our approach effectively resolve the issues of systematic intensity attenuation and clarity degradation introduced by deep learning methods. Through the comparisons of key metrics such as MSE, SSIM, CSI20, CSI30, and CSI40, the results demonstrated significant improvements over traditional approaches, particularly in CSI30 and CSI40, where the metrics improved by more than 35 %.

meteorology & atmospheric sciences
Deep Learning-based Estimation for Multitarget Radar Detection

Mamady Delamou,Ahmad Bazzi,Marwa Chafii,El Mehdi Amhoud

2023-05-06

Abstract:Target detection and recognition is a very challenging task in a wireless environment where a multitude of objects are located, whether to effectively determine their positions or to identify them and predict their moves. In this work, we propose a new method based on a convolutional neural network (CNN) to estimate the range and velocity of moving targets directly from the range-Doppler map of the detected signals. We compare the obtained results to the two dimensional (2D) periodogram, and to the similar state of the art methods, 2DResFreq and VGG-19 network and show that the estimation process performed with our model provides better estimation accuracy of range and velocity index in different signal to noise ratio (SNR) regimes along with a reduced prediction time. Afterwards, we assess the performance of our proposed algorithm using the peak signal to noise ratio (PSNR) which is a relevant metric to analyse the quality of an output image obtained from compression or noise reduction. Compared to the 2D-periodogram, 2DResFreq and VGG-19, we gain 33 dB, 21 dB and 10 dB, respectively, in terms of PSNR when SNR = 30 dB.

Signal Processing,Machine Learning
MistNet: Measuring historical bird migration in the US using archived weather radar data and convolutional neural networks

Tsung‐Yu Lin,Kevin Winner,Garrett Bernstein,Abhay Mittal,Adriaan M. Dokter,Kyle G. Horton,Cecilia Nilsson,Benjamin M. Van Doren,Andrew Farnsworth,Frank A. La Sorte,Subhransu Maji,Daniel Sheldon

DOI: https://doi.org/10.1111/2041-210X.13280

2019-11-25

Methods in Ecology and Evolution

Abstract:Large networks of weather radars are comprehensive instruments for studying bird migration. For example, the US WSR‐88D network covers the entire continental US and has archived data since the 1990s. The data can quantify both broad and fine‐scale bird movements to address a range of migration ecology questions. However, the problem of automatically discriminating precipitation from biology has significantly limited the ability to conduct biological analyses with historical radar data. We develop M ist N et , a deep convolutional neural network to discriminate precipitation from biology in radar scans. Unlike prior machine learning approaches, M ist N et makes fine‐scaled predictions and can collect biological information from radar scans that also contain precipitation. M ist N et is based on neural networks for images, and includes several architecture components tailored to the unique characteristics of radar data. To avoid a massive human labelling effort, we train M ist N et using abundant noisy labels obtained from dual polarization radar data. In historical and contemporary WSR‐88D data, M ist N et identifies at least 95.9% of all biomass with a false discovery rate of 1.3%. Dual polarization training data and our radar‐specific architecture components are effective. By retaining biomass that co‐occurs with precipitation in a single radar scan, M ist N et retains 15% more biomass than traditional whole‐scan approaches to screening. M ist N et is fully automated and can be applied to datasets of millions of radar scans to produce fine‐grained predictions that enable a range of applications, from continent‐scale mapping to local analysis of airspace usage. Radar ornithology is advancing rapidly and leading to significant discoveries about continent‐scale patterns of bird movements. General‐purpose and empirically validated methods to quantify biological signals in radar data are essential to the future development of this field. M ist N et can enable large‐scale, long‐term, and reproducible measurements of whole migration systems.

ecology
Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radar

David Borts,Erich Liang,Tim Brödermann,Andrea Ramazzina,Stefanie Walz,Edoardo Palladin,Jipeng Sun,David Bruggemann,Christos Sakaridis,Luc Van Gool,Mario Bijelic,Felix Heide

2024-05-10

Abstract:Neural fields have been broadly investigated as scene representations for the reproduction and novel generation of diverse outdoor scenes, including those autonomous vehicles and robots must handle. While successful approaches for RGB and LiDAR data exist, neural reconstruction methods for radar as a sensing modality have been largely unexplored. Operating at millimeter wavelengths, radar sensors are robust to scattering in fog and rain, and, as such, offer a complementary modality to active and passive optical sensing techniques. Moreover, existing radar sensors are highly cost-effective and deployed broadly in robots and vehicles that operate outdoors. We introduce Radar Fields - a neural scene reconstruction method designed for active radar imagers. Our approach unites an explicit, physics-informed sensor model with an implicit neural geometry and reflectance model to directly synthesize raw radar measurements and extract scene occupancy. The proposed method does not rely on volume rendering. Instead, we learn fields in Fourier frequency space, supervised with raw radar data. We validate the effectiveness of the method across diverse outdoor scenarios, including urban scenes with dense vehicles and infrastructure, and in harsh weather scenarios, where mm-wavelength sensing is especially favorable.

Computer Vision and Pattern Recognition
Towards Monocular Digital Elevation Model (DEM) Estimation by Convolutional Neural Networks - Application on Synthetic Aperture Radar Images

Gabriele Costante,Thomas A. Ciarfuglia,Filippo Biondi

DOI: https://doi.org/10.48550/arXiv.1803.05387

IF: 4.729

2018-03-14

Signal Processing

Abstract:Synthetic aperture radar (SAR) interferometry (InSAR) is performed using repeat-pass geometry. InSAR technique is used to estimate the topographic reconstruction of the earth surface. The main problem of the range-Doppler focusing technique is the nature of the two-dimensional SAR result, affected by the layover indetermination. In order to resolve this problem, a minimum of two sensor acquisitions, separated by a baseline and extended in the cross-slant-range, are needed. However, given its multi-temporal nature, these techniques are vulnerable to atmosphere and Earth environment parameters variation in addition to physical platform instabilities. Furthermore, either two radars are needed or an interferometric cycle is required (that spans from days to weeks), which makes real time DEM estimation impossible. In this work, the authors propose a novel experimental alternative to the InSAR method that uses single-pass acquisitions, using a data driven approach implemented by Deep Neural Networks. We propose a fully Convolutional Neural Network (CNN) Encoder-Decoder architecture, training it on radar images in order to estimate DEMs from single pass image acquisitions. Our results on a set of Sentinel images show that this method is able to learn to some extent the statistical properties of the DEM. The results of this exploratory analysis are encouraging and open the way to the solution of single-pass DEM estimation problem with data driven approaches.
TempEE: Temporal–Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Autoregression

Shengchao Chen,Ting Shu,Huan Zhao,Guo Zhong,Xunlai Chen

DOI: https://doi.org/10.1109/tgrs.2023.3311510

IF: 8.2

2023-09-15

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Meteorological radar reflectivity data (i.e., radar echo) significantly influences precipitation prediction. It can facilitate accurate and expeditious forecasting of short-term heavy rainfall bypassing the need for complex numerical weather prediction (NWP) models. In comparison to conventional models, deep-learning (DL)-based radar echo extrapolation algorithms exhibit higher effectiveness and efficiency. Nevertheless, the development of a reliable and generalized echo extrapolation algorithm is impeded by three primary challenges: cumulative error spreading, imprecise representation of sparsely distributed echoes, and inaccurate description of nonstationary motion processes. To tackle these challenges, this article proposes a novel radar echo extrapolation algorithm called temporal–spatial parallel transformer, referred to as TempEE. TempEE avoids using autoregression and instead employs a one-step forward strategy to prevent the cumulative error from spreading during the extrapolation process. Additionally, we propose the incorporation of a multilevel temporal–spatial attention mechanism to improve the algorithm's capability of capturing both global and local information while emphasizing task-related regions, including sparse echo representations, in an efficient manner. Furthermore, the algorithm extracts spatio-temporal representations from continuous echo images using a parallel encoder to model the nonstationary motion process for echo extrapolation. The superiority of our TempEE has been demonstrated in the context of the classic radar echo extrapolation task, utilizing a real-world dataset. Extensive experiments have further validated the efficacy and indispensability of various components within TempEE.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Accelerating Deep Learning in Radar Systems: A Simulation Framework for 60 GHz Indoor Radar

Philipp Reitz,Timo Maiwald,Jonas Bönsch,Norman Franchi,Maximilian Lübke

DOI: https://doi.org/10.3390/rs16214028

IF: 5

2024-10-31

Remote Sensing

Abstract:FMCW radar systems are increasingly used in diverse applications, and emerging technologies like JCAS offer new opportunities. However, machine learning for radar faces challenges due to limited application-specific datasets, often requiring advanced simulations to supplement real-world data. This paper presents a setup for generating synthetic radar data for indoor environments, evaluated using CNNs. The setup involves comprehensive modeling, including far-field antenna simulations, variations in human radar cross-section, and detailed representations of indoor environments with their corresponding propagation channel properties. These synthetic data are used to train CNNs, and their performance is assessed on real measurement data. The results demonstrate that CNNs trained on synthetic data can perform well when tested on real measurement data. Specifically, the models trained with synthetic data showed performance comparable to models trained with real measurement data, which required a minimum of 300 samples to reach similar levels of accuracy. This result demonstrates that synthetic data can effectively train neural networks, providing an alternative to real measurement data, particularly when collecting sufficient real-world samples is difficult or costly. This approach significantly reduces the time required for generating datasets, and the ability to quickly label data in simulations simplifies and accelerates post-processing. Additionally, the generated datasets can be made more heterogeneous by introducing varying signal conditions, enhancing the diversity and robustness of the training data.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

Meteor Head Echo Detection at Multiple High‐Power Large‐Aperture Radar Facilities via a Convolutional Neural Network Trained on Synthetic Radar Data

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

High Resolution Point Clouds from mmWave Radar

Deep Convolutional Neural Network for Meteorology Target Detection in Airborne Weather Radar Images

Development and Interpretation of a Neural Network-Based Synthetic Radar Reflectivity Estimator Using GOES-R Satellite Observations

Target recognition algorithm based on HRRP time-spectrogram feature and multi-scale asymmetric convolutional neural network

Weather Radar Echo Extrapolation Method Based on Deep Learning

Radar Composite Reflectivity Reconstruction Based on FY-4A Using Deep Learning

The MS-RadarFormer: A Transformer-Based Multi-Scale Deep Learning Model for Radar Echo Extrapolation

Dual adaptive differential threshold method for automated detection of faint and strong echo features in radar observations of winter storms

Super-Resolution Radar Imaging with Sparse Arrays Using a Deep Neural Network Trained with Enhanced Virtual Data

HRPnet: High-Dimensional Feature Mapping for Radar Space Target Recognition

Research on Radar Echo Extrapolation Method by Fusing Environment Grid Point Field Information

TEDR: A spatiotemporal attention radar extrapolation network constrained by optical flow and distribution correction

Deep Learning-based Estimation for Multitarget Radar Detection

MistNet: Measuring historical bird migration in the US using archived weather radar data and convolutional neural networks

Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radar

Towards Monocular Digital Elevation Model (DEM) Estimation by Convolutional Neural Networks - Application on Synthetic Aperture Radar Images

TempEE: Temporal–Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Autoregression

Accelerating Deep Learning in Radar Systems: A Simulation Framework for 60 GHz Indoor Radar