Abstract:We applied Deep Learning algorithm known as Generative Adversarial Networks (GANs) to perform solar image-to-image translation. That is, from Solar Dynamics Observatory (SDO)/Helioseismic and Magnetic Imager (HMI) line of sight magnetogram images to SDO/Atmospheric Imaging Assembly (AIA) 0304-Å images. The Ultraviolet (UV)/Extreme Ultraviolet observations like the SDO/AIA 0304-Å images were only made available to scientists in the late 1990s even though the magnetic field observations like the SDO/HMI have been available since the 1970s. Therefore, by leveraging Deep Learning algorithms like GANs we can give scientists access to complete datasets for analysis. For generating high resolution solar images, we use the Pix2PixHD and Pix2Pix algorithms. The Pix2PixHD algorithm was specifically designed for high resolution image generation tasks, and the Pix2Pix algorithm is by far the most widely used image to image translation algorithm. For training and testing we used the data for the year 2012, 2013 and 2014. After model training, we evaluated the model on the test data. The results show that our deep learning models are capable of generating high resolution (1024 × 1024 pixels) SDO/AIA0304 images from SDO/HMI line of sight magnetograms. Specifically, the pixel-to-pixel Pearson Correlation Coefficient of the images generated by Pix2PixHD and original images is as high as 0.99. The number is 0.962 if Pix2Pix is used to generate images. The results we get for our Pix2PixHD model is better than the results obtained by previous works done by others to generate SDO/AIA 0304 images. Thus, we can use these models to generate AIA0304 images when the AIA0304 data is not available which can be used for understanding space weather and giving researchers the capability to predict solar events such as Solar Flares and Coronal Mass Ejections. As far as we know, our work is the first attempt to leverage Pix2PixHD algorithm for SDO/HMI to SDO/AIA0304 image-to-image translation.

Solar Active Region Magnetogram Generation by Attention Generative Adversarial Networks

A Transfer Learning Method to Generate Synthetic Synoptic Magnetograms

Magnetogram-to-Magnetogram: Generative Forecasting of Solar Evolution

A Deep Learning Approach to Generating Photospheric Vector Magnetograms of Solar Active Regions for SOHO/MDI Using SDO/HMI and BBSO Data

Super-resolution of Solar Magnetograms Using Deep Learning

A Multibranch Deep Neural Network for the Superresolution of Solar Magnetograms

Super-Resolution of SOHO/MDI Magnetograms of Solar Active Regions Using SDO/HMI Data and an Attention-Aided Convolutional Neural Network

High Resolution Solar Image Generation Using Generative Adversarial Networks

Improving the Spatial Resolution of Solar Images Using Generative Adversarial Network and Self-attention Mechanism

Image Synthesis for Solar Flare Prediction

A forecast model of geomagnetic indices from the solar wind fluids observations based on long short-term memory neural network

Prediction of Space Weather Events through Analysis of Active Region Magnetograms using Convolutional Neural Network

A Deep Learning Method to Estimate Magnetic Fields in Solar Active Regions from Photospheric Continuum Images

Predicting the Evolution of Photospheric Magnetic Field in Solar Active Regions Using Deep Learning

Solar Flare Forecasting Based on Magnetogram Sequences Learning with Multiscale Vision Transformers and Data Augmentation Techniques

Prediction of Solar Concentration Flux Distribution for a Heliostat Based on Lunar Concentration Image and Generative Adversarial Networks

Solar Flare Prediction Based on the Fusion of Multiple Deep-learning Models

Advancing Solar Flare Prediction using Deep Learning with Active Region Patches

Data-driven Magnetohydrodynamic Modelling of a Flux-Emerging Active Region Leading to Solar Eruption.

Solar Filament Segmentation Based on AA-UNet