Spectral replacement using machine learning methods for continuous mapping of Geostationary Environment Monitoring Spectrometer (GEMS)

Yeeun Lee,Myoung-Hwan Ahn,Mina Kang,Mijin Eo

DOI: https://doi.org/10.5194/amt-2022-37

2022-02-17

Abstract:Abstract. Earth radiance in the form of hyperspectral data contains useful information on atmospheric constituents and aerosol properties. The Geostationary Environment Monitoring Spectrometer (GEMS) is an environmental sensor measuring such hyperspectral data in the ultraviolet and visible (UV/VIS) spectral range over the Asia-Pacific region. After successful completion of the in orbit test of GEMS in October 2020, bad pixels are found as a remaining calibration issue to be updated with follow-up treatment. Currently, one-dimensional interpolation in the spatial direction is performed in operation to replace the erroneous pixels of GEMS, which causes high interpolation error for a wider defect area on a detector array. To resolve the issue, this study suggests machine learning methods with artificial neural network (ANN) and multivariate linear regression (Linear) to fill in a spectral gap of defective spectra. The machine learning models are trained with normal measurements to emulate spectral relations between input and output radiances in a spectrum. For efficient training, dimensionality reduction for the input radiances is applied with principal component analysis (PCA) prior to the training process. The results show that the defect area at the wavelengths of strong absorption lines is better replaced with PCA-ANN with the error of 5 %, while PCA-Linear is better for reproducing radiances having strong correlation with input radiances. The shorter the spectral range of output radiances is, the smaller the prediction error is with PCA-Linear (0.5–5 %). Spectral and spatial discontinuity caused by real bad pixels can be significantly improved with the trained machine learning models especially for wide defect areas. This study verifies that spectral relations of radiances in the UV/VIS spectrum are successfully reproduced with a simple machine learning model, which has high potential to be investigated further for enhancing measurement quality of environmental satellite measurements.