Abstract:Clouds play a significant role in the climate system, which affects the radiation balance and modulates the global hydrological cycle. However, the existing cloud property products have poor spatiotemporal continuity with only daytime cloud property retrieval results, which makes it challenging for us to carry out researches related to clouds at night. In this study, the effect of parallax error between the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) and Himawari-8 data is corrected based on parallax correction algorithm by referring to cloud parameters extracted from the CALIOP (Cloud-Aerosol Lidar with Orthogonal Polarization) cloud property product. Due to the different sensitivity of different channels to clouds, this study treats the CALIOP data with cloud optical depth greater than 0.2 as clouds, otherwise as clear sky. Cloud property retrieval model based on the XGBoost machine learning (ML) algorithm is developed for the advanced Himawari imager (AHI) onboard the Himawari-8 satellite. The ML model can achieve unified cloud mask, cloud top temperature (CTT), and cloud top height (CTH) retrieval for both daytime and nighttime with high spatial (0.02°) and temporal (10 min) resolutions using the AHI thermal data. The retrieval results are extensively evaluated over study regions (80° E ~ 135° E, 18° N ~ 55° N) by comparisons with cloud property products of JAXA (Japan Aerospace Exploration Agency) AHI, MODIS, and CALIOP data. The ML algorithm has higher cloud detection accuracy with cloudy sky (clear sky) hit rate (CHR) and false alarm rate (FAR) of 90.79% (88.35%) and 5.74% (4.67%) compared with the JAXA AHI (CHR = 92.81% (60.64%) and FAR = 19.66% (3.61%)) and MODIS (CHR = 88.50% (72.32%) and FAR = 13.10% (6.06%)) cloud products, and the ML algorithm also performs well for thin clouds over bright surfaces. The CTH and CTT retrieved by the ML algorithm (RMSE = 1.83 km and 12.29 K) are in good agreement with the CALIOP cloud property product, and the root mean squared error (RMSE) of CTH and CTT is reduced by 33.70% (18.67%) and 35.28% (16.45%) on average, respectively, compared with the JAXA AHI (MODIS) cloud product with RMSE of 2.76 km (2.25 km) and 18.99 K (14.71 K). In addition, the ML algorithm can obtain higher cloud property retrieval accuracy at night compared with the results during the day.

A Global Classification Dataset of Daytime and Nighttime Marine Low-cloud Mesoscale Morphology Based on Deep Learning Methods

Simultaneous Retrieval Algorithm of Water Cloud Optical and Microphysical Properties by High-Spectral-Resolution Lidar

Climatology of stratocumulus cloud morphologies: microphysical properties and radiative effects

M4Fog: A Global Multi-Regional, Multi-Modal, and Multi-Stage Dataset for Marine Fog Detection and Forecasting to Bridge Ocean and Atmosphere

A survey of radiative and physical properties of North Atlantic mesoscale cloud morphologies from multiple identification methodologies

Local Climate Zone Classification by Seasonal and Diurnal Satellite Observations: An Integration of Daytime Thermal Infrared Multispectral Imageries and High-Resolution Night-Time Light Data

Combining crowd-sourcing and deep learning to explore the meso-scale organization of shallow convection

Improving Prediction of Marine Low Clouds with Cloud Droplet Number Concentration and a Deep Learning Method

MCDNet: Multilevel Cloud Detection Network for Remote Sensing Images Based on Dual-Perspective Change-Guided and Multi-Scale Feature Fusion

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Machine-learned cloud classes from satellite data for process-oriented climate model evaluation

Cloud detection sample generation algorithm for nighttime satellite imagery based on daytime data and machine learning application

Capturing the Diversity of Mesoscale Trade Wind Cumuli Using Complementary Approaches From Self‐Supervised Deep Learning

Machine learning clustering of cloud regimes using synergetic ground-based remote sensing observations

A Unified Cloud Detection Method for Suomi-NPP VIIRS Day and Night PAN Imagery

A Physical Basis for the Overstatement of Low Clouds at Night by Conventional Satellite Infrared‐Based Imaging Radiometer Bi‐Spectral Techniques

Cloud macrophysical characteristics in China mainland and east coast from 2006 to 2017 using satellite active remote sensing observations

Cloud classification through machine learning and global horizontal irradiance data analysis

Machine learning-based retrieval of day and night cloud macrophysical parameters over East Asia using Himawari-8 data

Creating and Leveraging a Synthetic Dataset of Cloud Optical Thickness Measures for Cloud Detection in MSI

A global land aerosol fine-mode fraction dataset (2001–2020) retrieved from MODIS using hybrid physical and deep learning approaches