A Novel Big Data Mining Framework for Reconstructing Large-Scale Daily MAIAC AOD Across China from 2000 to 2020

Chen Binjie,Yong Yang,Cheng Tong,Jinsong Deng,Ke Wang,Yang Hong

DOI: https://doi.org/10.5281/zenodo.5520164

2021-01-01

Abstract:This dataset contains the mean reconstructed MAIAC AOD and mean percentage of coverage of reconstructed MAIAC AOD across China from 2000 to 2020.

What problem does this paper attempt to address?

A novel big data mining framework for reconstructing large-scale daily MAIAC AOD data across China from 2000 to 2020

Binjie Chen,Yang Ye,Cheng Tong,Jinsong Deng,Ke Wang,Yang Hong

DOI: https://doi.org/10.1080/15481603.2022.2051382

2022-03-21

Abstract:Satellite-based aerosol optical depth (AOD) retrieval products are essential in air pollution and climate change research. Unfortunately, cloud contaminations and unfavorable surface conditions result in a considerable proportion of missing AOD data. Numerous studies have been conducted to reconstruct large-scale AOD data gaps by utilizing adjacent spatiotemporal information or modeling AOD data via various external geographical data. However, the erratic variation of AOD and the inconvenience of external data weaken the accuracy and efficiency of reconstruction. To address these issues, a novel big data based iterative variation mining framework (IVMF), utilizing multi-spatiotemporal information on AOD variations, is proposed to reconstruct large-scale AOD data over China from 2000 to 2020. Simulated and real-data experiments are carried out to validate the effectiveness and robustness of the IVMF. Results show that the spatial patterns of the reconstructed AOD are consistent with those of the original AOD in the simulated experiments. The final reconstructed AOD data strongly correlate with in-situ AOD measurements in the real-data experiments (correlation coefficient of 0.91). After reconstruction, the average daily AOD coverage increases from 30.42% to 96.69% (a 218% increase). Besides, results reveal that central China exhibits severe AOD levels, while northwest China presents low AOD levels. Overall, the proposed IVMF can largely resolve the missing AOD data problem with outstanding accuracy and efficiency, and has great potential to be generalized to other regions and remote sensing products.

geography, physical,remote sensing
Mapping Annual Land Disturbance and Reclamation in a Surface Coal Mining Region Using Google Earth Engine and the LandTrendr Algorithm: A Case Study of the Shengli Coalfield in Inner Mongolia, China

Wu Xiao,Xinyu Deng,Tingting He,Wenqi Chen

DOI: https://doi.org/10.3390/rs12101612

IF: 5

2020-01-01

Remote Sensing

Abstract:The development and utilization of mining resources are basic requirements for social and economic development. Both open-pit mining and underground mining have impacts on land, ecology, and the environment. Of these, open-pit mining is considered to have the greatest impact due to the drastic changes wrought on the original landform and the disturbance to vegetation. As awareness of environmental protection has grown, land reclamation has been included in the mining process. In this study, we used the Shengli Coalfield in the eastern steppe region of Inner Mongolia to demonstrate a mining and reclamation monitoring process. We combined the Google Earth Engine platform with time series Landsat images and the LandTrendr algorithm to identify and monitor mining disturbances to grassland and land reclamation in open-pit mining areas of the coalfield between 2003 and 2019. Pixel-based trajectories were used to reconstruct the temporal evolution of vegetation, and sequential Landsat archive data were used to achieve accurate measures of disturbances to vegetation. The results show that: (1) the proposed method can be used to determine the years in which vegetation disturbance and recovery occurred with accuracies of 86.53% and 78.57%, respectively; (2) mining in the Shengli mining area resulted in the conversion of 89.98 km(2) of land from grassland, water, etc., to barren earth, and only 23.54 km(2) was reclaimed, for a reclamation rate of 26.16%; and (3) the method proposed in this paper can achieve fast, efficient identification of surface mining land disturbances and reclamation, and has the potential to be applied to other similar areas.
MAIAC-based Long-Term Spatiotemporal Trends of PM2.5 in Beijing, China.

Fengchao Liang,Qingyang Xiao,Yujie Wang,Alexei Lyapustin,Guoxing Li,Dongfeng Gu,Xiaochuan Pan,Yang Liu

DOI: https://doi.org/10.1016/j.scitotenv.2017.10.155

IF: 9.8

2017-01-01

The Science of The Total Environment

Abstract:Satellite-driven statistical models have been proven to be able to provide spatially resolved PM2.5 estimates worldwide. The North China Plain has been suffering from severe PM2.5 pollution in recent years. An accurate assessment of the spatiotemporal characteristics of PM2.5 levels in this region is crucial to design effective air pollution control policy. Our objective is to estimate daily PM2.5 concentrations at 1km spatial resolution from 2004 to 2014 in Beijing and its surrounding areas using the Multi-angle implementation of atmospheric correction (MAIAC) aerosol optical depth (AOD). A high-performance three-stage model was developed with AOD, meteorological, demographic and land use variables as predictors, which includes a custom-designed PM2.5 gap-filling method. The 11-year average annual coverage increased from 177days to 279days and annual PM2.5 prediction error decreased from 14.1μg/m3 to 8.3μg/m3 after gap-filling techniques were applied. Results show that the 11-year overall mean of predicted PM2.5 was 67.1μg/m3 in our study domain. The cross-validation R2 value of our model is 0.82 in 2013 and 0.79 in 2014. In addition, the models predicted historical PM2.5 concentrations with relatively high accuracy at the seasonal and annual levels (R2 ranged from 0.78 to 0.86). Our long-term PM2.5 prediction filled the gaps left by ground monitors, which would be beneficial to PM2.5 related epidemiological studies in Beijing.
MAIAC-Based Long-Term Trends in Ambient PM2.5 and the Effects on Population Mortality in Beijing, China.

Fengchao Liang,Qingyang Xiao,Alexei Lyapustin,Yujie Wang,Xiaochuan Pan,Yang Liu

DOI: https://doi.org/10.1289/isee.2017.2017-299

2018-01-01

ISEE Conference Abstracts

Abstract:Background/Aim: This study was to estimate daily PM2.5 concentrations at 1 km spatial resolution from 2004 to 2014 using the Multi-angle implementation of atmospheric correction (MAIAC) AOD values ...
Full-coverage High-Resolution Daily PM2.5 Estimation Using MAIAC AOD in the Yangtze River Delta of China

Qingyang Xiao,Yujie Wang,Howard H. Chang,Xia Meng,Guannan Geng,Alexei Lyapustin,Yang Liu

DOI: https://doi.org/10.1016/j.rse.2017.07.023

IF: 13.5

2017-01-01

Remote Sensing of Environment

Abstract:Satellite aerosol optical depth (AOD) has been used to assess population exposure to fine particulate matter (PM2.5). The emerging high-resolution satellite aerosol product, Multi-Angle Implementation of Atmospheric Correction (MAIAC), provides a valuable opportunity to characterize local-scale PM2.5 at 1-km resolution. However, non-random missing AOD due to cloud/snow cover or high surface reflectance makes this task challenging. Previous studies filled the data gap by spatially interpolating neighboring PM2.5 measurements or predictions. This strategy ignored the effect of cloud cover on aerosol loadings and has been shown to exhibit poor performance when monitoring stations are sparse or when there is seasonal large-scale missingness. Using the Yangtze River Delta of China as an example, we present a Multiple Imputation (MI) method that combines the MAIAC high-resolution satellite retrievals with chemical transport model (CTM) simulations to fill missing AOD. A two-stage statistical model driven by gap-filled AOD, meteorology and land use information was then fitted to estimate daily ground PM2.5 concentrations in 2013 and 2014 at 1 km resolution with complete coverage in space and time. The daily MI models have an average R2 of 0.77, with an inter-quartile range of 0.71 to 0.82 across days. The overall model 10-fold cross-validation R2 (root mean square error) were 0.81 (25 μg/m3) and 0.73 (18 μg/m3) for year 2013 and 2014, respectively. Predictions with only observational AOD or only imputed AOD showed similar accuracy. Comparing with previous gap-filling methods, our MI method presented in this study performed better with higher coverage, higher accuracy, and the ability to fill missing PM2.5 predictions without ground PM2.5 measurements. This method can provide reliable PM2.5 predictions with complete coverage that can reduce bias in exposure assessment in air pollution and health studies.
A 15-Year Full-Coverage Daily PM1 Dataset Across China Based on a Data-Fusion Model

Rui Li,Jianping Guo,Guannan Geng,Qingyang Xiao,Qiang Zhang

DOI: https://doi.org/10.5281/zenodo.4280029

2020-01-01

Abstract:The long-term (2004-2018) full-coverage daily PM1 dataset across China was developed based on a stacking decision tree model assimilating satellite data, meteorological variables, and other geographical covariates. The PM1 dataset captured a strong prediction capability with a high cross-validation (CV) R2 value (0.64), and the low root-mean-square error (RMSE: 18.60 μg/m3) and moderate absolute error (MAE: 11.96 μg/m3). The long-term PM1 dataset obtained here provide a key scientific basis and data support for epidemiological research and air pollution mitigation.
LGHAP: the Long-term Gap-free High-resolution Air Pollutant concentration dataset, derived via tensor-flow-based multimodal data fusion

Kaixu Bai,Ke Li,Mingliang Ma,Kaitao Li,Zhengqiang Li,Jianping Guo,Ni-Bin Chang,Zhuo Tan,Di Han

DOI: https://doi.org/10.5194/essd-14-907-2022

IF: 11.4

2022-02-24

Earth System Science Data

Abstract:Abstract. Developing a big data analytics framework for generating the Long-term Gap-free High-resolution Air Pollutant concentration dataset (abbreviated as LGHAP) is of great significance for environmental management and Earth system science analysis. By synergistically integrating multimodal aerosol data acquired from diverse sources via a tensor-flow-based data fusion method, a gap-free aerosol optical depth (AOD) dataset with a daily 1 km resolution covering the period of 2000–2020 in China was generated. Specifically, data gaps in daily AOD imageries from the Moderate Resolution Imaging Spectroradiometer (MODIS) aboard Terra were reconstructed based on a set of AOD data tensors acquired from diverse satellites, numerical analysis, and in situ air quality measurements via integrative efforts of spatial pattern recognition for high-dimensional gridded image analysis and knowledge transfer in statistical data mining. To our knowledge, this is the first long-term gap-free high-resolution AOD dataset in China, from which spatially contiguous PM2.5 and PM10 concentrations were then estimated using an ensemble learning approach. Ground validation results indicate that the LGHAP AOD data are in good agreement with in situ AOD observations from the Aerosol Robotic Network (AERONET), with an R of 0.91 and RMSE equaling 0.21. Meanwhile, PM2.5 and PM10 estimations also agreed well with ground measurements, with R values of 0.95 and 0.94 and RMSEs of 12.03 and 19.56 μg m−3, respectively. The LGHAP provides a suite of long-term gap-free gridded maps with a high resolution to better examine aerosol changes in China over the past 2 decades, from which three major variation periods of haze pollution in China were revealed. Additionally, the proportion of the population exposed to unhealthy PM2.5 increased from 50.60 % in 2000 to 63.81 % in 2014 across China, which was then reduced drastically to 34.03 % in 2020. Overall, the generated LGHAP dataset has great potential to trigger multidisciplinary applications in Earth observations, climate change, public health, ecosystem assessment, and environmental management. The daily resolution AOD, PM2.5, and PM10 datasets are publicly available at https://doi.org/10.5281/zenodo.5652257 (Bai et al., 2021a), https://doi.org/10.5281/zenodo.5652265 (Bai et al., 2021b), and https://doi.org/10.5281/zenodo.5652263 (Bai et al., 2021c), respectively. Monthly and annual datasets can be acquired from https://doi.org/10.5281/zenodo.5655797 (Bai et al., 2021d) and https://doi.org/10.5281/zenodo.5655807 (Bai et al., 2021e), respectively. Python, MATLAB, R, and IDL codes are also provided to help users read and visualize these data.

geosciences, multidisciplinary,meteorology & atmospheric sciences
Retrieving Hourly Seamless PM2.5 Concentration Across China with Physically Informed Spatiotemporal Connection

Yu Ding,Siwei Li,Jia Xing,Xi Li,Xin Ma,Ge Song,Mengfan Teng,Jie Yang,Jiaxin Dong,Shiyao Meng

DOI: https://doi.org/10.1016/j.rse.2023.113901

IF: 13.5

2024-01-01

Remote Sensing of Environment

Abstract:Seamless hourly surface fine particulate matters (PM2.5) datasets are urgently needed for environmental and epidemiologic studies. Most existing models rely on satellite AOD with spatial gaps and the time-geolocation information not directly physically related to ground-level PM2.5 as input, leading to several problems, e.g., for daytime only, spatial discontinuity. By exploring spatiotemporal connection, here we propose a novel framework for improving reanalysis AOD with satellite AOD and retrieving seamless PM2.5 concentration. With the wavelet decomposition on the meteorological / AOD time-series and the machine learning algorithm 'Cat -Boost', the grid cells are well connected based on the meteorological/AOD similarity (quasi-Lagrangian description), rather than the spatial distance (Eulerian description). Our new AOD dataset (compared with AERONET AOD, R2 = 0.60, RMSE = 0.19) combines the advantages of reanalysis AOD (all-day hourly; seamless) and satellite AOD (high accuracy and spatial resolution). The new PM2.5 estimation strategy performed excellent in cross-validation (spatial CV R2/RMSE = 0.84/14.57 mu g/m3) and mapping (no spatial discontinuity). With the help of new AOD dataset, the PM2.5 estimation exhibits significant improvement (R2: increased from 0.60 to 0.65, RMSE: reduced from 21.52 to 20.10 mu g/m3) on retrieving PM2.5 at ground monitoring site sparse area (the spatial distance to the closest site is over 20 km). Such high temporal-resolved PM2.5 prediction improved daily esti-mates of PM2.5 as it leveraged the additional hourly information to well capture the transport pattern, with the increased R2 (from 0.72 to 0.77) and decreased RMSE (from 15.54 to 14.30 mu g/m3) at ground monitoring site sparse area. The annual averaged PM2.5 estimated by hourly model also exhibit noticeable differences (-6%) from that estimated with daily model, implying the latter might suffer overestimation (-3%) in population -weighted PM2.5 exposure across China. In addition, our new PM2.5 dataset shows the Chinese average PM2.5 is highest around 24:00, lowest around 17:00.Synopsis: By performing the wavelet decomposition on meteorological factors/AOD (independent variables), the hourly seamless PM2.5 concentration across China is well estimated with improved spatiotemporal connection.
High-resolution Daily AOD Estimated to Full Coverage Using the Random Forest Model Approach in the Beijing-Tianjin-Hebei Region

Chen Zhao,Zhaorong Liu,Qing Wang,Jie Ban,Nancy Xi Chen,Tiantian Li

DOI: https://doi.org/10.1016/j.atmosenv.2019.01.045

IF: 5

2019-01-01

Atmospheric Environment

Abstract:Remote sensing is an effective means of observing and detecting global aerosol distribution and changes over time, which impact human health and climate change. However, aerosol optical depth (AOD) always has low spatial coverage, which not only affects the analysis of AOD but also harms many relevant applications of the data, such as utilization to estimate PM2.5. In our study, we utilize the random forest model, which is an effective ensemble learning method, to estimate the gaps of Moderate Resolution Imaging Spectroradiometer (MODIS) AOD data with a spatial resolution of 0.01 degrees x 0.01 degrees in a typical contaminated region of Beijing-Tianjin-Hebei during 2010-2016. Our model performs accurately in that the results of R-2 testing exceed 0.9 and the final estimated AOD coverage achieves 100%. The average value of the AOD is 0.44 (0.41-0.47 by year) over the study period. The simulation values of AOD have an obvious seasonal distribution, with the highest AOD in summer. The AOD estimations in the southern region are higher than those in the northern region. Aerosol Robotic Network (AERONET) AOD observations are compared with MODIS AOD (R-2 = 0.44) and AOD estimations (R-2 = 0.36). We analyze and screen each of the variables to compute their contributions. Specifically, the elevation and 2-m dew point are the most important in modeling the AOD, while road data, snowfall depth and snowfall have the least impact on modeling the AOD. Practical applications of AOD data include estimating the various impacts of PMPM2.5 concentrations on health based on the AOD observations in China's typically polluted areas that have cloud influence. We compare two measurement ranges that will most accurately model and fill the AOD data missing in areas. After careful consideration, we determine that our preferred range is 0-2.
When big data meets big smog: a big spatio-temporal data framework for China severe smog analysis.

Jiaoyan Chen,Huajun Chen,Jeff Z. Pan,Ming Wu,Ningyu Zhang,Guozhou Zheng

DOI: https://doi.org/10.1145/2534921.2534924

2013-01-01

Abstract:ABSTRACTRecently, the appearing disaster of severe smog has been attacking many cities in China such as the capital Beijing. The chief culprit of China smog, namely PM2.5, is affected by various factors including air pollutants, weather, climate, geographical location, urbanization, etc. To analyze the factors, we collect about 35,000,000 air quality records and about 30,000,000 weather records from the sensors in 77 China's cities in 2013. Moreover, two big data sets named Geoname and DBPedia are also combined for the data of climate, geographical location and urbanization. To deal with big spatio-temporal data for big smog analysis, we propose a MapReduce-based framework named BigSmog. It mainly conducts parallel correlation analysis of the factors and scalable training of artificial neural networks for spatio-temporal approximation of the concentration of PM2.5. In the experiments, BigSmog displays high scalability for big smog analysis with big spatio-temporal data. The analysis result shows that the air pollutants influence the short-term concentration of PM2.5 more than the weather and the factors of geographical location and climate rather than urbanization play a major role in determining a city's long-term pollution level of PM2.5. Moreover, the trained ANNs can accurately approximate the concentration of PM2.5.
Evaluation and analysis of long-term MODIS MAIAC aerosol products in China

Ge Huang,Xin Su,Lunche Wang,Yi Wang,Mengdan Cao,Lin Wang,Xiaoyu Ma,Yueji Zhao,Leiku Yang

DOI: https://doi.org/10.1016/j.scitotenv.2024.174983

IF: 9.8

2024-07-26

The Science of The Total Environment

Abstract:NASA has released the latest Moderate Resolution Imaging Spectroradiometer (MODIS) Multi-Angle Implementation of Atmospheric Correction (MAIAC) Collection 6 (C6) and Collection 6.1 (C6.1) aerosol optical depth (AOD) products with 1 km spatial resolution. This study validated and compared C6 and C6.1 MAIAC AOD products with AERONET observations in terms of accuracy and stability, and analyzed the spatiotemporal characteristics of AOD at different scales in China. The results show that the overall accuracy of MAIAC products is good, with correlation coefficient (R) > 0.9, mean bias (BIAS) 68 %. However, after the algorithm update, the accuracy of Terra MAIAC aerosol products C6.1 has significantly decreased. The accuracy of the products varies with the region. The accuracy of C6.1 in North China, Central East China, and West China, is comparable to or even exceeds that of C6, but performs poorly in South China. In addition, the stability of the updated C6.1 MAIAC aerosol products has not seen significantly improvement. The metrics of no product can all meet the stability goals of the Global Climate Observing System (GCOS, 0.02 per decade) in China. C6.1 improves the retrieval frequency in many regions and temporarily solves the problem of AOD discontinuity at the boundaries of different aerosol models in C6, but there are some fixed climatological AOD blocks (AOD = 0.014) in the eastern Tibetan Plateau region. Both C6 and C6.1 can capture similar annual variation characteristics of AOD to those observed at the AERONET sites. The study provides possible references for improving the MAIAC algorithm and building long-term stable aerosol records.

environmental sciences
Estimation of Anthropogenic Heat Emissions in China Using Cubist with Points-of-interest and Multisource Remote Sensing Data.

Qian Chen,Xuchao Yang,Zutao Ouyang,Naizhuo Zhao,Qutu Jiang,Tingting Ye,Jun Qi,Wenze Yue

DOI: https://doi.org/10.1016/j.envpol.2020.115183

IF: 8.9

2020-01-01

Environmental Pollution

Abstract:Rapid urbanization and industrialization in China stimulated the great increase of energy consumption, which leads to drastic rise in the emission of anthropogenic waste heat. Anthropogenic heat emission (AHE) is a crucial component of urban energy budget and has direct implications for investigating urban climate and environment. However, reliable and accurate representation of AHE across China is still lacking. This study presented a new machine learning-based top-down approach to generate a gridded anthropogenic heat flux (AHF) benchmark dataset at 1 km spatial resolution for China in 2010. Cubist models were constructed by fusing points-of-interest (POI) data of varying categories and multisource remote sensing data to explore the nonlinear relationships between various geographic predictors and AHE from different heat sources. The strategy of developing specific models for different components and exploiting the complementary features of POIs and remote sensing data generated a more reasonable distribution of AHF. Results showed that the AHF values in urban centers of metropolises over China range from 60 to 190 W m(-2). The highest AHF values were observed in some heavy industrial zones with value up to 415 W m(-2). Compared with previous studies, the spatial distribution of AHF from different heating components was effectively distinguished, which highlights the potential of POI data in improving the precision of AHF mapping. The gridded AHF dataset can serve as input of urban numerical models and can help decision makers in targeting extreme heat sources and polluters in cities and making differentiated and tailored strategies for emission mitigation. (C) 2020 Elsevier Ltd. All rights reserved.
Full-Coverage PM2.5 Mapping and Variation Assessment during the Three-Year Blue-Sky Action Plan Based on a Daily Adaptive Modeling Approach

Weihuan He,Songlin Zhang,Huan Meng,Jie Han,Gaohui Zhou,Hongquan Song,Shenghui Zhou,Hui Zheng

DOI: https://doi.org/10.3390/rs14153571

IF: 5

2022-07-26

Remote Sensing

Abstract:Owing to a series of air pollution prevention and control policies, China's PM2.5 pollution has greatly improved; however, the long-term spatial contiguous products that facilitate the analysis of the distribution and variation of PM2.5 pollution are insufficient. Due to the limitations of missing values in aerosol optical depth (AOD) products, the reconstruction of full-coverage PM2.5 concentration remains challenging. In this study, we present a two-stage daily adaptive modeling framework, based on machine learning, to solve this problem. We built the annual models in the first stage, then daily models were constructed in the second stage based on the output of the annual models, which incorporated the parameter and feature adaptive tuning strategy. Within this study, PM2.5 concentrations were adaptively modeled and reconstructed daily based on the multi-angle implementation of atmospheric correction (MAIAC) AOD products and other ancillary data, such as meteorological factors, population, and elevation. Our model validation showed excellent performance with an overall R2 = 0.91 and RMSE = 9.91 μg/m3 for the daily models, along with the site-based cross-validation R2s and RMSEs of 0.86–0.87 and 12–12.33 μg/m3; these results indicated the reliability and feasibility of the proposed approach. The daily full-coverage PM2.5 concentrations at 1 km resolution across China during the Three-Year Blue-Sky Action Plan were reconstructed in this study. We analyzed the distribution and variations of reconstructed PM2.5 at three different time scales. Overall, national PM2.5 pollution has significantly improved with the annual average concentration dropping from 33.67–28.03 μg/m3, which demonstrated that air pollution control policies are effective and beneficial. However, some areas still have severe PM2.5 pollution problems that cannot be ignored. In conclusion, the approach proposed in this study can accurately present daily full-coverage PM2.5 concentrations and the research outcomes could provide a reference for subsequent air pollution prevention and control decision-making.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
A 30 m annual cropland dataset of China from 1986 to 2021

Ying Tu,Shengbiao Wu,Bin Chen,Qihao Weng,Yuqi Bai,Jun Yang,Le Yu,Bing Xu

DOI: https://doi.org/10.5194/essd-16-2297-2024

IF: 11.4

2024-05-07

Earth System Science Data

Abstract:Accurate, detailed, and up-to-date information on cropland extent is crucial for provisioning food security and environmental sustainability. However, because of the complexity of agricultural landscapes and lack of sufficient training samples, it remains challenging to monitor cropland dynamics at high spatial and temporal resolutions across large geographical extents, especially for regions where agricultural land use is changing dramatically. Here we developed a cost-effective annual cropland mapping framework that integrated time-series Landsat satellite imagery, automated training sample generation, as well as machine learning and change detection techniques. We implemented the proposed scheme to a cloud computing platform of Google Earth Engine and generated a novel dataset of China's annual cropland at a 30 m spatial resolution (namely CACD). Results demonstrated that our approach was capable of tracking dynamic cropland changes in different agricultural zones. The pixel-wise F 1 scores for annual maps and change maps of CACD were 0.79 ± 0.02 and 0.81, respectively. Further cross-product comparisons, including accuracy assessment, correlations with statistics, and spatial details, highlighted the precision and robustness of CACD compared with other datasets. According to our estimation, from 1986 to 2021, China's total cropland area expanded by 30 300 km 2 (1.79 %), which underwent an increase before 2002 but a general decline between 2002 and 2015, and a slight recovery afterward. Cropland expansion was concentrated in the northwest while the eastern, central, and southern regions experienced substantial cropland loss. In addition, we observed 419 342 km 2 (17.57 %) of croplands that were abandoned at least once during the study period. The consistent, high-resolution data of CACD can support progress toward sustainable agricultural use and food production in various research applications. The full archive of CACD is freely available at https://doi.org/10.5281/zenodo.7936885 (Tu et al., 2023a).

geosciences, multidisciplinary,meteorology & atmospheric sciences
Spatiotemporal Continuous Estimates of PM2.5 Concentrations in China, 2000-2016: A Machine Learning Method with Inputs from Satellites, Chemical Transport Model, and Ground Observations.

Tao Xue,Yixuan Zheng,Dan Tong,Bo Zheng,Xin Li,Tong Zhu,Qiang Zhang

DOI: https://doi.org/10.1016/j.envint.2018.11.075

IF: 11.8

2019-01-01

Environment International

Abstract:Ambient exposure to fine particulate matter (PM2.5) is known to harm public health in China. Satellite remote sensing measurements of aerosol optical depth (AOD) were statistically associated with in-situ observations after 2013 to predict PM2.5 concentrations nationwide, while the lack of surface monitoring data before 2013 have created difficulties in historical PM2.5 exposure estimates. Hindcast approaches using statistical models or chemical transport models (CTMs) were developed to overcome this limitation, while those approaches still suffer from incomplete daily coverage due to missing AOD data or limited accuracy due to uncertainties of CTMs. Here we developed a new machine learning (ML) model with high-dimensional expansion (HD-expansion) of numerous predictors (including AOD and other satellite covariates, meteorological variables and CTM simulations). Through comprehensive characterization of the nonlinear effects of, and interactions among different predictors, the HD-expansion parameterized the association between PM2.5 and AOD as a nonlinear function of space and time covariates (e.g., planetary boundary layer height and relative humidity). In this way, the PM2.5-AOD association can vary spatiotemporally. We trained the model with data from 2013 to 2016 and evaluated its performance using annually-iterated cross-validation, which iteratively held out the in-situ observations for a whole calendar year (as testing data) to examine the predictions from a model trained by the rest of the observations. Our estimates were found to be in good agreement with in-situ observations, with correlation coefficients (R2) of 0.61, 0.68, and 0.75 for daily, monthly and annual averages, respectively. To interpolate the missing predictions due to incomplete AOD data, we incorporated a generalized additive model into the ML model. The two-stage estimates of PM2.5 sacrificed the prediction accuracy on a daily timescale (R2 = 0.55), but achieved complete spatiotemporal coverage and improved the accuracy of monthly (R2 = 0.71) and annual (R2 = 0.77) averages. The model was then used to predict daily PM2.5 concentrations during 2000-2016 across China and estimate long-term trends in PM2.5 for the period. We found that population-weighted concentrations of PM2.5 significantly increased, by 2.10 (95% confidence interval (CI): 1.74, 2.46) μg/m3/year during 2000-2007, and rapidly decreased by 4.51 (3.12, 5.90) μg/m3/year during 2013-2016. In this study, we produced AOD-based estimates of historical PM2.5 with complete spatiotemporal coverage, which were evidenced as accurate, particularly in middle and long term. The products could support large-scale epidemiological studies and risk assessments of ambient PM2.5 in China and can be accessed via the website (http://www.meicmodel.org/dataset-phd.html).
High resolution spatiotemporal modeling of long term anthropogenic nutrient discharge in China

Haoran Zhang,Huihang Sun,Ruikun Zhao,Yu Tian,Yiming Meng

DOI: https://doi.org/10.1038/s41597-024-03102-9

2024-03-11

Scientific Data

Abstract:High-resolution integration of large-scale and long-term anthropogenic nutrient discharge data is crucial for understanding the spatiotemporal evolution of pollution and identifying intervention points for pollution mitigation. Here, we establish the MEANS-ST1.0 dataset, which has a high spatiotemporal resolution and encompasses anthropogenic nutrient discharge data collected in China from 1980 to 2020. The dataset includes five components, namely, urban residential, rural residential, industrial, crop farming, and livestock farming, with a spatial resolution of 1 km and a temporal resolution of monthly. The data are available in three formats, namely, GeoTIFF, NetCDF and Excel, catering to GIS users, researchers and policymakers in various application scenarios, such as visualization and modelling. Additionally, rigorous quality control was performed on the dataset, and its reliability was confirmed through cross-scale validation and literature comparisons at the national and regional levels. These data offer valuable insights for further modelling the interactions between humans and the environment and the construction of a digital Earth.

multidisciplinary sciences
Validation and Analysis of MAIAC AOD Aerosol Products in East Asia from 2011 to 2020

Ping Wang,Qingxin Tang,Yuxin Zhu,Ke Zheng,Tianquan Liang,Quanzhou Yu,Yaqian He

DOI: https://doi.org/10.3390/rs14225735

IF: 5

2022-11-13

Remote Sensing

Abstract:East Asia is one of the most important sources of aerosols in the world. The distribution of aerosols varies across time and space. Accurate aerosol data is crucial to identify its spatiotemporal dynamics; thus, it is of great significance to obtain and verify new aerosol data for this region. Based on the Aerosol Optical Depth (AOD) data of the Aerosol Robotic Network (AERONET) program for 17 stations from 2011 to 2020, this study comprehensively verified the accuracy and applicability of the Multi-Angle Implementation of Atmospheric Correction (MAIAC) AOD 1 km products among different seasons, elevations, and climate zones over entire East Asia. The results showed that: (1) The overall accuracy of MAIAC AOD was high in East Asia, and the accuracy of Terra was slightly better than that of Aqua. MAIAC AOD showed significant heterogeneity among sites. MAIAC AOD performed well in areas with high vegetation cover and flat terrain, while the inversion accuracy was relatively low in areas with low vegetation cover and high terrain. (2) In general, MAIAC AOD and AERONET AOD showed good agreement in different seasons, presenting as winter > spring > autumn > summer. Yet the accuracy and consistency of Terra AOD product were better than Aqua product. (3) MAIAC AOD showed different accuracy at different elevations and climate zones. It had a high correlation and best inversion accuracy with AERONET AOD at low and medium elevations. MAIAC AOD had better inversion accuracy in the arid and warm temperate zones than that in the equatorial and cold temperate zones. (4) AOD distribution and its trend showed significant spatial differences in East Asia. The high AOD values were dominant in the Sichuan basin and the eastern plains of China, as well as in India and Bangladesh, while the relatively low AOD values were distributed in southwestern China and the areas north of 40°N. AOD in most parts of East Asia showed a negative trend, indicating a great improvement in air quality in these regions.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
LGHAP v2: a global gap-free aerosol optical depth and PM2.5 concentration dataset since 2000 derived via big Earth data analytics

Kaixu Bai,Ke Li,Liuqing Shao,Xinran Li,Chaoshun Liu,Zhengqiang Li,Mingliang Ma,Di Han,Yibing Sun,Zhe Zheng,Ruijie Li,Ni-Bin Chang,Jianping Guo

DOI: https://doi.org/10.5194/essd-16-2425-2024

IF: 11.4

2024-05-23

Earth System Science Data

Abstract:The Long-term Gap-free High-resolution Air Pollutants (LGHAP) concentration dataset generated in our previous study has provided spatially contiguous daily aerosol optical depth (AOD) and fine particulate matter (PM 2.5 ) concentrations at a 1 km grid resolution in China since 2000. This advancement empowered unprecedented assessments of regional aerosol variations and their influence on the environment, health, and climate over the past 20 years. However, there is a need to enhance such a high-quality AOD and PM 2.5 concentration dataset with new robust features and extended spatial coverage. In this study, we present version 2 of a global-scale LGHAP dataset (LGHAP v2), which was generated using improved big Earth data analytics via a seamless integration of versatile data science, pattern recognition, and machine learning methods. Specifically, multimodal AODs and air quality measurements acquired from relevant satellites, ground monitoring stations, and numerical models were harmonized by harnessing the capability of random-forest-based data-driven models. Subsequently, an improved tensor-flow-based AOD reconstruction algorithm was developed to weave the harmonized multisource AOD products together for filling data gaps in Multi-Angle Implementation of Atmospheric Correction (MAIAC) AOD retrievals from Terra. The results of the ablation experiments demonstrated better performance of the improved tensor-flow-based gap-filling method in terms of both convergence speed and data accuracy. Ground-based validation results indicated good data accuracy of this global gap-free AOD dataset, with a correlation coefficient ( R ) of 0.85 and a root mean square error (RMSE) of 0.14 compared to the worldwide AOD observations from the AErosol RObotic NETwork (AERONET), outperforming the purely reconstructed AODs ( R = 0.83, RMSE = 0.15), but they were slightly worse than raw MAIAC AOD retrievals ( R = 0.88, RMSE = 0.11). For PM 2.5 concentration mapping, a novel deep-learning approach, termed the SCene-Aware ensemble learning Graph ATtention network (SCAGAT), was hereby applied. While accounting for the scene representativeness of data-driven models across regions, the SCAGAT algorithm performed better during spatial extrapolation, largely reducing modeling biases over regions with limited and/or even absent in situ PM 2.5 concentration measurements. The validation results indicated that the gap-free PM 2.5 concentration estimates exhibit higher prediction accuracies, with an R of 0.95 and an RMSE of 5.7 μg m −3 , compared to PM 2.5 concentration measurements obtained from former holdout sites worldwide. Overall, while leveraging state-of-the-art methods in data science and artificial intelligence, a quality-enhanced LGHAP v2 dataset was generated through big Earth data analytics by cohesively weaving together multimodal AODs and air quality measurements from diverse sources. The gap-free, high-resolution, and global coverage merits render the LGHAP v2 dataset an invaluable database for advancing aerosol- and haze-related studies as well as triggering multidisciplinary applications for environmental management, health-risk assessment, and climate change attribution. All gap-free AOD and PM 2.5 concentration grids in the LGHAP v2 dataset, as well as the data user guide and relevant visualization codes, are publicly accessible at https://zenodo.org/communities/ecnu_lghap (last access: 3 April 2024, Bai and Li, 2023a).

meteorology & atmospheric sciences,geosciences, multidisciplinary
Air Mass Exposure to Chlorophyll a (AEC) over the Eastern China Seas During 2009 to 2020

Shengqian Zhou,Ying Chen

DOI: https://doi.org/10.5281/zenodo.7056980

2022-01-01

Abstract:This dataset contains (1) air mass exposure to chlorophyll a (AEC) values, (2) air mass retention ratio over the land (RL), (3) marine air mss retention ratio within the boundary layer (RMBL), and (4) harmonic means of boundary layer height along the air mass trajectory (BLH_traj) over the eastern China seas spanning from 2009 to 2020. The domain (23−37° N, 117−130° E) includes the south Yellow Sea (YS), the East China Sea (ECS), and part of Northwest Pacific, which is divided into 145 grids with a spatial resolution of 1° × 1°. The time period is 1 January 2009 − 31 December 2020, and the time resolution is 6 hours. The tracking time of initial trajectory is 72 hours. The Matlab scripts for calculating the abovementioned indices are also given. The main code includes "AEC_Cal_Multi.m", "AirmasstoChla.m", and "BLH_traj_multi.m".
Estimating Hourly PM2.5 Concentrations Using Himawari-8 AOD and a DBSCAN-modified Deep Learning Model over the YRDUA, China

Xiaoman Lu,Jiajia Wang,Yingting Yan,Liguo Zhou,Weichun Ma

DOI: https://doi.org/10.1016/j.apr.2020.10.020

IF: 4.831

2021-01-01

Atmospheric Pollution Research

Abstract:In view of the spatial and temporal gaps left by the ground monitoring network for fine particulate matter (PM2.5), remote sensing has been regarded as an effective monitoring alternative to provide data of the PM2.5 distribution at a high resolution. Satellite-derived aerosol optical depth (AOD) is a parameter that has a good correlation with the PM2.5 concentration. In this study, a modified deep learning model was established to estimate hourly PM2.5 concentrations in the Yangtze River Delta Urban Agglomeration (YRDUA) region based on 5-km AOD data from Himawari-8. The model incorporated a density-based spatial clustering of applications-with-noise (DBSCAN) cluster analysis and a deep neural network (DNN) (denoted as DBSCAN–DNN) to construct individualized DNNs for the retrieval of PM2.5. The DBSCAN algorithm was used to identify the outlying datasets by involving the relationship between AOD–NO2 and PM2.5. The cluster analysis divided the inputs into separated clusters with distinct pollution levels, which helped to build a reference for the construction of individualized DNNs. The results showed that the DBSCAN–DNN model could greatly improve the estimation accuracy of the PM2.5 concentration based on identical inputs when compared with the pure DNN model. The 10-fold cross-validation R-value was enhanced by over 30%, with the highest R-value reaching 0.94 when applied to Shanghai dataset of 2018. The root-mean-square prediction error (RMSE) was also reduced by over 30%. In addition, the model performed well in generating hourly spatial estimations, thereby showing more detailed information for the dynamic changes of the PM2.5 concentration during the day. Moreover, according to the comparisons of five regional estimation results, the model was proven to have a good applicability to deal with a differentiated data volume and data complexity. This study not only proposes a new method to achieve PM2.5 estimations with a higher accuracy and spatiotemporal resolution, but also provides a new perspective for exploiting the sophisticated correlations among large environmental datasets by introducing pre-clustering into the deep learning approach.

A Novel Big Data Mining Framework for Reconstructing Large-Scale Daily MAIAC AOD Across China from 2000 to 2020

A novel big data mining framework for reconstructing large-scale daily MAIAC AOD data across China from 2000 to 2020

Mapping Annual Land Disturbance and Reclamation in a Surface Coal Mining Region Using Google Earth Engine and the LandTrendr Algorithm: A Case Study of the Shengli Coalfield in Inner Mongolia, China

MAIAC-based Long-Term Spatiotemporal Trends of PM2.5 in Beijing, China.

MAIAC-Based Long-Term Trends in Ambient PM2.5 and the Effects on Population Mortality in Beijing, China.

Full-coverage High-Resolution Daily PM2.5 Estimation Using MAIAC AOD in the Yangtze River Delta of China

A 15-Year Full-Coverage Daily PM1 Dataset Across China Based on a Data-Fusion Model

LGHAP: the Long-term Gap-free High-resolution Air Pollutant concentration dataset, derived via tensor-flow-based multimodal data fusion

Retrieving Hourly Seamless PM2.5 Concentration Across China with Physically Informed Spatiotemporal Connection

High-resolution Daily AOD Estimated to Full Coverage Using the Random Forest Model Approach in the Beijing-Tianjin-Hebei Region

When big data meets big smog: a big spatio-temporal data framework for China severe smog analysis.

Evaluation and analysis of long-term MODIS MAIAC aerosol products in China

Estimation of Anthropogenic Heat Emissions in China Using Cubist with Points-of-interest and Multisource Remote Sensing Data.

Full-Coverage PM2.5 Mapping and Variation Assessment during the Three-Year Blue-Sky Action Plan Based on a Daily Adaptive Modeling Approach

A 30 m annual cropland dataset of China from 1986 to 2021

Spatiotemporal Continuous Estimates of PM2.5 Concentrations in China, 2000-2016: A Machine Learning Method with Inputs from Satellites, Chemical Transport Model, and Ground Observations.

High resolution spatiotemporal modeling of long term anthropogenic nutrient discharge in China

Validation and Analysis of MAIAC AOD Aerosol Products in East Asia from 2011 to 2020

LGHAP v2: a global gap-free aerosol optical depth and PM2.5 concentration dataset since 2000 derived via big Earth data analytics

Air Mass Exposure to Chlorophyll a (AEC) over the Eastern China Seas During 2009 to 2020

Estimating Hourly PM2.5 Concentrations Using Himawari-8 AOD and a DBSCAN-modified Deep Learning Model over the YRDUA, China