Abstract:SummaryVisible–near infrared (vis–NIR) spectroscopy can be used to estimate soil properties effectively using spectroscopic calibrations derived from data contained in spectroscopic databases. However, these calibrations cannot be used with proximally sensed (field) spectra because the spectra in these databases are recorded in the laboratory and are different to field spectra. Environmental factors, such as the amount of water in the soil, ambient light, temperature and the condition of the soil surface, cause the differences. Here, we investigated the use of direct standardization (DS) to remove those environmental factors from field spectra. We selected 104 sensing (sampling) sites from nine paddy fields in Zhejiang province, China. At each site, vis–NIR spectra were recorded with a portable spectrometer. The soils were also sampled to record their spectra under laboratory conditions and to measure their soil organic matter (SOM) content. The resulting data were divided into training and validation sets. A subset of the corresponding field and laboratory spectra in the training set (the transfer set) was used to derive the DS transfer matrix, which characterizes the differences between the field and laboratory spectra. Using DS, we transferred the field spectra of the validation samples so that they acquired the characteristics of spectra that were measured in the laboratory. A partial least squares regression (PLSR) of SOM on the laboratory spectra of the training set was then used to predict both the original field spectra and the DS‐transferred field spectra. The assessment statistics of the predictions were improved from R2 = 0.25 and RPD = 0.35 to R2 = 0.69 and RPD = 1.61. We also performed independent predictions of SOM on the DS‐transferred field spectra with a PLSR derived using the Chinese soil spectroscopic database (CSSD), which was developed in the laboratory. The R2 and RPD values of these predictions were 0.70 and 1.79, respectively. Predictions of SOM with the DS‐transferred field spectra were more accurate than those treated with external parameter orthogonalisation (EPO), and more accurate than predictions made by spiking. Our results show that DS can effectively account for the effects of water and environmental factors on field spectra and improve predictions of SOM. DS is conceptually straightforward and allows the use of calibrations made with laboratory‐measured spectra to predict soil properties from proximally sensed (field) spectra, without needing to recalibrate the models.

Deployment strategy of multiple miniaturized near-infrared spectrometers based on spectral transfer for characterizing soil organic matter and nitrogen

Real-time Analysis of Soil Total N and P with Near Infrared Reflectance Spectroscopy

[Measurement of Soil Organic Matter with Near Infrared Spectroscopy Combined with Genetic Algorithm and Successive Projection Algorithm].

Spectral Feature Characterizing and Nitrogen Content Prediction in a Soil with Different Particle Size and Moisture Content

Broadening the Scope of Food Quality Control: a Calibration Transfer Strategy for Minimizing External Influences on Spectral Analysis

Measurement of Soil Total N Based on Portable Short Wave NIR Spectroscopy Technology

Application of Near-infrared Spectroscopy and Multiple Spectral Algorithms to Explore the Effect of Soil Particle Sizes on Soil Nitrogen Detection

Estimating model of soil total nitrogen content based on near-infrared spectroscopy analysis

Possibilities of Multi-spectral Data for the Assessment of Soil Nitrogen Content

Accounting for the Effects of Water and the Environment on Proximally Sensed Vis–nir Soil Spectra and Their Calibrations

Evaluating Calibration and Spectral Variable Selection Methods for Predicting Three Soil Nutrients Using Vis-NIR Spectroscopy

A New Coupled Elimination Method of Soil Moisture and Particle Size Interferences on Predicting Soil Total Nitrogen Concentration through Discrete NIR Spectral Band Data

Measurement and Analysis of Soil Nitrogen and Organic Matter Content Using Near-Infrared Spectroscopy Techniques.

Transferability of soil organic matter prediction models between different soil types based on improved standard-sample calibration transfer method

Potential Of Vis-Nir-Swir Spectroscopy From The Chinese Soil Spectral Library For Assessment Of Nitrogen Fertilization Rates In The Paddy-Rice Region, China

Quantitative Analysis of Soil Nitrogen, Organic Carbon, Available Phosphorous, and Available Potassium Using Near-Infrared Spectroscopy Combined with Variable Selection

Comparison between Random Forests, Artificial Neural Networks and Gradient Boosted Machines Methods of On-Line Vis-NIR Spectroscopy Measurements of Soil Total Nitrogen and Total Carbon

Measurement of Soil Total Nitrogen Using Near Inf Rared Spectroscopy Combined with RCA and SPA

Laboratory Assessment of Three Quantitative Methods for Estimating the Organic Matter Content of Soils in China Based on Visible/near-Infrared Reflectance Spectra

A New Approach to Detect Soil Nutrient Content Based on NIR Spectroscopy Technique

Using Diffuse Reflectance Spectroscopy as a High Throughput Method for Quantifying Soil C and N and Their Distribution in Particulate and Mineral-Associated Organic Matter Fractions