Global calibration model of UV-Vis spectroscopy for COD estimation in the effluent of rural sewage treatment facilities

Peng Li,Jiangbei Qu,Yiliang He,Zhang Bo,Mengke Pei

DOI: https://doi.org/10.1039/c9ra10732k

IF: 4.036

2020-01-01

RSC Advances

Abstract:In recent years, rural sewage treatment facilities have grown rapidly in China, and yet the water quality of the effluent has not been well monitored.

chemistry, multidisciplinary

What problem does this paper attempt to address?

Detection of COD in the Wastewater Treatment Process Based on Fluorescence Excitation-Emission Matrix Spectrometry

Du Shuxin,Wu Yuanqing,Yuan Zhibao

DOI: https://doi.org/10.4028/www.scientific.net/amm.178-181.599

2012-01-01

Applied Mechanics and Materials

Abstract:In the wastewater treatment process, it is necessary to detect the concentrations of organic matter in order to monitor the operation and adjust the process parameters. Based on fluorescence excitation-emission matrix spectrometry, Chemical oxygen demand (COD) of effluent wastewater in the primary sedimentation tank, the secondary sedimentation tank and the final sedimentation tank of Hengdian Wastewater Treatment Plant, Zhejiang Province, is detected respectively based on fluorescence excitation-emission matrix spectrometry. In order to compare the modeling performance, principal component regression (PCR), partial least squares (PLS), parallel factor analysis (PARAFAC) and multi-way partial least squares (N-PLS) are respectively used to build the calibration models between the fluorescence spectrometry and COD. Experimental results show PLS is better than PARAFAC and N-PLS in the aspect of modeling performance for detecting COD in the wastewater.
COD Detection in Wastewater Treatment Based on Three-dimensional Fluorescence Spectrometry

DU Shu-xin,WU Yuan-qing,WANG Jian

DOI: https://doi.org/10.3969/j.issn.1000-3932.2013.08.006

2013-01-01

Abstract:The three-dimensional fluorescence spectrometry was employed to analyze COD detection in the primary, secondary and final sedimentation tanks of a wastewater treatment plant;and the performance of calibration models respectively established with principal component regression(PCA),the partial least squares(PLS),the parallel factor analysis(PARAFAC) and the multi-way partial least squares(N-PLS) were compared to show that the conventional un-folded PLS method outperforms three-dimensional modeling methods like PARAFAC and N-PLS in COD detection.
Novel Method of Turbidity Compensation for Chemical Oxygen Demand Measurements by Using UV–vis Spectrometry

Hu Yingtian,Liu Chao,Wang Xiaoping

DOI: https://doi.org/10.1016/j.snb.2015.12.078

2017-01-01

IOP Conference Series Earth and Environmental Science

Abstract:In recent years, ultraviolet–visible spectroscopy has been widely used for chemical oxygen demand (COD) measurements of water. However, chemical compositions of substance in different water samples can cause measurement deviations, so a local calibration is needed. In this study, a novel local calibration method is proposed. The absorption spectra of COD standard solutions and wastewater samples taken from four factories were collected. We analyzed the impact of chemical compositions of substance in different water samples and extracted the morphology features of their absorptive spectra for recognition models. Furthermore, we calculated the local calibration parameters of the four categories of real water samples by specific modification based on the ability of light absorption in various water environments. After the process of local calibration, the root mean square errors (RMSEs) of the predictions were very small, which highlights the potential of this method for improving the accuracy and adaptability of COD measurements based on ultraviolet–visible spectrum.
DOM tracking and prediction of rural domestic sewage with UV-vis and EEM in the Yangtze River Delta, China

Jinjing Lan,Lili Liu,Xu Wang,Xiaoxin Wu,Zhiping Wang

DOI: https://doi.org/10.1007/s11356-022-20979-4

Abstract:Compared with the urban sewage treatment plants, the operation of rural decentralized sewage facilities is trapped by the absence of professionals, thus having to be run dependently on the self-adaptive operation of the facilities, which makes timely monitoring particularly important. In this study, organic pollutants in rural domestic sewage and urban domestic sewage are analyzed using ultraviolet-visible (UV-vis) absorption spectroscopy, fluorescence excitation-emission matrix (EEM) and Fourier transform infrared reflectance (FTIR). Compared with the UV-vis absorption spectrum, EEM can not only make up the deficiency in the detection of some easily degradable organics in sewage, but also reveal the transformation of different components, thus indicating timely the treatment progress of rural sewage. Linear fitting of COD and spectrum shows that UV254 combined with fluorescence excitation-emission at Ex/Em = 250/330 nm might be more suitable for the prediction of COD in rural water than the UV254 alone. This is of great significance for guiding the self-adaptive operation of rural domestic sewage facilities, improving their stability and efficiency, so as to improve the rural living environment.
Design for On-Line COD Measuring Instrument Based on Ultraviolet(uv) Absorptive Principle

SUN Ji-yang,WANG Xiao-ping,MI Yun-ping

DOI: https://doi.org/10.3969/j.issn.1005-5630.2006.02.016

2006-01-01

Abstract:Chemical oxygen demand(COD) is the representative index of organic sewage.In this paper,we introduce an on-line COD measuring instrument which is based on ultraviolet absorptive principle.In particular,we focus on its operating principle and structure.Based on experimental findings,we provide the correlation between ultraviolet absorbancy and COD.According the feasibility analysis,ultraviolet absorbancy can be used as a surrogate parameter of COD.The instrument can be applied to monitoring wastewater.Since this new analysis technology is faster,more reliable and cost efficient,we believe this will be the developing tendency of online COD monitoring.
A New Multi-Wavelength Analysis Method for Estimation of Total Organic Carbon in Urban Wastewater Using UV/Vis Spectrometry

Xiaoli Wu,Tiejun Wu

DOI: https://doi.org/10.1109/wcica.2004.1343164

2004-01-01

Abstract:Total organic carbon (TOC) is an important parameter to evaluate the organic pollution of water. A novel method to rapidly detect TOC of wastewater with UV/Vis spectroanalysis is presented in this paper. UV/Vis absorption spectra in the range of 250∼450 nm were utilised for regression and prediction. Multi-wavelength regression procedure was discussed, and boosting method was used to improve the accuracy of prediction. Experiments show that better prediction result can be gained by this adaptive method than by the traditional regression algorithms, such as PLS, non-linear PLS and RBF neural network. Meanwhile, the improved regression model shows a good correlation between the estimated TOC values and the chemical analysis values.
Design and Realization of a Multi-Spectra Based Portable Water Quality Analyzer

Mu Hai-Yang,Li Yan-jun,Wu Tie-jun

DOI: https://doi.org/10.1109/cmce.2010.5609846

2010-01-01

Abstract:Spectrum based water quality analyzer for comprehensive organic pollution index evaluating is a kind of green measurements with prosperous futures. Due to the low estimation precision of single-spectrum based analyzer and the complementary advantages of multi-spectrums, a modeling method based on information fusion of the ultra-violet absorption spectrum and the fluorescence emission spectrum is adopted for rapid measure of organic pollution indices such as COD, TOC, etc. A module structure is designed for portable realization to perform the field mobile tasks and rapid scene measurements. The experimental results show that this instrument possesses a better prediction capability than single UV based instruments popular in the market.
Rapid Detection of Chemical Oxygen Demand Using Least Square Support Vector Machines

Jun Fang,Liankui Dai

DOI: https://doi.org/10.1109/wcica.2004.1342200

2004-01-01

Abstract:A novel method to rapidly detect COD (Chemical Oxygen Demand) in polluted water with UV (ultra-violet) spectroanalysis is proposed in this paper. This method utilizes an on-line adaptive algorithm based upon LS-SVM (least square support vector machine), which can build adaptive models to predict the COD values of unknown water samples quickly and accurately. Practical application shows that this adaptive algorithm can build better estimation models than the traditional modeling techniques, such as MLR (multivariate linear regression), PLS (partial least square regression) and BPNN (back-propagation neural network) in terms of various statistical performance indices. Meanwhile, the new COD model shows a good correlation between COD estimated values and COD analysis values.
Estimation of Chemical Oxygen Demand by Ultraviolet Spectroscopic Profiling and Physical Parameters Using Ipw-Pls Algorithm

Jia-chen Li,Ping-jie Huang,Di-bo Hou,Guang-xin Zhang

DOI: https://doi.org/10.4028/www.scientific.net/amm.316-317.606

2013-01-01

Applied Mechanics and Materials

Abstract:In recent years, water pollution is increasing, especially organic pollution. The chemical oxygen demand (COD) is one of the most important evaluation index. Compared with the traditional chemical analysis method of COD, the method of spectrum analysis of organic pollutant concentration in water quality detection is fast, no chemical reagent and simple operation etc, and it is a kind of green testing technology. The current spectrum method of water quality analysis is usually based on single wavelength or the feature band extracted. It is lack of methods with the full spectrum scan. Based on water quality research, we choose the spectral analysis of COD as the objective. Combining the ultraviolet absorption spectrum with the conventional five physical parameters as the absorbance in the last wave band, we use the iterative predictor partial least squares algorithm to realize the rapid detection of water quality COD.
Novel Spectral COD Measurement Method Based on Identification of Water Samples

Lu Meng,Hu Ying-tian,Gao Ya,Wang Xiao-ping

DOI: https://doi.org/10.3964/j.issn.1000-0593(2017)12-3797-06

2017-01-01

Spectroscopy and spectral analysis

Abstract:Chemical oxygen demand (COD) is one of the important indicators of water quality. The COD measurement method based on UV/Vis absorption spectra has been widely used because of its advantages of high speed, real time results, void of reagents, and pollution-free. Different functional groups have different characteristic absorption spectra. In the application of the method to water samples with a stable solution, high COD measurement accuracy can be achieved by building a precise "UV/Vis Absorbance(Auv)-COD" computational model. However, when the method is used for water samples with variable components, the measurement precision is low, limiting its applicability. This study proposes a new method based on dynamic identification of water sample type. The LM-BP neural network algorithm is used for the identification of water samples in this paper. And the morphology characteristics of the absorption spectra were used as the input parameters of water sample identification models. In the application of COD measurement, the water sample's absorption spectra have a time correlation. Based on the foundation laid by traditional spectrum identification techniques, the algorithm was optimized in accordance with the characteristics of COD measurement. The concept of historical data queue and historical identification factor was introduced into LM-BP artificial neural network and forms the cascaded network structure. Experiments show that the method exhibited better robustness and higher accuracy than traditional algorithms, because the cascaded network is relatively more able to adapt the characteristics of the COD measurement. The test yielded a 98% identification accuracy rate, which can provide a technical guarantee for the application of spectral COD measurement in a complex environment. In this paper, the sensor structure and the proposed algorithm are simple as well, which can be used in the portable instrument with limited resource. The UV/Vis-COD measurement method based on the water sample identification algorithm can achieve improved accuracy compared to the traditional method, which calculates all water sample types with the same computational model. The proposed method is expected to solve the problem that traditional UV/Vis-COD measurement methods face regarding difficulties adapting when applied to complex environments while still achieving high COD measurement accuracy.
A Water Monitoring and Early Warning System of COD Using UV-Vis Spectroscopy

T. Yuan,Tang Ge,Zhang Zhen,Xiong Shuang-fei,Wu De-chao,L. Juan,W. Biao,Feng Peng

DOI: https://doi.org/10.11648/J.IJEMA.20150305.19

2015-11-12

Abstract:A distributed remote water monitoring and early warning system was proposed, which used the UV-Vis spectroscopy, GPS, GIS, 4G network, COD solution and database technology, to solve the problems including long detection cycle, limited scale and the lack of early warning mechanism of the water monitoring. 50 groups of original water sample from Ciqikou to Chaotianmen of Jialing River in Chongqing, China (every 5 km decorate a monitoring node, every 60 minutes collect data) was selected to study distributed remote water monitoring and early warning system of COD in UV-Vis spectroscopy based on 4G networks. The results indicated that through the system, not only the real-time display and storage, historical data query and warning function of water quality monitoring information could be achieved, but also the status of the water quality environment on the basis of COD can be reflected, which has a strong practicability and can provide environmental monitoring departments with real-time water quality information.

Environmental Science
Multi-sensor Fusion and Feature Selection in Ultraviolet-Visible Spectrometry System for Predicting Chemical Oxygen Demand

Jian Zhang,Dibo Hou,Huang Ping-jie,Guangxin Zhang,Leilei Dai,Jiachen Li,Tianlong Lu,Shu Liu

DOI: https://doi.org/10.1109/icca.2014.6871041

2014-01-01

Abstract:The ultraviolet-visible (UV-Vis) spectrometry system is increasingly employed in chemical oxygen demand (COD) predicting recently for its significant advantages compared with traditional standard chemical method. In this study, an investigation is undertaken to determine whether the physic-chemical parameters of samples provide a good compensation for prediction. Meanwhile, a feature selecting algorithm is employed to reduce the size of UV-Vis absorption spectroscopy provided as data input to the modeling algorithm. A high correlation of above 0.90 is obtained with the data using the stand chemical method, while less absorbance values are necessary to measure and a spectrometer with industrial wavelength resolution is adequate.
Ultraviolet scanning technique for water COD measurement and its instrument development

Xiao-ping WANG,Zhen LIN,Xin JIN

DOI: https://doi.org/10.3785/j.issn.1008-973X.2006.11.024

2006-01-01

Abstract:A method based on all band ultraviolet scanning for measuring water chemical oxygen demand (COD) was introduced, and the method was applied to develop an on-line COD measuring instrument. This instrument used embedded microcomputer system to collect and calculate the real-time multiple ultraviolet absorbance obtained by ultraviolet scanning system. Back propagation (BP) neutral network was used to establish mathematical model between ultraviolet absorbance and COD, which was applied to calculate COD from the ultraviolet absorbance of practical water sample by using Levenberg-Marquardt rapid algorithm. The testing results show that the instrument has high accuracy and no secondary pollution.
Research on COD measurement method based on UV-Vis absorption spectra of transmissive and reflective detection systems

Xin Xu,Jihui Wang,Jianan Li,Axin Fan,Yuhan Zhang,Chang Xu,Haolin Qin,Feng Mu,Tingfa Xu

DOI: https://doi.org/10.3389/fenvs.2023.1175363

IF: 5.411

2023-04-12

Frontiers in Environmental Science

Abstract:The world's rapid industrialisation and population expansion have led to water pollution, causing significant disruption to the activities of humans, animals, and plants. Organic contamination content in water is commonly evaluated by measuring the chemical oxygen demand (COD). However, traditional COD detection methods often require additional reagents, resulting in secondary contamination and extended detection time. In this study, we propose and implement a reflective detection system that measures the UV-Vis absorption spectra of COD in water without contact measurement. We compared the modeling results of the transmissive and reflective detection systems using three regression analysis algorithms. We also assessed the modeling results using various spectral preprocessing and different feature selection bands. The results of the standard samples confirmed the viability of the reflective detection system for detecting COD, with the impressive coefficient of determination ( R 2 ) of 0.98892, the root mean square error (RMSE) of 2.86776, and the detection time of only 47.6 s. For the transmissive detection system, the R 2 was 0.99976, the RMSE was 0.41979, and the detection time was 162.4 s. Overall, this study proposes two referenceable detection methods for measuring COD concentrations, which can be adapted to suit various job demands.

environmental sciences
A New Method To Rapidly Determine Quality Of Waste Water

xin zhao,kun yang,strong,shichang huang

2010-01-01

Abstract:With the increase of water pollution, the standards of drinking water supply and wastewater discharge become stringent. Efficient methods for water analysis need to be developed in order to achieve higher water qualities. The common methods for chemical oxygen demand (COD) determination of waste water, such as the dichromate titration method and a flow injection, are time-consuming and complex. Therefore, near-infrared (NIR) spectroscopy, which offers a number of advantages over traditional chemical methods, was employed in this work to determine COD and pH in waste water rapidly. Calibration models for COD and pH were established by correlating the reference data (obtained from the analysis with the dichromate titration method) with the data of NIR spectra using a partial least-squares (PLS) regression. The results indicate that the performance of PLS regression models are good to predict COD and pH value, with high correlation coefficients and low root mean square error. The COD PLS model using raw spectra gives the best prediction. The pH PLS model using first derivative and 4 latent variables has the best prediction. The results suggest that NIR spectroscopy is an alternative method, relative to the traditional chemical methods, for the rapid analysis of COD and pH value in waste water.
Approach to rapid detection of chemical oxygen demand in livestock wastewater based on spectroscopy technology

Song Haiyan,Cen Haiyan,Ying Xiafang,Bao Yidan,Huang Min,He Yong

DOI: https://doi.org/10.3321/j.issn:1002-6819.2006.06.031

2006-01-01

Abstract:Chemical oxygen demand (COD) is an important index in evaluating the pollution degree of the wastewater. Traditional methods cannot satisfy the demand of the wastewater detection for its high cost, long time, and second pollution. A rapid measurement method was put forward in this paper by using spectroscopy techniques. A total of 18 wastewater samples with different concentrations (1000 mL, 2000 mL) were measured using the ASD Handheld FieldSpec spectrometer. The results from both spectral absorbance and COD values in wastewater show that there are high correlation coefficients between spectral features and COD values. The partial least square regression models were therefore developed. The r2 values between measured and predicted values of COD in wastewater with containers of 1000 mL and 2000 mL were 0.9895 and 0.9985, the standard errors of calibration were 14.2 and 11.5, and standard errors of prediction were 22 and 32, respectively. The relative standard deviations for unknown samples were below 10%. The tested precision can meet the requirements of the application in agriculture engineering. Compared with standard chemical method, it indicates that the spectroscopy technique can be applied in the quantitative analysis of COD in livestock wastewater, and the predictive model for COD provides a basis for developing potable instrument to detect water quality on line.
An improved prediction model for COD measurements using UV-Vis spectroscopy

Li Guan,Yijun Zhou,Sen Yang

DOI: https://doi.org/10.1039/d3ra05472a

2024-01-02

Abstract:In the 21st century, although water quality has been improved in the last two decades, water pollution by organic contaminants has remained a non-negligible issue in China, so Chemical-Oxygen Demand (abbreviated as COD, unit: mg L-1) is often used as the main index to measure the degree of surface water pollution. UV-Vis spectroscopy, as a sensitive and rapid analytical technique, is a green detection technology suitable for automatic online COD detection equipment. However, due to the complex composition of surface water, the interference degree of the UV-Vis spectrum caused by turbidity is strongly correlated with the size, type and color of particulate matter in the solution, which results in noise sensitivity and poor generalization of the current detection model. Therefore, the main purpose of this research is to improve the traditional detection model performance by using deep learning and a spectrum preprocessing algorithm. Firstly, we used an improved noise filter based on discrete wavelet transforms to solve the noise sensitivity. Secondly, we proposed a novel COD detection network to address poor generalization. Thirdly, we collected a total of 2259 water samples' UV-Vis absorption spectra and corresponding COD as a dataset. Then, we pipelined the improved noise removal algorithm and proposed COD detection network, as a complete COD prediction model. Finally, the experiment on the dataset shows that the COD prediction model has a good performance in terms of both noise tolerance and accuracy.
Water quality analysis by UV-Vis spectroscopy: A review of methodology and application

HOU Di-bo,Jianjun Zhang,Lin Chen,HUANG Ping-jie,ZHANG Guang-xin

DOI: https://doi.org/10.3964/j.issn.1000-0593(2013)07-1839-06

2013-01-01

Spectroscopy and spectral analysis

Abstract:Compared with the traditional approaches, UV-Vis spectroscopy is gaining growing acceptance in the field of online water-quality monitoring as an effective method for water quality analysis. UV-Vis spectroscopy has the advantages of fast response, low maintenance costs, and no secondary pollution. In the present paper, the principle of water quality analysis by UV-Vis spectroscopy is introduced. Existing researches on the online analysis of water quality using UV-Vis spectrum and data fusion technologies are comprehensively reviewed. The applications of UV-Vis based methods in multi-parameter water-quality monitoring, water-quality classification, and water-quality alarm are also discussed. Finally, future research directions are outlined.
Quantitative analysis of water quality parameters COD measurement based on spectral data fusion

Qing Chen,Mingfu Zhao,Ninghui Yang,Linfeng Cai,Jinfu Zhang,Junfeng Miao,Qisen Xiao,Bin Tang,Han Liu,Zourong Long

DOI: https://doi.org/10.1117/12.2656746

2022-10-20

Abstract:UV-Vis absorption spectroscopy is often used to measure COD values. At present, certain points or wavelengths in the spectrum are often obtained for modeling, resulting in deviations in predicting COD values. Aiming at this problem, this study adopts a data fusion method of multi-source spectroscopy (Raman spectroscopy and UV-Vis absorption spectroscopy) to improve the accuracy of predicted COD values. In the experiment, two groups of single spectrum and multi-source spectrum were used for comparison. Potassium hydrogen phthalate was used to simulate the COD value of water quality. The range of COD was 5-100mg/L, and the concentration gradient was 5mg/L. The data fusion of multisource spectra in the experiment uses the normalization method to remove the dimension and then cascades into a new data set matrix. The eigenvalues are screened out through the importance analysis of projection variables, and finally the processed matrix is combined with the partial least squares regression method. The experiment was modeled with 19 training groups, and 1 group was used to verify whether the model was good or bad. The experimental results use the two dimensions of root mean square error and coefficient of determination to evaluate the quality of the model. UV-Vis absorption spectrum R2=0.9993, RMSECV=1.8525; data-level fusion R2=0.9668, RMSECV=1.6113; feature-level fusion R2=0.9766, RMSECV=1.2957. The experimental results show that multi-source spectral fusion has a positive impact on improving the detection of water quality parameters, and the fusion model has stronger predictive ability.

Environmental Science,Chemistry,Engineering
Rapid determination of chemical oxygen demand(COD),biochemical oxygen demand(BOD_5) and pH in wastewater using near-infrared spectroscopy

HE Jincheng,YANG Xianglong,WANG Liren,PAN Jinming

2007-01-01

Abstract:The aim of this study is to develop a multi-index water quality characterization protocol using near infrared(NIR) spectroscopy.Two hundred wastewater samples were collected from a wastewater treatment plant,a fishpond and a hoggery.The spectral data were collected in the region of 800 ~ 2500nm using InGaAs detectors at a 4cm-1 resolution using cell pathlengths of 2mm and 10mm.A partial least squares(PLS) model for the determination of chemical oxygen demand(COD),biochemical oxygen demand(BOD5) and pH was developed.The calibration coefficient and standard error were 0.975 and 19.9 mg·L-1 for COD;0.759 and 32.7 mg·L-1 for BOD5;0.966 and 0.165 for pH.The correlation coefficient and the standard error of prediction were 0.945 and 29.4 mg·L-1 for COD;0.6939 and 37.9 mg·L-1 for BOD5;and 0.927 and 0.208 for pH.These results indicate that NIR spectroscopy has great potential for application in the determination of multi-index wastewater quality parameters.

Global calibration model of UV-Vis spectroscopy for COD estimation in the effluent of rural sewage treatment facilities

Detection of COD in the Wastewater Treatment Process Based on Fluorescence Excitation-Emission Matrix Spectrometry

COD Detection in Wastewater Treatment Based on Three-dimensional Fluorescence Spectrometry

Novel Method of Turbidity Compensation for Chemical Oxygen Demand Measurements by Using UV–vis Spectrometry

DOM tracking and prediction of rural domestic sewage with UV-vis and EEM in the Yangtze River Delta, China

Design for On-Line COD Measuring Instrument Based on Ultraviolet(uv) Absorptive Principle

A New Multi-Wavelength Analysis Method for Estimation of Total Organic Carbon in Urban Wastewater Using UV/Vis Spectrometry

Design and Realization of a Multi-Spectra Based Portable Water Quality Analyzer

Rapid Detection of Chemical Oxygen Demand Using Least Square Support Vector Machines

Estimation of Chemical Oxygen Demand by Ultraviolet Spectroscopic Profiling and Physical Parameters Using Ipw-Pls Algorithm

Novel Spectral COD Measurement Method Based on Identification of Water Samples

A Water Monitoring and Early Warning System of COD Using UV-Vis Spectroscopy

Multi-sensor Fusion and Feature Selection in Ultraviolet-Visible Spectrometry System for Predicting Chemical Oxygen Demand

Ultraviolet scanning technique for water COD measurement and its instrument development

Research on COD measurement method based on UV-Vis absorption spectra of transmissive and reflective detection systems

A New Method To Rapidly Determine Quality Of Waste Water

Approach to rapid detection of chemical oxygen demand in livestock wastewater based on spectroscopy technology

An improved prediction model for COD measurements using UV-Vis spectroscopy

Water quality analysis by UV-Vis spectroscopy: A review of methodology and application

Quantitative analysis of water quality parameters COD measurement based on spectral data fusion

Rapid determination of chemical oxygen demand(COD),biochemical oxygen demand(BOD_5) and pH in wastewater using near-infrared spectroscopy