XForms in X-Smiles

M. Honkala,P. Vuorimaa

DOI: https://doi.org/10.1023/A:1013853416747

2001-12-03

Abstract:

What problem does this paper attempt to address?

Detection of Specific Contamination Events in Water Distribution System Using Ultraviolet Spectra.

Hang Yin,Qiaojun Yu,Hui Dong,Dibo Hou,Pingjie Huang,Guanxin Zhang

DOI: https://doi.org/10.1109/i2mtc.2018.8409760

2018-01-01

Abstract:In recent years, issues surrounding water quality's security have attracted attention. The use of UV/VIS spectrum, for the in-situ detection of water-quality anomalies, has several advantages: it is free of reagent, has a low cost and facilitates rapid analysis. For these reasons, it is one of the more popular research trends for urban distribution water systems. This paper proposes using the UV-VIS spectrum detection method to resolve the problems of existing methods, which cannot distinguish specific contaminants. We made a pretreatment using orthogonal projection to correct the gap between different batches of spectral data. We then used Partial Least Squares Discriminatory Analysis to extract features from the data set. A comparison of the alarm signal with the optimal threshold, revealed outliers from the training set. Finally, we used the Sequential Bayesian Method to update the probability of Contaminate Intrusion Events and to obtain the alarm sequence. Our results show that this new method is effective in detecting specific contamination, which can assist existing methods to confirm contamination types.
Online Detecting Water Quality Anomaly from UV/Vis Spectra Using Baseline Correction and Principal Component Analysis Method

Guo Bing-bing,Hou Di-bo,Jin Yu,Yin Hang,Huang Ping-jie,Zhang Guang-xin,Zhang Hong-jian

DOI: https://doi.org/10.3964/j.issn.1000-0593(2017)05-1460-06

2017-01-01

Spectroscopy and spectral analysis

Abstract:In recent years, water quality security issue has aroused widespread social concerns. Ultraviolet and visible absorption spectrum for real-time monitoring of water quality has the advantages of in-situ detection as well as no need for reagents and rapid analysis, which makes it suitable for online detection. However, the ultraviolet and visible spectra are of large size and easily interfered by instrument and the normal water quality fluctuation, which affect the water quality anomaly detection result. In this paper, the baseline correction and principal component analysis method for UV/Vis spectra is proposed to detect abnormal water quality. The asymmetric least squares algorithm is used to correct the baseline and the principal component analysis for UV/Vis spectral matrix is adopted to reduce dimensions and extract features. Afterwards the outliers in the test samples are evaluated according to the Q statistic in the residual subspace. Finally, anomalies warning is updated by calculating the cumulative probability. The performance of the proposed method is evaluated by using data from phenol injection experiments. Results show that the proposed method effectively improves the detection limit of pollutants and has a higher detection rate and lower false alarm rate compared with the result without baseline correction.
Real-time Detection of Organic Contamination Events in Water Distribution Systems by Principal Components Analysis of Ultraviolet Spectral Data

Jian Zhang,Dibo Hou,Ke Wang,Pingjie Huang,Guangxin Zhang,Hugo Loáiciga

DOI: https://doi.org/10.1007/s11356-017-8907-7

IF: 5.8

2017-01-01

Environmental Science and Pollution Research

Abstract:The detection of organic contaminants in water distribution systems is essential to protect public health from potential harmful compounds resulting from accidental spills or intentional releases. Existing methods for detecting organic contaminants are based on quantitative analyses such as chemical testing and gas/liquid chromatography, which are time- and reagent-consuming and involve costly maintenance. This study proposes a novel procedure based on discrete wavelet transform and principal component analysis for detecting organic contamination events from ultraviolet spectral data. Firstly, the spectrum of each observation is transformed using discrete wavelet with a coiflet mother wavelet to capture the abrupt change along the wavelength. Principal component analysis is then employed to approximate the spectra based on capture and fusion features. The significant value of Hotelling's T2 statistics is calculated and used to detect outliers. An alarm of contamination event is triggered by sequential Bayesian analysis when the outliers appear continuously in several observations. The effectiveness of the proposed procedure is tested on-line using a pilot-scale setup and experimental data.
Classification of water contamination developed by 2-D Gabor wavelet analysis and support vector machine based on fluorescence spectroscopy.

P Huang,T Mao,Q Yu,Y Cao,J Yu,G Zhang,D Hou

DOI: https://doi.org/10.1364/OE.27.005461

IF: 3.8

2019-01-01

Optics Express

Abstract:The identification of the specific categories of pollutants in the urban water supply system is necessary. Traditional detection methods are based mainly on common water quality indicators. However, inspecting these water quality indicators is made difficult by issues such as long analysis time, insufficient sensitivity, need for reagents, and generation of waste liquid. These problems hinder high-frequency water detection and monitoring. In this study, three-dimensional (3D) fluorescence spectroscopy is adopted as a monitoring method for water quality. An identification method based on two-dimensional (2D) Gabor wavelets and support vector machine (SVM) multi-classification is also proposed. The Delaunay triangulation method for interpolation is used to pre-process 3D fluorescence spectra and thereby eliminate Rayleigh scattering and Raman scattering. A 2D Gabor wavelet function generated by filters of different scales and rotation angles is proposed to extract the features of the spectra. The block statistics method, based on Gabor feature description, is employed to enhance the efficiency in describing spectra features. Then, multiple SVM classifiers are used in pollutant classification and recognition. By comparing the proposed method with principal component analysis, which is a commonly used feature extraction method, this study finds that the application of 2D Gabor wavelets and block statistics can effectively describe the characteristics of 3D fluorescence spectra. Moreover, 2D Gabor wavelets achieve high classification accuracy, especially for substances with closely positioned or overlapping characteristic peaks. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Ultraviolet Spectrum Analysis Methods for Detecting the Concentration of Organic Pollutants in Water

Wu Yuan-qing,Du Shu-xin,Yan Yun

DOI: https://doi.org/10.3964/j.issn.1000-0593(2011)01-0233-05

2011-01-01

Abstract:The absorption rate of ultraviolet could be used to measure the concentration of organic pollutant, as most of the organic pollutant has stronger absorption rate in ultraviolet region in water. In the present paper, principal component regression (PCR), partial least squares (PLS), and support vector machine (SVM) were respectively used to model a regression model after the spectrum preprocessing, such as smoothing, derivation, standard normal variate transformation (SNV), etc. Then, the concentration of organic pollutant could be measured via the ultraviolet spectrum and the regression model. In the experiments, a group of water samples from the wastewater treatment process were used to verify the effects of the various preprocessing and modeling approaches. The results showed that for the good spectrum data, direct modeling without the spectrum pretreatment could be used since the pretreatment would worsen the results. LSSVM approach is more applicable in the case of small-size samples.
Online Monitoring of Water-Quality Anomaly in Water Distribution Systems Based on Probabilistic Principal Component Analysis by UV-Vis Absorption Spectroscopy

Dibo Hou,Shu Liu,Jian Zhang,Fang Chen,Pingjie Huang,Guangxin Zhang

DOI: https://doi.org/10.1155/2014/150636

2014-01-01

Journal of Spectroscopy

Abstract:This study proposes a probabilistic principal component analysis- (PPCA-) based method for online monitoring of water-quality contaminant events by UV-Vis (ultraviolet-visible) spectroscopy. The purpose of this method is to achieve fast and sound protection against accidental and intentional contaminate injection into the water distribution system. The method is achieved first by properly imposing a sliding window onto simultaneously updated online monitoring data collected by the automated spectrometer. The PPCA algorithm is then executed to simplify the large amount of spectrum data while maintaining the necessary spectral information to the largest extent. Finally, a monitoring chart extensively employed in fault diagnosis field methods is used here to search for potential anomaly events and to determine whether the current water-quality is normal or abnormal. A small-scale water-pipe distribution network is tested to detect water contamination events. The tests demonstrate that the PPCA-based online monitoring model can achieve satisfactory results under the ROC curve, which denotes a low false alarm rate and high probability of detecting water contamination events.
Optical detection of contamination event in water distribution system using online Bayesian method with UV–Vis spectrometry

Ke Wang,Jie Yu,Dibo Hou,Hang Yin,Qiaojun Yu,Pingjie Huang,Guangxin Zhang

DOI: https://doi.org/10.1016/j.chemolab.2019.07.006

IF: 4.175

2019-01-01

Chemometrics and Intelligent Laboratory Systems

Abstract:The detection of contamination events in water distribution systems remains a major concern to public health. However, much of the contaminant detection methods are supervised learning which cannot adapt to the complex environment in practical applications. In this work, a contaminant detection method using ultraviolet–visible spectroscopy technique was developed to achieve a goal of real-time detection on online acquisition of absorbance spectra. This method combined the advantages of probability distribution, message-passing algorithm and Bayesian theory. Message-passing algorithm was used to achieve a goal of online detection on noisy UV–Vis spectra signals. The proposed Bayesian algorithm organized the message passing schedule and helped to extract sequential patterns for event classification, which can avoid extreme conclusions. In addition, parameters were set up based on reasonable prior, by which the detection model was dynamically updated. Pilot scale experiment was conducted for long-term online monitoring of the water distribution system. And the experiment results showed improved performances in its ability to detect contamination events with higher probabilities, compared to previous studies.
In-Situ Detection of Water Quality Anomaly with UV/Vis Spectrum Based on Supervised Learning

Yin Hang,Yu Qiao-jun,Hou Di-bo,Huang Ping-jie,Zhang Guang-xin,Zhang Hong-jian

DOI: https://doi.org/10.3964/j.issn.1000-0593(2019)02-0491-09

2019-01-01

Spectroscopy and spectral analysis

Abstract:Water resources are related to national economy and people's livelihood, detection of water quality anomaly has attracted more attention because of the water pollution events happened in recent years. In this paper, the detection method of water quality anomaly with UV-Vis Spectrum based on supervised learning was proposed to solve the problems of existing methods, which behaved as a high detection limit and poor adaptability method. The pretreatment of orthogonal projection was used to correct the gap between different batches of spectral data. Afterwards the Partial Least Squares Discriminatory Analysis was adopted to extract the features from the data set. Outliers were found by comparing the alarm signal with the best threshold from the training set. Finally, Sequential Bayesian Method was used to update the probability of Contaminate Intrusion Events and to get the alarm sequence. The results showed that the proposed method had the lower detection limit than unsupervised method and the pretreatment of orthogonal projection improved the adaptability of detection method based on supervised learning for baseline changing.
Water Quality Detection Using Uv Spectra Based on the Pca Algorithm

Lei-lei Dai,Ping-jie Huang,Di-bo Hou,Guang-xin Zhang

DOI: https://doi.org/10.4028/www.scientific.net/amm.316-317.690

2013-01-01

Applied Mechanics and Materials

Abstract:Nowadays water pollution is a major problem facing our country, how to detect the water quality anomalies quickly is a major issue which needs to be solved urgently. In this paper, using PCA and cluster analysis methods, the similarities and differences of different water samples are analyzed. Meanwhile, two water samples belonging to the same river can be classified into different clusters due to different pollution degrees. It is promising that detecting the abnormal events based on the ultraviolet spectrum of water is possible. The research and results of this paper provide theoretical support and feasibility roadmap of the technology.
Applications of Online UV-Vis Spectrophotometer for Drinking Water Quality Monitoring and Process Control: A Review

Zhining Shi,Christopher W. K. Chow,Rolando Fabris,Jixue Liu,Bo Jin

DOI: https://doi.org/10.3390/s22082987

IF: 3.9

2022-04-13

Sensors

Abstract:Water quality monitoring is an essential component of water quality management for water utilities for managing the drinking water supply. Online UV-Vis spectrophotometers are becoming popular choices for online water quality monitoring and process control, as they are reagent free, do not require sample pre-treatments and can provide continuous measurements. The advantages of the online UV-Vis sensors are that they can capture events and allow quicker responses to water quality changes compared to conventional water quality monitoring. This review summarizes the applications of online UV-Vis spectrophotometers for drinking water quality management in the last two decades. Water quality measurements can be performed directly using the built-in generic algorithms of the online UV-Vis instruments, including absorbance at 254 nm (UV254), colour, dissolved organic carbon (DOC), total organic carbon (TOC), turbidity and nitrate. To enhance the usability of this technique by providing a higher level of operations intelligence, the UV-Vis spectra combined with chemometrics approach offers simplicity, flexibility and applicability. The use of anomaly detection and an early warning was also discussed for drinking water quality monitoring at the source or in the distribution system. As most of the online UV-Vis instruments studies in the drinking water field were conducted at the laboratory- and pilot-scale, future work is needed for industrial-scale evaluation with ab appropriate validation methodology. Issues and potential solutions associated with online instruments for water quality monitoring have been provided. Current technique development outcomes indicate that future research and development work is needed for the integration of early warnings and real-time water treatment process control systems using the online UV-Vis spectrophotometers as part of the water quality management system.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Investigating Effectiveness of Sensor Placement Strategies in Contamination Detection within Water Distribution Systems

Jiawen Du,Kegong Diao,Tuqiao Zhang,Tingchao Yu,Yu Shao

DOI: https://doi.org/10.1061/(ASCE)WR.1943-5452.0000919

IF: 3.457

2018-01-01

Journal of Water Resources Planning and Management

Abstract:Water quality sensors placed in water distribution systems (WDSs) are critical for detecting accidental or intentional contamination intrusion. This motivates research to optimally place a limited number of sensors for a given WDS aimed to maximize the detection effectiveness (e.g.,the detection likelihood and time to detection). Typically, effectiveness of a sensor placement strategy (SPS) is assessed using the expected impact across a number of contamination scenarios. Despite the value of such an approach, it may provide limited information on the SPS's comprehensive properties in detection, such as the SPS's ability to detect events with different levels of consequences, or to reduce the impacts from undetectable events. To address this limitation, this study investigates the underlying characteristics of the SPS's effectiveness for contamination detection using a set of metrics focusing on detection time, consumption of contaminated water, the number of contaminated demand nodes, and the contaminated spatial distance. The former two are derived from detectable contamination scenarios and the latter two are computed from both detectable and undetectable contamination scenarios. The proposed method is illustrated for two real-world WDSs, and the results reveal the underlying properties of the SPS's utility in contamination detection, which is significantly more informative than the measure of expected impacts. Such improved understanding provides guidance for selecting the most appropriate SPS and for improving preparedness for contamination events.
In situ detection of water quality contamination events based on signal complexity analysis using online ultraviolet-visible spectral sensor

Pingjie Huang,Ke Wang,Dibo Hou,Jian Zhang,Jie Yu,Guangxin Zhang

DOI: https://doi.org/10.1364/AO.56.006317

2017-08-01

Abstract:The contaminant detection in water distribution systems is essential to protect public health from potentially harmful compounds resulting from accidental spills or intentional releases. As a noninvasive optical technique, ultraviolet-visible (UV-Vis) spectroscopy is investigated for detecting contamination events. However, current methods for event detection exhibit the shortcomings of noise susceptibility. In this paper, a new method that has less sensitivity to noise was proposed to detect water quality contamination events by analyzing the complexity of the UV-Vis spectrum series. The proposed method applied approximate entropy (ApEn) to measure spectrum signals' complexity, which made a distinction between normal and abnormal signals. The impact of noise was attenuated with the help of ApEn's insensitivity to signal disturbance. This method was tested on a real water distribution system data set with various concentration simulation events. Results from the experiment and analysis show that the proposed method has a good performance on noise tolerance and provides a better detection result compared with the autoregressive model and sequential probability ratio test.
Detection of Water Contamination Events Using Fluorescence Spectroscopy and Alternating Trilinear Decomposition Algorithm

Jie Yu,Xiaoyan Zhang,Dibo Hou,Fang Chen,Tingting Mao,Pingjie Huang,Guangxin Zhang

DOI: https://doi.org/10.1155/2017/1485048

2017-01-01

Journal of Spectroscopy

Abstract:The method based on conventional index and UV-vision has been widely applied in the field of water quality abnormality detection. This paper presents a qualitative analysis approach to detect the water contamination events with unknown pollutants. Fluorescence spectra were used as water quality monitoring tools, and the detection method of unknown contaminants in water based on alternating trilinear decomposition (ATLD) is proposed to analyze the excitation and emission spectra of the samples. The Delaunay triangulation interpolation method was used to make the pretreatment of three-dimensional fluorescence spectra data, in order to estimate the effect of Rayleigh and Raman scattering; ATLD model was applied to establish the model of normal water sample, and the residual matrix was obtained by subtracting the measured matrix from the model matrix; the residual sum of squares obtained from the residual matrix and threshold was used to make qualitative discrimination of test samples and distinguish drinking water samples and organic pollutant samples. The results of the study indicate that ATLD modeling with three-dimensional fluorescence spectra can provide a tool for detecting unknown organic pollutants in water qualitatively. The method based on fluorescence spectra can be complementary to the method based on conventional index and UV-vision.
Application Of Multi-Spectral Information Fusion For Water Quality Analysis

Wu Xiao-Li,Li Yan-Jun,Wu Tie-Jun

DOI: https://doi.org/10.3321/j.issn:0253-3820.2007.12.007

IF: 1.193

2007-01-01

Chinese Journal of Analytical Chemistry

Abstract:A multi-spectral Information fusion based water quality analytical method for the comprehensive index of organic contaminant was proposed to solve the low precision problem of single-spectral analytical techniques. The Independent component analysis with reference was improved to extract valid features from the ultraviolet absorption spectrum and the three-dimensional fluorescence spectrum of water samples for interferential signals filtering, and then a least-square support vector machine algorithm was employed to build an information fusion model based on these multi-spectral features. 32 samples from surface water and urban wastewater were used to test the proposed UV spectra and fluorescence spectra data fused water analytical method, covering the range of total organic carbon index from 3. 4 mg/L to 125. 3 mg/L. Compared with these of the UV spectrum analysis method and the fluorescence spectrum analysis method, the root mean square analysis error of the multi-spectral fusion method are decreased by 36. 1 % and 34. 7%, respectively.
Classification of Organic Contaminants in Water Distribution Systems Developed by SPA and Multi-Classification SVM Using UV-Vis Spectroscopy

Ping-jie Huang,Yu-han Li,Qiao-jun Yu,Ke Wang,Hang Yin,Di-bo Hou,Guang-xin Zhang

DOI: https://doi.org/10.3964/j.issn.1000-0593(2020)07-2267-06

2020-01-01

Spectroscopy and spectral analysis

Abstract:Quickly and effectively identifying the water contaminants is vital for reducing the impact of sudden drinking water pollution incidents. PCA is mostly used to extract the feature of different contaminants in drinking water with UV-Vis spectra. However, for the organic contaminants with high similarity in UV-Vis spectra, the identification result is ineffective when only extracting the feature of the largest variance direction from the data-driven point of view. This paper studies the classification of organic contaminants in water distribution systems developed by SPA and multi-classification SVM using UV-Vis spectroscopy. Firstly, the original spectral data of phenol, hydroquinone, resorcinol and m-phenylenediamine are measured by UV spectrometer and pretreated. The correlation between wavelength and concentration of four contaminants was compared. The peaks between phenol and resorcinol, hydroquinone and m-phenylenediamine are overlapped seriously, the classification results can interfere easily. In feature extraction, the SPA is introduced to select the organic contaminants' characteristic wavelengths of UV-Vis spectra. Then, multiple linear regression analysis is carried out to choose the optimal parameter combination, which corresponds to the minimum prediction standard deviation. Based on this, the multi-classification support vector machine is used to form an identification model for drinking water organic contaminants. Finally, the classification results of spectral data based on full spectrum, PCA and SPA under different classification methods and different concentrations are compared and analyzed, and the applicability and stability of SPA are further explained. Experimental results demonstrate that SPA-based feature extraction method eliminates the interference of multi-collinearity and amplifies the difference among the UV-Vis spectra of different organic contaminants, thereby improving the accuracy of the classification model. This method has certain reference value for solving the problem of identifying the types of pollutants with overlapped peaks in the drinking water.
Water quality analysis by UV-Vis spectroscopy: A review of methodology and application

HOU Di-bo,Jianjun Zhang,Lin Chen,HUANG Ping-jie,ZHANG Guang-xin

DOI: https://doi.org/10.3964/j.issn.1000-0593(2013)07-1839-06

2013-01-01

Spectroscopy and spectral analysis

Abstract:Compared with the traditional approaches, UV-Vis spectroscopy is gaining growing acceptance in the field of online water-quality monitoring as an effective method for water quality analysis. UV-Vis spectroscopy has the advantages of fast response, low maintenance costs, and no secondary pollution. In the present paper, the principle of water quality analysis by UV-Vis spectroscopy is introduced. Existing researches on the online analysis of water quality using UV-Vis spectrum and data fusion technologies are comprehensively reviewed. The applications of UV-Vis based methods in multi-parameter water-quality monitoring, water-quality classification, and water-quality alarm are also discussed. Finally, future research directions are outlined.
Contamination Event Detection Method Based On The Longest Common Subsequence Analysis Using Multiple Water Quality Parameters

Kexin Wang,Yuan Wei,Dibo Hou,Pingjie Huang,Jie Yu,Guangxin Zhang

DOI: https://doi.org/10.1061/9780784480625.059

2017-01-01

Abstract:As the irreplaceable natural resource, water plays an important part in human life. It's necessary to establish of a set of water quality early warning system which can quickly and accurately identify contamination. The existing anomaly detection methods are either simple fusion of abnormal judgment results from single index [1], or correlation analysis of multiple parameters at the cost of high time complexity. Aimed to solve these problems, this paper describes a multivariate correlation analysis method based on the longest common subsequence (LCSS) analysis combined with Dempster- Shafer (D- S) evidence theory. The proposed method utilizes adaptive sliding window scale to acquire water quality parameter time sequence, LCSS to describe similarity between different water quality series fluctuation, and D- S evidence theory to calculate abnormal probabilities. The ROC curve is introduced to verify the algorithm performance. Tested by data from the laboratory contaminant injection experiment, this approach shows nice ability in dealing with time series deformation problem rapidly, which to a certain extent can improve the reliability of multi- index correlation degree analysis, and ultimately reduce the abnormal water contamination event detection false alarm rate.
A Time Series Double Threshold Method for Pollution Events Detection in Drinking Water Using Three-Dimensional Fluorescence Spectroscopy

Xue Fang-jia,Yu Jie,Yin Hang,Xia Qi-yu,Shi Jie-gen,Hou Di-bo,Huang Ping-jie,Zhang Guang-xin

DOI: https://doi.org/10.3964/j.issn.1000-0593(2023)10-3081-08

2023-01-01

Spectroscopy and spectral analysis

Abstract:Three-dimensional fluorescence technology is attracting attention in detecting emergency drinking water pollution events. However, some unsolved problems remain, such as being easily affected by water environment fluctuations, low detection rate facing low-concentration organic pollutants, etc. Therefore, in response to the demand for online monitoring, this study proposed a time series double thresholds method for anomaly detection in drinking water using three-dimensional fluorescence. This method applied principal component analysis (PCA) to extract the feature spectrum of the detected samples and trained the linear autoregressive (AR) model to predict the principal component of the water samples in the future. The eigenvalue difference was then obtained by comparing the predicted and measured ones. At the same time, combined with the change rate of the measured eigenvalues, the double threshold for time series was set to finally determine the start and end points of the pollution event to determine the entire pollution event. The research validated the proposed method by simulating high-concentration pollution events, low-concentration pollution events, and fluctuations in water background. The experimental results show that this method maintains the detection accuracy for high-concentration pollution events. Moreover, compared with conventional methods, the proposed method improved the detection performance in low-concentration pollution events and low-concentration pollution in high-interference environments. The detection accuracy is increased by 9. 4% and 20. 7% respectively.
Application of Surrogate Parameters in Characteristic UV–vis Absorption Bands for Rapid Analysis of Water Contaminants

Yingtian Hu,Xiaoping Wang

DOI: https://doi.org/10.1016/j.snb.2016.08.072

IF: 9.221

2017-01-01

Sensors and Actuators B Chemical

Abstract:In recent years, absorption spectroscopy is being widely used for water quality monitoring. However, much of the spectral analysis results do not provide any physical meaning and the use of traditional parameters for monitoring water quality, such as chemical oxygen demand (COD), is not a radical research method because of the large diversity of chemical components in water. Here in, we studied the absorption spectra of eight typical contaminants and proposed four integral parameters in different spectral ranges, which were relative to different functional groups. The proposed surrogate parameters can be used to rapidly analyze and predict the categories of contaminants based on their changes without using any modeling. We used a dynamic partitioning algorithm based on the fourth-order derivative spectrum to adapt the movement of absorption bands. The impact of turbidity was eliminated by deducting the turbidity component from surrogate parameters based on the proportion of four parameters in formazine turbid solution. Using this method, we conducted long-term monitoring of the wastewater released by a dyeing and printing plant. The rapid analysis and prediction potential of different categories of water contaminants was demonstrated. The prediction results can provide evidence for more targeted and detailed analysis and water quality monitoring. (C) 2016 Elsevier B.V. All rights reserved.
Adaptive Detection Method for Organic Contamination Events in Water Distribution Systems Using the UV-Vis Spectrum Based on Semi-Supervised Learning

Hang Yin,Hui Dong,Q. Yu,Ke Wang,D. Hou

DOI: https://doi.org/10.3390/W10111566

IF: 3.53

2018-11-02

Water

Abstract:A method that uses the ultraviolet-visible (UV-Vis) spectrum to detect organic contamination events in water distribution systems exhibits the advantages of rapid detection, low cost, and no need for reagents. The speed, accuracy, and comprehensive analysis of such a method meet the requirements for online water quality monitoring. However, the UV-Vis spectrum is easily disturbed by environmental factors that cause fluctuations of the spectrum and result in false alarms. This study proposes an adaptive method for detecting organic contamination events in water distribution systems that uses the UV-Vis spectrum based on a semi-supervised learning model. This method modifies the baseline using dynamic orthogonal projection correction and adjusts the support vector regression model in real time. Thus, an adaptive online anomaly detection model that maximizes the use of unlabeled data is obtained. Experimental results demonstrate that the proposed method is adaptive to baseline drift and exhibits good performance in detecting organic contamination events in water distribution systems.

Geology,Environmental Science

XForms in X-Smiles

Detection of Specific Contamination Events in Water Distribution System Using Ultraviolet Spectra.

Online Detecting Water Quality Anomaly from UV/Vis Spectra Using Baseline Correction and Principal Component Analysis Method

Real-time Detection of Organic Contamination Events in Water Distribution Systems by Principal Components Analysis of Ultraviolet Spectral Data

Classification of water contamination developed by 2-D Gabor wavelet analysis and support vector machine based on fluorescence spectroscopy.

Ultraviolet Spectrum Analysis Methods for Detecting the Concentration of Organic Pollutants in Water

Online Monitoring of Water-Quality Anomaly in Water Distribution Systems Based on Probabilistic Principal Component Analysis by UV-Vis Absorption Spectroscopy

Optical detection of contamination event in water distribution system using online Bayesian method with UV–Vis spectrometry

In-Situ Detection of Water Quality Anomaly with UV/Vis Spectrum Based on Supervised Learning

Water Quality Detection Using Uv Spectra Based on the Pca Algorithm

Applications of Online UV-Vis Spectrophotometer for Drinking Water Quality Monitoring and Process Control: A Review

Investigating Effectiveness of Sensor Placement Strategies in Contamination Detection within Water Distribution Systems

In situ detection of water quality contamination events based on signal complexity analysis using online ultraviolet-visible spectral sensor

Detection of Water Contamination Events Using Fluorescence Spectroscopy and Alternating Trilinear Decomposition Algorithm

Application Of Multi-Spectral Information Fusion For Water Quality Analysis

Classification of Organic Contaminants in Water Distribution Systems Developed by SPA and Multi-Classification SVM Using UV-Vis Spectroscopy

Water quality analysis by UV-Vis spectroscopy: A review of methodology and application

Contamination Event Detection Method Based On The Longest Common Subsequence Analysis Using Multiple Water Quality Parameters

A Time Series Double Threshold Method for Pollution Events Detection in Drinking Water Using Three-Dimensional Fluorescence Spectroscopy

Application of Surrogate Parameters in Characteristic UV–vis Absorption Bands for Rapid Analysis of Water Contaminants

Adaptive Detection Method for Organic Contamination Events in Water Distribution Systems Using the UV-Vis Spectrum Based on Semi-Supervised Learning