SIMILARITY BASED TIME SERIES ANALYSE METHOD

李闰平,李斌,王垚

DOI: https://doi.org/10.3969/j.issn.1008-0570.2008.12.066

2008-01-01

Abstract:Based on the coefficient of time series data,we developed a method to measure the similarity of the data in figure. By using this method,we could detect the anomaly of the time series data with periodicity. In the experiment,the method is proved effectively.

What problem does this paper attempt to address?

A New Representation and Distance Measure for Financial Time Series

Yongwei Ding,Xiaohu Yang,Juefeng Li,Alexsander J. Kavs

DOI: https://doi.org/10.1109/icife.2010.5609286

2010-01-01

Abstract:Similarity metric is of fundamental importance for similarity matching and subsequence query in time series applications. Most existing approaches measure the similarity by calculating and aggregating the point-to-point distance, few of them take the segment trend duration into account. In this paper, upon analyzing the properties of financial time series, we define a time series notation which is more intuitive and expressive. Base on that, a new similarity model is proposed. Experiments on both real foreign currency exchange rate data and stock market data are performed. The result shows the effectiveness and good accuracy of our method.
An efficient method for time series similarity search using binary code representation and hamming distance

Haowen Zhang,Yabo Dong,Jing Li,Duanqing Xu

DOI: https://doi.org/10.3233/IDA-194876

IF: 1.7

2021-01-01

Intelligent Data Analysis

Abstract:Time series similarity search is an essential operation in time series data mining and has received much higher interest along with the growing popularity of time series data. Although many algorithms to solve this problem have been investigated, there is a challenging demand for supporting similarity search in a fast and accurate way. In this paper, we present a novel approach, TS2BC, to perform time series similarity search efficiently and effectively. TS2BC uses binary code to represent time series and measures the similarity under the Hamming Distance. Our method is able to represent original data compactly and can handle shifted time series and work with time series of different lengths. Moreover, it can be performed with reasonably low complexity due to the efficiency of calculating the Hamming Distance. We extensively compare TS2BC with state-of-the-art algorithms in classification framework using 61 online datasets. Experimental results show that TS2BC achieves better or comparative performance than other the state-of-the-art in accuracy and is much faster than most existing algorithms. Furthermore, we propose an approximate version of TS2BC to speed up the query procedure and test its efficiency by experiment.
A Novel Similarity Measure Approach for Time Series Based on PLA and DTW

Shen Jingyi,Zhu Dongyang,Huang Weiping,Liang Jun

DOI: https://doi.org/10.1109/chicc.2016.7554488

2016-01-01

Abstract:Dynamic time warping (DTW) is the most popular method for time series similarity measure. In this paper, a novel method is proposed to deal with two problems of DTW: “singularity” and high time complexity. Firstly, to solve the “singularity” problem, we propose the summation dynamic time series warping (SDTW) by considering both point values and derivatives without extra parameters. Secondly, we integrate piecewise linear approximation (PLA) and SDTW as PLA-SDTW to reduce the time consumption of SDTW. We empirically compare our new approach to other techniques and demonstrate its superiority in time complexity and similarity measure.
The Comparison of Time-frequency Analysis Methods and Their Applications

Hai-yan LIU,Gang TIAN,Zhan-jie SHI

DOI: https://doi.org/10.15953/j.1004-4140.2015.24.02.06

2015-01-01

Abstract:The seismic data usually is non-linear and non-stationary series, the time-frequency analysis technique has the capability to reflect the partial feature of signal in time domain and frequency domain as well. This paper studies four kinds of time-frequency analysis methods, including short time Fourier transform, Wavelet transform, also S transform and Wigner-Ville distribution. Theoretically writer used Ricker wavelet matching to simulate seismic data, in order to contrast with the real seismic records. On base of the results, it can be concluded that the generalized S transform presents better time-frequency localization precision and cross-terms suppressing. In order to better verify this theory, writer conducts several experiments in two different field, then analysis and elaborate both the advantages and disadvantages for these four time-frequency methods, in the meantime, the results also verified the superiority of generalized S transform.
A Novel Similarity Measure Model for Multivariate Time Series Based on LMNN and DTW

Jingyi Shen,Weiping Huang,Dongyang Zhu,Jun Liang

DOI: https://doi.org/10.1007/s11063-016-9555-5

2016-01-01

Abstract:In this paper, a novel model is proposed to measure the similarity of multivariate time series by combining large margin nearest neighbor (LMNN) and dynamic time warping (DTW). Firstly we use a Mahalanobis distance-based DTW measure for multivariable time series, which considers the relations among variables through the Mahalanobis matrix. Secondly, the LMNN algorithm is applied to learn the Mahalanobis matrix by minimizing a renewed cost function. As the cost function is non-differentiable, the minimization problem is solved from a perspective of k-means by coordinate descent method. We empirically compare the proposed model with other techniques and demonstrate its convergence and superiority in similarity measure for multivariate time series.
Study on Pattern Similarity of Time Series

LIN Xun,LI Zhi-shu,ZHOU Yong

DOI: https://doi.org/10.3969/j.issn.1002-137X.2011.09.058

2011-01-01

Computer Science

Abstract:Under normal circumstances,the same distance measurement method can only measure the similarity of the same length sequence mode.Based on the similarity with definition meta model,this article drawed the idea of dynamic time warping distance and gave the definition of a sequential pattern of dynamic time warping distance,and finally conducted simulation experiments with two different time series.
Research of New Similarity Measure Method on Time Series Data

LIU Yi,BAO De-pei,YANG Ze-hong,ZHAO Yan-nan,JIA Pei-fa,WANG Jia-qin

DOI: https://doi.org/10.3969/j.issn.1001-3695.2007.05.034

2007-01-01

Abstract:Based on the feature of symbolic time series data,a new similarity measure method(SAX Statistical Vector Space,SSVS)was cleatively brought.The stock data from the Standard Poor 500 index was obtained,and the behavior of kinds of similarity measure methods in clustering research was compared.The experiment results showed that the new method could efficiently measure the similarity according to the whole trend by comparing with the classic methods.
A method for measuring similarity of time series based on series decomposition and dynamic time warping

Qingzhen Zhang,Chaoqi Zhang,Langfu Cui,Xiaoxuan Han,Yang Jin,Gang Xiang,Yan Shi

DOI: https://doi.org/10.1007/s10489-022-03716-9

IF: 5.3

2022-07-09

Applied Intelligence

Abstract:Dynamic time warping (DTW) is one of the most important similarity measurement methods for time series analysis. In view of the high complexity and pathological alignment of DTW, a lot of variants of DTW have been proposed. However, the existing methods calculate the similarity between the original time series through dynamic programming directly, and ignore the characteristic that different components in the time series often have different degrees of importance. This paper proposes a time series similarity measurement method based on series decomposition and fast DTW, which combines time series decomposition method and DTW method. Series decomposition is an important means of time series analysis which can decompose time series into trend, seasonality, and remainder components. In this paper, after using the Seasonal-Trend decomposition using Loess (STL) method to decompose the time series, the similarity between the trend components and the similarity between seasonal components are respectively measured. The impact of the more important component is amplified, and then the comprehensive similarity measurement result will be obtained. Experimental results on 20 UCR time series datasets show that, compared with the existing fast DTW and constrained DTW and their variants, the method proposed in this paper achieves a higher classification accuracy. Simultaneously, combining the advantage of low complexity of fast DTW, the computational complexity of proposed method is still first-order linearly related to the length of time series.

computer science, artificial intelligence
A New Method for Similarity Matching of Non-Stationary Time Series Based on Fractal Time-Varying Dimension

ZHAO Hui,HOU Jian-Rong,SHI Bo-Le

DOI: https://doi.org/10.3321/j.issn:0254-4164.2005.02.012

2005-01-01

Chinese Journal of Computers

Abstract:At present, the similarity pattern query about time series is a hot research topic in knowledge discovering in the time series database. Traditional dimension reduction methods about similarity query introduce the smoothness to data series in some degree that the important features of time series about non linearity and fractal are destroyed. The matching method based on wavelet transformation measures the similarity by using the distance standard at some resolution level. In case of that the fractal dimension of non stationary time series is unknown, the local error of similarity matching of series increases. The process of querying the similarity of curve figure will be affected to a certain degree. Stochastic non stationary time series show the non linear and fractal characters in the process of time space kinetics evolution. The concept of series fractal time varying dimension is presented. The original Fractal Brownian Motion model is reconstructed to be a stochastic process with local self similarity. The Daubechies wavelet is used to transform the local self similarity process. An evaluation formula of time varying Hurst index is established. The algorithm of time varying index is presented, and a new standard of series similarity is also introduced. The similarity of curve basic figure is queried and measured at some resolution ratio level, in the meantime, the fractal dimension in local similarity is matched. The effectiveness of the method is validated by the means of the simulation example in the end of the paper.
Similarity Measure Based on Partial Information of Time Series

Xiaoming Jin,Yuchang Lu,Chunyi Shi

DOI: https://doi.org/10.1145/775047.775127

2002-01-01

Abstract:Similarity measure of time series is an important subroutine in many KDD applications. Previous similarity models mainly focus on the prominent series behaviors by considering the whole information of time series. In this paper, we address the problem: which portion of information is more suitable for similarity measure for the data collected from a certain field. We propose a model for the retrieval and representation of the partial information in time series data, and a methodology for evaluating the similarity measurements based on partial information. The methodology is to retrieve various portions of information from the raw data and represent it in a concise form, then cluster the time series using the partial information and evaluate the similarity measurements through comparing the results with a standard classification. Experiments on data set from stock market give some interesting observations and justify the usefulness of our approach.
A New Distributional Treatment for Time Series and an Anomaly Detection Investigation.

Kai Ming Ting,Zongyou Liu,Hang Zhang,Ye Zhu

DOI: https://doi.org/10.14778/3551793.3551796

IF: 2.5

2022-01-01

Proceedings of the VLDB Endowment

Abstract:Time series is traditionally treated with two main approaches, i.e., the time domain approach and the frequency domain approach. These approaches must rely on a sliding window so that time-shift versions of a periodic subsequence can be measured to be similar. Coupled with the use of a root point-to-point measure, existing methods often have quadratic time complexity. We offer the third R domain approach. It begins with an insight that subsequences in a periodic time series can be treated as sets of independent and identically distributed (iid) points generated from an unknown distribution in R. This R domain treatment enables two new possibilities: (a) the similarity between two subsequences can be computed using a distributional measure such as Wasserstein distance (WD), kernel mean embedding or Isolation Distributional kernel (IDK); and (b) these distributional measures become non-sliding-window-based. Together, they offer an alternative that has more effective similarity measurements and runs significantly faster than the point-to-point and sliding-window-based measures. Our empirical evaluation shows that IDK and WD are effective distributional measures for time series; and IDK-based detectors have better detection accuracy than existing sliding-window-based detectors, and they run faster with linear time complexity.
A new distributional treatment for time series anomaly detection

Kai Ming Ting,Zongyou Liu,Lei Gong,Hang Zhang,Ye Zhu

DOI: https://doi.org/10.1007/s00778-023-00832-x

2024-02-17

The VLDB Journal

Abstract:Time series is traditionally treated with two main approaches, i.e., the time domain approach and the frequency domain approach. These approaches must rely on a sliding window so that time-shift versions of a sequence can be measured to be similar. Coupled with the use of a root point-to-point measure, existing methods often have quadratic time complexity. We offer the third domain approach. It begins with an insight that sequences in a stationary time series can be treated as sets of independent and identically distributed (iid) points generated from an unknown distribution in . This domain treatment enables two new possibilities: (a) The similarity between two sequences can be computed using a distributional measure such as Wasserstein distance (WD), kernel mean embedding or isolation distributional kernel ( ), and (b) these distributional measures become non-sliding-window-based. Together, they offer an alternative that has more effective similarity measurements and runs significantly faster than the point-to-point and sliding-window-based measures. Our empirical evaluation shows that is an effective and efficient distributional measure for time series; and -based detectors have better detection accuracy than existing detectors in two tasks: (i) anomalous sequence detection in a stationary time series and (ii) anomalous time series detection in a dataset of non-stationary time series. The insight makes underutilized "old things new again" which gives existing distributional measures and anomaly detectors a new life in time series anomaly detection that would otherwise be impossible.

computer science, information systems, hardware & architecture
A novel similarity measure framework on financial data mining

Fangwen Zhai,Zehong Yang,Yixu Song,Yi Liu

DOI: https://doi.org/10.1109/NSWCTC.2010.126

2010-01-01

Abstract:Similarity measure is one of the core problems in data mining research on time series. Both Euclidean Distance and Dynamic Time Warping methods are widely used in similarity measure, which have their own limitations. Based on the symbolic time series data, this paper creatively brought forward a new kind of similarity measure framework SFVM (SAX Feature Vector Model). Based on the architecture of SFVM, we introduced three feature extraction methods, which can be extended as three new similarity measure methods. The paper obtained stock data from the Standard & Poor's 500 index, and compared the behavior of several similarity measure methods in clustering research. The experiment results showed that the three methods could efficiently measure the similarity according to the whole trend by comparing with the classic methods. © 2010 IEEE.
Learning the feature distribution similarities for online time series anomaly detection

Jin Fan,Yan Ge,Xinyi Zhang,ZheYu Wang,Huifeng Wu,Jia Wu

DOI: https://doi.org/10.1016/j.neunet.2024.106638

2024-08-21

Abstract:Identifying anomalies in multi-dimensional sequential data is crucial for ensuring optimal performance across various domains and in large-scale systems. Traditional contrastive methods utilize feature similarity between different features extracted from multidimensional raw inputs as an indicator of anomaly severity. However, the complex objective functions and meticulously designed modules of these methods often lead to efficiency issues and a lack of interpretability. Our study introduces a structural framework called SimDetector, which is a Local-Global Multi-Scale Similarity Contrast network. Specifically, the restructured and enhanced GRU module extracts more generalized local features, including long-term cyclical trends. The multi-scale sparse attention module efficiently extracts multi-scale global features with pattern information. Additionally, we modified the KL divergence to suit the characteristics of time series anomaly detection, proposing a symmetric absolute KL divergence that focuses more on overall distribution differences. The proposed method achieves results that surpass or approach the State-of-the-Art (SOTA) on multiple real-world datasets and synthetic datasets, while also significantly reducing Multiply-Accumulate Operations (MACs) and memory usage.
TS3IM: Unveiling Structural Similarity in Time Series through Image Similarity Assessment Insights

Yuhan Liu,Ke Tu

2024-05-10

Abstract:In the realm of time series analysis, accurately measuring similarity is crucial for applications such as forecasting, anomaly detection, and clustering. However, existing metrics often fail to capture the complex, multidimensional nature of time series data, limiting their effectiveness and application. This paper introduces the Structured Similarity Index Measure for Time Series (TS3IM), a novel approach inspired by the success of the Structural Similarity Index Measure (SSIM) in image analysis, tailored to address these limitations by assessing structural similarity in time series. TS3IM evaluates multiple dimensions of similarity-trend, variability, and structural integrity-offering a more nuanced and comprehensive measure. This metric represents a significant leap forward, providing a robust tool for analyzing temporal data and offering more accurate and comprehensive sequence analysis and decision support in fields such as monitoring power consumption, analyzing traffic flow, and adversarial recognition. Our extensive experimental results also show that compared with traditional methods that rely heavily on computational correlation, TS3IM is 1.87 times more similar to Dynamic Time Warping (DTW) in evaluation results and improves by more than 50% in adversarial recognition.

Machine Learning,Computer Vision and Pattern Recognition
Piecewise Statistic Approximation Based Similarity Measure for Time Series

Qinglin Cai,Ling Chen,Jianling Sun

DOI: https://doi.org/10.1016/j.knosys.2015.05.005

IF: 8.139

2015-01-01

Knowledge-Based Systems

Abstract:In the research field of time series analysis, dynamic time warping distance (DTW) is a prevalent similarity measure with high precision. However, the computational complexity of DTW is high, which makes it difficult to be applied to the high dimensional time series. An effective solution is to compute DTW on the piecewise representation (PR-DTW), which employs the features of the subsequences of time series for similarity measure. However, the features that most existing piecewise representations focus on are too simple, which capture only one aspect of the fluctuation information of time series, and thus influence the precision of PR-DTW. In order to solve this problem, we propose a novel piecewise representation model, named piecewise statistic approximation (PSA), for supporting the PR-DTW measure. Rather than focusing on a single type of features, PSA extracts multiple statistical features to capture the synthetic fluctuation information for similarity measure. Besides, by taking the weighted Euclidean distance for the subsequence matching in the subroutine, PSA based DTW (PSADTW) can discriminate the expressivities of the multiple features. Comprehensive experiments over 45 real-world datasets empirically demonstrate that, PSA is well suited to support both precise and efficient PR-DTW measure.
SimAD: A Simple Dissimilarity-based Approach for Time Series Anomaly Detection

Zhijie Zhong,Zhiwen Yu,Xing Xi,Yue Xu,Jiahui Chen,Kaixiang Yang

2024-05-18

Abstract:Despite the prevalence of reconstruction-based deep learning methods, time series anomaly detection remains challenging. Existing approaches often struggle with limited temporal contexts, inadequate representation of normal patterns, and flawed evaluation metrics, hindering their effectiveness in identifying aberrant behavior. To address these issues, we introduce $\textbf{SimAD}$, a $\textbf{Sim}$ple dissimilarity-based approach for time series $\textbf{A}$nomaly $\textbf{D}$etection. SimAD incorporates an advanced feature extractor adept at processing extended temporal windows, utilizes the EmbedPatch encoder to integrate normal behavioral patterns comprehensively, and introduces an innovative ContrastFusion module designed to accentuate distributional divergences between normal and abnormal data, thereby enhancing the robustness of anomaly discrimination. Additionally, we propose two robust evaluation metrics, UAff and NAff, addressing the limitations of existing metrics and demonstrating their reliability through theoretical and experimental analyses. Experiments across $\textbf{seven}$ diverse time series datasets demonstrate SimAD's superior performance compared to state-of-the-art methods, achieving relative improvements of $\textbf{19.85%}$ on F1, $\textbf{4.44%}$ on Aff-F1, $\textbf{77.79%}$ on NAff-F1, and $\textbf{9.69%}$ on AUC on six multivariate datasets. Code and pre-trained models are available at

Machine Learning,Artificial Intelligence
Experimental analysis of similarity measurements for multivariate time series and its application to the stock market

Zhong-Liang Xiang,Rui Wang,Xiang-Ru Yu,Bo Li,Yuan Yu

DOI: https://doi.org/10.1007/s10489-023-04874-0

IF: 5.3

2023-08-09

Applied Intelligence

Abstract:Similarity measurement takes on critical significance in strategies that seek similar stocks based on historical data to make predictions. Stock data refers to a multidimensional time series with features of non-linearity and high noise, posing a challenge to the practical design of similarity measurement. However, the existing similarity measurements cannot better address the negative effects of the singularity of data and correlations of data in multidimensional stock price series, such that the performance of stock prediction will be reduced. In this study, a novel method named dynamic multi-factor similarity measurement (DMFSM) is proposed to accurately describe the similarity between a pair of multidimensional time series. DMFSM is capable of eliminating effects exerted by singularity and correlations of data using dynamic time warping (DTW) with Mahalanobis distance embedded and weights of series nodes in multidimensional time series. To validate the efficiency of DMFSM, several experiments were performed on a total of 675 stocks, which comprised 290 stocks from the Shanghai Stock Exchange, 285 stocks from the Shenzhen Stock Exchange, as well as 100 stocks from the Growth Enterprise Market of the Shenzhen Stock Exchange. The experiment results for mean absolute error of predictions indicated that DMFSM (0.018) outperformed similarity measurements (e.g., Euclidean distance (0.023), DTW (0.054), and dynamic multi-perspective personalized similarity measurement (0.023)).

computer science, artificial intelligence
The Research and Application of Multivariate Time Series Similarity Data Mining

WANG Yong-mei

DOI: https://doi.org/10.14165/j.cnki.hunansci.2010.15.055

2010-01-01

Abstract:How to discover the hidden knowledge among data collected by various sensors during the last years has caused more and more attention.Similarity mining is the basic of time series data mining.This paper deals with similarity mining from hydrological time series and concentrates itself on the similarity analysis of multivariate time series(MTS).A novel similarity measure has been put forward,which is based on a improved BORDA count in multiple classifier system.Firstly,dimension reduction is adaptively conducted according to the target data complexity in PCA and the contribution rate of the variance,then the similarity of single time series is computed and lastly,the overall similarity of the MTS is obtained by synthesize each of the single similarity based on the improved BORDA count.Experiments on the similarity analysis of historical flood data from Yifeng basin have shown the feasibility and effectiveness of the proposed method.
Scalable Methods for Multiple Time Series Comparison in Second Order Dynamics

Lei Jin,Bo Li

DOI: https://doi.org/10.1080/00401706.2024.2388547

2024-09-22

Technometrics

Abstract:Statistical comparison of multiple time series in their underlying frequency patterns has many real applications. However, existing methods are only applicable to a small number of mutually independent time series, and empirical results for dependent time series are only limited to comparing two time series. We propose scalable methods based on a new algorithm that enables us to compare the spectral density of a large number of time series. The new algorithm helps us efficiently obtain all pairwise feature differences in frequency patterns between M time series, which plays an essential role in our methods. When all M time series are independent of each other, we derive the joint asymptotic distribution of their pairwise feature differences. The asymptotic dependence structure between the feature differences motivates our proposed test for multiple mutually independent time series. We then adapt this test to the case of multiple dependent time series by partially accounting for the underlying dependence structure. Additionally, we introduce a global test to further enhance the approach. To examine the finite sample performance of our proposed methods, we conduct simulation studies. The new approaches demonstrate the ability to compare a large number of time series, whether independent or dependent, while exhibiting competitive power. Finally, we apply our methods to compare multiple mechanical vibrational time series.

statistics & probability

SIMILARITY BASED TIME SERIES ANALYSE METHOD

A New Representation and Distance Measure for Financial Time Series

An efficient method for time series similarity search using binary code representation and hamming distance

A Novel Similarity Measure Approach for Time Series Based on PLA and DTW

The Comparison of Time-frequency Analysis Methods and Their Applications

A Novel Similarity Measure Model for Multivariate Time Series Based on LMNN and DTW

Study on Pattern Similarity of Time Series

Research of New Similarity Measure Method on Time Series Data

A method for measuring similarity of time series based on series decomposition and dynamic time warping

A New Method for Similarity Matching of Non-Stationary Time Series Based on Fractal Time-Varying Dimension

Similarity Measure Based on Partial Information of Time Series

A New Distributional Treatment for Time Series and an Anomaly Detection Investigation.

A new distributional treatment for time series anomaly detection

A novel similarity measure framework on financial data mining

Learning the feature distribution similarities for online time series anomaly detection

TS3IM: Unveiling Structural Similarity in Time Series through Image Similarity Assessment Insights

Piecewise Statistic Approximation Based Similarity Measure for Time Series

SimAD: A Simple Dissimilarity-based Approach for Time Series Anomaly Detection

Experimental analysis of similarity measurements for multivariate time series and its application to the stock market

The Research and Application of Multivariate Time Series Similarity Data Mining

Scalable Methods for Multiple Time Series Comparison in Second Order Dynamics