Representing Financial Time Series Based on Important Extrema Points

Xueyan Wu,Daoping Huang

DOI: https://doi.org/10.1109/IITA.2009.127

2009-01-01

Abstract:This paper presents a novel method for financial time series representation. The method can generate accurate and effective representation and segmentation in different resolutions and get better experimental results on real stock data.

What problem does this paper attempt to address?

A New Representation and Distance Measure for Financial Time Series

Yongwei Ding,Xiaohu Yang,Juefeng Li,Alexsander J. Kavs

DOI: https://doi.org/10.1109/icife.2010.5609286

2010-01-01

Abstract:Similarity metric is of fundamental importance for similarity matching and subsequence query in time series applications. Most existing approaches measure the similarity by calculating and aggregating the point-to-point distance, few of them take the segment trend duration into account. In this paper, upon analyzing the properties of financial time series, we define a time series notation which is more intuitive and expressive. Base on that, a new similarity model is proposed. Experiments on both real foreign currency exchange rate data and stock market data are performed. The result shows the effectiveness and good accuracy of our method.
A hybrid important points identification for time series: Financial case

Yongwei Ding,Xiaohu Yang,Kavs, A.J.,Juefeng Li

2010-01-01

Abstract:Important points identification is the key of the piecewise linear segmentation for time series. However, nearly all existing approaches are always perceptually important points (PIPs) focused while neglecting the domain related important points (DIPs) which might be of great interests to the domain experts. In order to preserve more important information relating to the particular domain after segmentation, a hybrid method to identify important points from both perceptual and domain perspectives is presented. We show the validity and effectiveness of the proposed method via a financial case.
A novel piecewise linear segmentation for time series

Yongwei Ding,Xiaohu Yang,Kavs, A.J.,Juefeng Li

DOI: https://doi.org/10.1109/ICCAE.2010.5451780

2010-01-01

Abstract:Time series representation is one of the fundamental tasks in Time Series Data Mining (TSDM). Due to the advantage of easy understanding and implementation, Piecewise Linear Representation (PLR) has been widely used in compression, indexing, and similarity measurement of time series data. In this paper, we introduce a novel online PLR segmentation method. It is based on determining the cumulative radian error for each data point. The proposed method is demonstrated by applying to real stock market indices data and shows its effectiveness and superiority.
Trend feature extraction method based on important points in time series

Qian ZHOU,Tie-jun WU

DOI: https://doi.org/10.3785/j.issn.1008-973X.2007.11.003

2007-01-01

Abstract:The existing algorithms to extract trend features based on time series piecewise linearization representation cannot extract completely correct basic trend features of time series. This work defined important points as the natural segment point of basic trend features of time series, and proposed a new segment objective function. The objective function includes two optimal objects, i.e., minimize the difference between the basic trend of time series and that of its corresponding segment, and minimize the sum of square error between the trend value of time series and that of its corresponding segment. Based on the new objective function, a piecewise linearization representation method which combining time series important points extraction with bottom-up segment was presented to extract trend features of time series. Important points based segment can extract the basic trend correctly. By iterative merging the neighbor small scale segments whose sum of square error increases least after time series segmented into small scale segment, the bottom-up segment method can acquire high fitting precision. Simulation shows that the proposed method can overcome the shortcoming of the existing piecewise linearization technique, and it can dig out trend features more precisely than the current methods given the same number of time series segmentation.
Representing financial time series based on data point importance

Tak-chung Fu,Fu-lai Chung,Robert Luk,Chak-man Ng

DOI: https://doi.org/10.1016/j.engappai.2007.04.009

IF: 8

2008-03-01

Engineering Applications of Artificial Intelligence

Abstract:Recently, the increasing use of time series data has initiated various research and development attempts in the field of data and knowledge management. Time series data is characterized as large in data size, high dimensionality and update continuously. Moreover, the time series data is always considered as a whole instead of individual numerical fields. Indeed, a large set of time series data is from stock market. Stock time series has its own characteristics over other time series. Moreover, dimensionality reduction is an essential step before many time series analysis and mining tasks. For these reasons, research is prompted to augment existing technologies and build new representation to manage financial time series data. In this paper, financial time series is represented according to the importance of the data points. With the concept of data point importance, a tree data structure, which supports incremental updating, is proposed to represent the time series and an access method for retrieving the time series data point from the tree, which is according to their order of importance, is introduced. This technique is capable to present the time series in different levels of detail and facilitate multi-resolution dimensionality reduction of the time series data. In this paper, different data point importance evaluation methods, a new updating method and two dimensionality reduction approaches are proposed and evaluated by a series of experiments. Finally, the application of the proposed representation on mobile environment is demonstrated.
Predicting Financial Extremes Based on Weighted Visual Graph of Major Stock Indices.

Dong-Rui Chen,Chuang Liu,Yi-Cheng Zhang,Zi-Ke Zhang

DOI: https://doi.org/10.1155/2019/5320686

IF: 2.3

2019-01-01

Complexity

Abstract:Understanding and predicting extreme turning points in the financial market, such as financial bubbles and crashes, has attracted much attention in recent years. Experimental observations of the superexponential increase of prices before crashes indicate the predictability of financial extremes. In this study, we aim to forecast extreme events in the stock market using 19-year time-series data (January 2000–December 2018) of the financial market, covering 12 kinds of worldwide stock indices. In addition, we propose an extremes indicator through the network, which is constructed from the price time series using a weighted visual graph algorithm. Experimental results on 12 stock indices show that the proposed indicators can predict financial extremes very well.
Asymmetry of return distribution, abnormality of intradaily risk based on quantile regression model with high-frequency data from Shanghai stock market

Wang Xin-Yu,Jie Qiu,Song Xue-feng

DOI: https://doi.org/10.1109/ICMSE.2007.4422092

2008-01-01

Abstract:In finance and econometrics, study oh high-frequency time series data has attracted plenty of attentions in recent years. The high-frequency time series data do help to investigate the microstructure theory of financial market more closely, and the need of modeling high-frequency data for risk management has already risen greatly in practice. In the paper, the quantile regression model with ARCH effect, as an ideal semi-parametric approach to estimate the quantile of return distribution directly that differs from the conventional mean-variance framework in risk management and econometrics, is applied to analyze the 5-minitue high-frequency intradaily return and trading volume time series of Shanghai Composite Index in Shanghai stock market of China. We find that the significant, asymmetry of return distribution and negative relationship between price change and first-order lagged trading volume, and that value at risk analysis and back testing also indicate quantile regression model is a competitive method to risk management in high-frequency data conditions. Finally the abnormality of intradaily risk pattern near opening and closing is also discovered.
Imaging feature-based clustering of financial time series

Jun Wu,Zelin Zhang,Rui Tong,Yuan Zhou,Zhengfa Hu,Kaituo Liu

DOI: https://doi.org/10.1371/journal.pone.0288836

IF: 3.7

2023-07-28

PLoS ONE

Abstract:Timeseries representation underpin our ability to understand and predict the change of natural system. Series are often predicated on our choice of highly redundant factors, and in fact, the system is driven by a much smaller set of latent intrinsic keys. It means that a better representation of data makes points in phase space clearly for researchers. Specially, a 2D structure of timeseries could combine the trend and correlation characters of different periods in timeseries together, which provides more clear information for top tasks. In this work, the effectiveness of 2D structure of timeseries is investigated in clustering tasks. There are 4 kinds of methods that the Recurrent Plot (RP), the Gramian Angular Summation Field (GASF), the Gramian Angular Differential Field (GADF) and the Markov Transition Field (MTF) have been adopted in the analysis. By classifying the CSI300 and S&P500 indexes, we found that the RP imaging series are valid in recognizing abnormal fluctuations of financial timeseries, as the silhouette values of clusters are over 0.6 to 1. Compared with segment methods, the 2D models have the lowest instability value of 0. It verifies that the SIFT features of RP images take advantage of the volatility of financial series for clustering tasks.

multidisciplinary sciences
A Topological Based Feature Extraction Method for the Stock Market

Chen Chang,Hongwei Lin

DOI: https://doi.org/10.3934/dsfe.2023013

2023-01-01

Data Science in Finance and Economics

Abstract:We proposed a topology-based method for pre-processed time series data extracted from stock market data. The topology features are extracted from data after denoising and normalization by using a version of weighted Vietoris-Rips complex. We compare the features from bullish, bearish and normal periods of the Chinese stock market and found significant differences between the features extracted from the groups. Based on the previous research mentioned in the context, we proposed a topology-based stock market index which has the ability to distinguish different stages of the stock market and forewarn stock market crashes.
Unleashing the Potential of Mixed Frequency Data: Measuring Risk with Dynamic Tail Index Regression Model

Hongyu An,Boping Tian

DOI: https://doi.org/10.1007/s10614-024-10592-7

IF: 1.741

2024-05-08

Computational Economics

Abstract:Understanding why extreme events occur is crucial in many fields, particularly in managing financial market risk. In order to explain such occurrences, it is necessary to use explanatory variables. However, flexible models with explanatory variables are severely lacking in financial market risk management, particularly when the variables are sampled at different frequencies. To address this gap, this article proposes a novel dynamic tail index regression model based on mixed-frequency data, which enables the high-frequency variable of interest to depend on both high- and low-frequency variables within the framework of extreme value regression. Specifically, it concurrently leverages information from low-frequency macroeconomic variables and high-frequency market variables to model the tail distribution of high-frequency returns, consequently enabling the computation of high-frequency Value at Risk and Expected Shortfall. Monte Carlo simulations and empirical studies show that the proposed method effectively models stock market tail risk and produces satisfactory forecasts. Moreover, including macroeconomic variables in the model provides insights for macroprudential regulation.

economics,mathematics, interdisciplinary applications,management
An adaptive time series segmentation algorithm based on visibility graph and particle swarm optimization

Zhipeng He,Shuguang Zhang,Jun Hu,Fei Dai

DOI: https://doi.org/10.1016/j.physa.2024.129563

IF: 3.778

2024-01-30

Physica A Statistical Mechanics and its Applications

Abstract:Time series segmentation is a crucial area of research in time series analysis as it can reveal meaningful patterns or segments hidden within time series data . In this paper, we present an accurate and efficient time series segmentation method that combines the visibility graph method, particle swarm optimization, and community detection algorithm. We start by applying visibility graph theory to process time series data, resulting in a corresponding complex network. Next, we introduce an adaptive particle swarm optimization algorithm with modularity Q as the objective function to optimize community detection. Finally, mapping the communities back to the nodes of the time series yields the segmented sequence. Our proposed method offers high segmentation accuracy and low time complexity (O(n2)) . Experimental results demonstrate that our approach outperforms existing methods in terms of segmentation accuracy on two different synthetic datasets. Furthermore, when applied to the S&P500 index dataset, it accurately identifies financial cycles and key financial events.

physics, multidisciplinary
Multi-Modal Financial Time-Series Retrieval Through Latent Space Projections

Tom Bamford,Andrea Coletta,Elizabeth Fons,Sriram Gopalakrishnan,Svitlana Vyetrenko,Tucker Balch,Manuela Veloso

DOI: https://doi.org/10.48550/arXiv.2309.16741

2024-01-02

Abstract:Financial firms commonly process and store billions of time-series data, generated continuously and at a high frequency. To support efficient data storage and retrieval, specialized time-series databases and systems have emerged. These databases support indexing and querying of time-series by a constrained Structured Query Language(SQL)-like format to enable queries like "Stocks with monthly price returns greater than 5%", and expressed in rigid formats. However, such queries do not capture the intrinsic complexity of high dimensional time-series data, which can often be better described by images or language (e.g., "A stock in low volatility regime"). Moreover, the required storage, computational time, and retrieval complexity to search in the time-series space are often non-trivial. In this paper, we propose and demonstrate a framework to store multi-modal data for financial time-series in a lower-dimensional latent space using deep encoders, such that the latent space projections capture not only the time series trends but also other desirable information or properties of the financial time-series data (such as price volatility). Moreover, our approach allows user-friendly query interfaces, enabling natural language text or sketches of time-series, for which we have developed intuitive interfaces. We demonstrate the advantages of our method in terms of computational efficiency and accuracy on real historical data as well as synthetic data, and highlight the utility of latent-space projections in the storage and retrieval of financial time-series data with intuitive query modalities.

Machine Learning,Artificial Intelligence,Human-Computer Interaction
Modeling financial interval time series

Liang-Ching Lin,Li-Hsien Sun

DOI: https://doi.org/10.1371/journal.pone.0211709

IF: 3.7

2019-02-14

PLoS ONE

Abstract:In financial economics, a large number of models are developed based on the daily closing price. When using only the daily closing price to model the time series, we may discard valuable intra-daily information, such as maximum and minimum prices. In this study, we propose an interval time series model, including the daily maximum, minimum, and closing prices, and then apply the proposed model to forecast the entire interval. The likelihood function and the corresponding maximum likelihood estimates (MLEs) are obtained by stochastic differential equation and the Girsanov theorem. To capture the heteroscedasticity of volatility, we consider a stochastic volatility model. The efficiency of the proposed estimators is illustrated by a simulation study. Finally, based on real data for S&P 500 index, the proposed method outperforms several alternatives in terms of the accurate forecast.
Clustering Financial Time Series Based on Multi-fractal Features of Variance Volatility

HUANG Chao,WU Qing-lie,WU Zhong,ZHU Yang-yong

DOI: https://doi.org/10.3969/j.issn.1001-4098.2006.06.019

IF: 2.034

2006-01-01

Systems Engineering

Abstract:A new probabilistic function for studying the multi-fractal features on the volatility of variance of financial time series is proposed.Then a new time series clustering algorithm based on multi-fractal features is brought forward,which can cluster financial time series flexibly according to different purpose by using different probabilistic functions and multi-fractal features parameters.The experiments conducted on real data of Shanghai securities market show the algorithm is practical and effective.
Modeling Extreme Events in Time Series Prediction

Daizong Ding,Mi Zhang,Xudong Pan,Min Yang,Xiangnan He

DOI: https://doi.org/10.1145/3292500.3330896

2019-07-25

Abstract:Time series prediction is an intensively studied topic in data mining. In spite of the considerable improvements, recent deep learning-based methods overlook the existence of extreme events, which result in weak performance when applying them to real time series. Extreme events are rare and random, but do play a critical role in many real applications, such as the forecasting of financial crisis and natural disasters. In this paper, we explore the central theme of improving the ability of deep learning on modeling extreme events for time series prediction. Through the lens of formal analysis, we first find that the weakness of deep learning methods roots in the conventional form of quadratic loss. To address this issue, we take inspirations from the Extreme Value Theory, developing a new form of loss called Extreme Value Loss (EVL) for detecting the future occurrence of extreme events. Furthermore, we propose to employ Memory Network in order to memorize extreme events in historical records.By incorporating EVL with an adapted memory network module, we achieve an end-to-end framework for time series prediction with extreme events. Through extensive experiments on synthetic data and two real datasets of stock and climate, we empirically validate the effectiveness of our framework. Besides, we also provide a proper choice for hyper-parameters in our proposed framework by conducting several additional experiments.
Forecasting Financial Extremes: A Network Degree Measure of Super-exponential Growth

Wanfeng Yan,Edgar van Tuyll van Serooskerken

DOI: https://doi.org/10.1371/journal.pone.0128908

2015-05-15

Abstract:Investors in stock market are usually greedy during bull markets and scared during bear markets. The greed or fear spreads across investors quickly. This is known as the herding effect, and often leads to a fast movement of stock prices. During such market regimes, stock prices change at a super-exponential rate and are normally followed by a trend reversal that corrects the previous over reaction. In this paper, we construct an indicator to measure the magnitude of the super-exponential growth of stock prices, by measuring the degree of the price network, generated from the price time series. Twelve major international stock indices have been investigated. Error diagram tests show that this new indicator has strong predictive power for financial extremes, both peaks and troughs. By varying the parameters used to construct the error diagram, we show the predictive power is very robust. The new indicator has a better performance than the LPPL pattern recognition indicator.

General Finance
Financial time series classification method based on low‐frequency approximate representation

Bing Liu,Huanhuan Cheng

DOI: https://doi.org/10.1002/eng2.12739

2023-07-28

Engineering Reports

Abstract:Aiming at the mode mixing problems of high frequency information caused by fluctuation agglomeration and pointed peak thick tail of financial time series, a time series classification method based on low frequency approximate representation is proposed. The steps are as follows. Firstly, complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) was used to decompose the time series into a series of modal components and residual terms, and the permutation entropy of the modal components and residual terms was calculated. And the permutation entropy was clustered into two categories by Fisher's optimal segmentation method. Then, according to the clustering results of permutation entropy, the corresponding modal components and residual terms were integrated into high frequency information and low frequency information, so as to realize the adaptive extraction of low frequency information. Secondly, distance matrices were obtained by Euclidean distance (ED) or dynamic time warping (DTW) for low frequency information, and then the nearest neighbor 1‐NN algorithm was used to classify time series. Aiming at the mode mixing problems of high frequency information caused by fluctuation agglomeration and pointed peak thick tail of financial time series, a time series classification method based on low frequency approximate representation is proposed. The steps are as follows. Firstly, complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) was used to decompose the time series into a series of modal components and residual terms, and the permutation entropy of the modal components and residual terms was calculated. And the permutation entropy was clustered into two categories by Fisher's optimal segmentation method. Then, according to the clustering results of permutation entropy, the corresponding modal components and residual terms were integrated into high frequency information and low frequency information, so as to realize the adaptive extraction of low frequency information. Secondly, distance matrices were obtained by Euclidean distance (ED) or dynamic time warping (DTW) for low frequency information, and then the nearest neighbor 1‐NN algorithm was used to classify time series.

English Else
A Fuzzy Interval Time-Series Energy and Financial Forecasting Model Using Network-Based Multiple Time-Frequency Spaces and the Induced-Ordered Weighted Averaging Aggregation Operation

Gang Liu,Chin-Teng Lin,Zehong Cao,Fuyuan Xiao

DOI: https://doi.org/10.1109/TFUZZ.2020.2972823

IF: 12.253

2020-02-10

IEEE Transactions on Fuzzy Systems

Abstract:Forecasting time series is an emerging topic in operational research. Existing time-series models have limited prediction accuracy when faced with the characteristics of nonlinearity and nonstationarity in complex situations related to energy and finance. To enhance overall prediction capabilities and improve forecasting accuracy, in this article we propose a fuzzy interval time-series forecasting model on the basis of network-based multiple time-frequency spaces and the induced-ordered weighted averaging aggregation (IOWA) operation. Specifically, a time-series signal is decomposed into ensemble empirical modes and then reconstructed as various time-frequency spaces, which are transformed into visibility graphs. Then, forecasting intervals in different spaces can be collected after the local random walker link prediction model is adopted. Furthermore, a rule-based representation value function inspired by Yager's golden rule approach is defined, and an appropriate representation value is calculated. Finally, after IOWA is used to aggregate the forecasting outcomes in different time-frequency spaces, the final forecast value can be obtained from the fuzzy forecasting interval. Considering that energy issues are of widespread interest in nature and the social economy, two cases, based on a hydrological time series from the Biliuhe River in China and two well-known sets of financial time-series data, Taiwan Stock Exchange Capitalization Weighted Stock Index and Hang Seng Index, are studied to test the performance of the proposed approach in comparison with existing models. Our results show that the proposed approach can achieve better performance than well-developed models.

Computer Science,Engineering
Progress in the Study of Financial Ultra-high Frequency Data

Yu De-jian,Wu Ying-yu,Zhou Wei,Meng Sun

DOI: https://doi.org/10.3969/j.issn.1009-055X.2011.01.003

2011-01-01

Abstract:Modeling and analysis of the UHF data has become one of the international and domestic research topics.In recent years,research on financial ultra-high frequency data has gained some new developments.This article,based on the analysis of the trading hours and value of the ultra-high frequency data,reviews the newly development of the study of financial high frequency data and points out its future progress.
The Size Distribution of Kuiper Belt Objects

Scott J. Kenyon,Benjamin C. Bromley

DOI: https://doi.org/10.1086/423697

2004-06-25

Abstract:We describe analytical and numerical collisional evolution calculations for the size distribution of icy bodies in the Kuiper Belt. For a wide range of bulk properties, initial masses, and orbital parameters, our results yield power-law cumulative size distributions, N_C propto r^{-q}, with q_L = 3.5 for large bodies with radii of 10-100 km, and q_s = 2.5-3 for small bodies with radii lesss than 0.1-1 km. The transition between the two power laws occurs at a break radius of 1-30 km. The break radius is more sensitive to the initial mass in the Kuiper Belt and the amount of stirring by Neptune than the bulk properties of individual Kuiper Belt objects (KBOs). Comparisons with observations indicate that most models can explain the observed sky surface density of KBOs for red magnitudes, R = 22-27. For R < 22 and R > 28, the model surface density is sensitive to the amount of stirring by Neptune, suggesting that the size distribution of icy planets in the outer solar system provides independent constraints on the formation of Neptune.

Astrophysics

Representing Financial Time Series Based on Important Extrema Points

A New Representation and Distance Measure for Financial Time Series

A hybrid important points identification for time series: Financial case

A novel piecewise linear segmentation for time series

Trend feature extraction method based on important points in time series

Representing financial time series based on data point importance

Predicting Financial Extremes Based on Weighted Visual Graph of Major Stock Indices.

Asymmetry of return distribution, abnormality of intradaily risk based on quantile regression model with high-frequency data from Shanghai stock market

Imaging feature-based clustering of financial time series

A Topological Based Feature Extraction Method for the Stock Market

Unleashing the Potential of Mixed Frequency Data: Measuring Risk with Dynamic Tail Index Regression Model

An adaptive time series segmentation algorithm based on visibility graph and particle swarm optimization

Multi-Modal Financial Time-Series Retrieval Through Latent Space Projections

Modeling financial interval time series

Clustering Financial Time Series Based on Multi-fractal Features of Variance Volatility

Modeling Extreme Events in Time Series Prediction

Forecasting Financial Extremes: A Network Degree Measure of Super-exponential Growth

Financial time series classification method based on low‐frequency approximate representation

A Fuzzy Interval Time-Series Energy and Financial Forecasting Model Using Network-Based Multiple Time-Frequency Spaces and the Induced-Ordered Weighted Averaging Aggregation Operation

Progress in the Study of Financial Ultra-high Frequency Data

The Size Distribution of Kuiper Belt Objects