Market Timing: Recent Development and a New Test

Cheng Chou,Chia-Shang J. Chu

DOI: https://doi.org/10.1016/j.econlet.2011.01.006

IF: 1.469

2011-01-01

Economics Letters

Abstract:Henriksson–Merton's market timing test suffers nontrivial size distortion when the event forecast is autocorrelated. A new test is suggested to detect the dependence of two autocorrelated binary time series. It complements the existing tests due to better test power.

What problem does this paper attempt to address?

Pitfalls in market timing test

Chia-Shang Chu,Liping Lu,Zhentao Shi

DOI: https://doi.org/10.1016/j.econlet.2009.01.034

IF: 1.469

2009-01-01

Economics Letters

Abstract:Henriksson and Merton's market timing test suffers nontrivial size distortion when the observations are serially dependent sequences. Potential danger of finding spurious timing ability can be avoided by implementing a Markov regression that includes the lagged dependent variables as additional explanatory variables.
Testing Independence of Two Autocorrelated Binary Time Series

Cheng Chou,Chia-Shang J. Chu

DOI: https://doi.org/10.1016/j.spl.2009.09.014

IF: 0.718

2009-01-01

Statistics & Probability Letters

Abstract:Event forecast is a possibly autocorrelated binary time series. A new test for its timing ability is based on the correlation between the discrete autoregressions of the event forecast and the event time series. The new test outperforms the existing market timing tests.
Test for Market Timing Using Daily Fund Returns

Lei Jiang,Weimin Liu,Liang Peng

DOI: https://doi.org/10.1080/07350015.2021.2006670

2021-12-21

Journal of Business and Economic Statistics

Abstract:Using daily mutual fund returns to estimate market timing, some econometric issues, including heteroscedasticity, correlated errors, and heavy tails, make the traditional least-squares estimate in Treynor–Mazuy and Henriksson–Merton models biased and severely distort the t-test size. Using ARMA-GARCH models, weighted least-squares estimate to ensure a normal limit, and random weighted bootstrap method to quantify uncertainty, we find more funds with positive timing ability than the Newey–West t-test. Empirical evidence indicates that funds with perverse timing ability have high fund turnovers and funds tradeoff between timing and stock picking skills.

statistics & probability,social sciences, mathematical methods,economics
Nonparametric Tests for Market Timing Ability Using Daily Mutual Fund Returns

Jing Ding,Lei Jiang,Xiaohui Liu,Liang Peng

DOI: https://doi.org/10.1016/j.jedc.2023.104635

2023-01-01

Abstract:When using daily mutual fund returns to study market timing ability, heavy tails and heteroscedasticity significantly challenge the existing methods. We propose a weighted nonparametric measure and test for market timing. The test finds different results from the traditional parametric inference concerning timing. By examining the holding characteristics of the funds with different levels of timing ability, we find that funds with positive timing ability hold stocks with lower trading frictions. We find evidence of a tradeoff between market timing ability and stock picking skill after excluding funds with zero timing ability, which is robust to different benchmark models.
Generalized Spectral Tests for Conditional Mean Models in Time Series with Conditional Heteroscedasticity of Unknown Form

YM Hong,YJ Lee

DOI: https://doi.org/10.1111/j.1467-937x.2005.00341.x

2005-01-01

Abstract:Economic theories in time series contexts usually have implications on and only on the conditional mean dynamics of underlying economic variables. We propose a new class of specification tests for time series conditional mean models, where the dimension of the conditioning information set may be infinite. Both linear and nonlinear conditional mean specifications are covered. The tests can detect a wide range of model misspecifications in mean while being robust to conditional heteroscedasticity and higher order time-varying moments of unknown form. They check a large number of lags, but naturally discount higher order lags, which is consistent with the stylized fact that economic behaviours are more affected by the recent past events than by the remote past events. No specific estimation method is required, and the tests have the appealing "nuisance parameter free" property that parameter estimation uncertainty has no impact on the limit distribution of the tests. A simulation study shows that it is important to take into account the impact of conditional heteroscedasticity; failure to do so will cause overrejection of a correct conditional mean model. In a horse race competition on testing linearity in mean, our tests have omnibus and robust power against a variety of alternatives relative to some existing tests. In an application, we find that after removing significant but possibly spurious autocorrelations due to nonsynchronous trading, there still exists significant predictable nonlinearity in mean for S&P 500 and NASDAQ daily returns.
Diagnostic Checking for the Adequacy of Nonlinear Time Series Models

YM Hong,TH Lee

DOI: https://doi.org/10.1017/s0266466603196089

IF: 1.968

2003-01-01

Econometric Theory

Abstract:We propose a new diagnostic test for linear and nonlinear time series models, using a generalized spectral approach. Under a wide class of time series models that includes autoregressive conditional heteroskedasticity (ARCH) and autoregressive conditional duration (ACD) models, the proposed test enjoys the appealing "nuisance-parameter-free" property in the sense that model parameter estimation uncertainty has no impact on the limit distribution of the test statistic. It is consistent against any type of pairwise serial dependence in the model standardized residuals and allows the choice of a proper lag order via data-driven methods. Moreover, the new test is asymptotically more efficient than the correlation integral-based test of Brock, Hsieh, and LeBaron (1991, Nonlinear Dynamics, Chaos, and Instability: Statistical Theory and Economic Evidence) and Brock, Dechert, Scheinkman, and LeBaron (1996, Econometric Reviews 15, 197-235), the well-known BDS test, against a class of plausible local alternatives (not including ARCH). A simulation study compares the finite-sample performance of the proposed test and the tests of BDS, Box and Pierce (1970, Journal of the American Statistical Association 65, 1509-1527), I-jung and Box (1978, Biometrika 65, 297-303), McLeod and Li (1983, Journal of Time Series Analysis 4, 269-273), and Li and Mak (1994, Journal of Time Series Analysis 15, 627-636). The new test has good power against a wide variety of stochastic and chaotic alternatives to the null models for conditional mean and conditional variance. It can play a valuable role in evaluating adequacy of linear and nonlinear time series models. An empirical application to the daily S&P 500 price index highlights the merits of our approach.
A Unified Approach to Validating Univariate and Multivariate Conditional Distribution Models in Time Series

Bin Chen,Yongmiao Hong

DOI: https://doi.org/10.1016/j.jeconom.2013.08.004

2013-01-01

Abstract:Modeling conditional distributions in time series has attracted increasing attention in economics and finance. We develop a new class of generalized Cramer–von Mises (GCM) specification tests for time series conditional distribution models using a novel approach, which embeds the empirical distribution function in a spectral framework. Our tests check a large number of lags and are therefore expected to be powerful against neglected dynamics at higher order lags, which is particularly useful for non-Markovian processes. Despite using a large number of lags, our tests do not suffer much from loss of a large number of degrees of freedom, because our approach naturally downweights higher order lags, which is consistent with the stylized fact that economic or financial markets are more affected by recent past events than by remote past events. Unlike the existing methods in the literature, the proposed GCM tests cover both univariate and multivariate conditional distribution models in a unified framework. They exploit the information in the joint conditional distribution of underlying economic processes. Moreover, a class of easy-to-interpret diagnostic procedures are supplemented to gauge possible sources of model misspecifications. Distinct from conventional CM and Kolmogorov–Smirnov (KS) tests, which are also based on the empirical distribution function, our GCM test statistics follow a convenient asymptotic N ( 0 , 1 ) distribution and enjoy the appealing “nuisance parameter free” property that parameter estimation uncertainty has no impact on the asymptotic distribution of the test statistics. Simulation studies show that the tests provide reliable inference for sample sizes often encountered in economics and finance.
One‐sided Testing for Conditional Heteroskedasticity in Time Series Models

Yongmiao Hong

DOI: https://doi.org/10.1111/1467-9892.00049

1997-01-01

Journal of Time Series Analysis

Abstract:Engle’s autoregressive conditional heteroskedasticity (ARCH) model and its various generalizations have been widely used to model the volatility of economic and financial time series. Most existing ARCH tests fail to exploit the one‐sided nature of the alternative hypothesis. Lee and King (A locally most mean powerful based score test for ARCH and GARCH regression disturbances. J. Bus. Econ. Stat. 11 (1993), 17–27) recently proposed a locally most mean powerful score‐based one‐ sided test for ARCH effects. In this paper a new one‐sided test for ARCH effects of the disturbance of a dynamic regression model is proposed. The test is based on a weighted sum of sample autocorrelations of squared regression residuals, with the weighting function typically giving more weight to lower orders of lags and less weight to higher orders of lags. Lee and King’s (1993) test can be viewed as a special case of the present approach with the use of uniform weighting. Many non‐uniform weighting schemes deliver better power than uniform weighting; the efficiency gain is substantial when a relatively long lag is used. A simulation experiment confirms the gains from exploiting the one‐sided nature of the alternative hypothesis and from using non‐uniform weighting.
An Improved Generalized Spectral Test for Conditional Mean Models in Time Series with Conditional Heteroskedasticity of Unknown Form

Yongmiao Hong,Yoon-Jin Lee

DOI: https://doi.org/10.1017/s0266466607070053

IF: 1.968

2007-01-01

Econometric Theory

Abstract:Dynamic economic theories usually have implications on and only on the conditional mean dynamics of economic processes. Using a generalized spectral derivative approach, Hong and Lee (2005, Review of Economic Studies 72, 499-541) recently proposed a new class of omnibus nonparametric specification tests for linear and nonlinear time series conditional mean models, where the dimension of the conditioning information set may be infinite. The tests can detect a wide range of model misspecifications in mean while being robust to conditional heteroskedasticity and time-varying higher order moments of unknown form. They enjoy an asymptotic "nuisance parameter-free" property in the sense that parameter estimation uncertainty has no impact on the asymptotic N(0, 1) distribution of the test statistics. As a result, only the estimated residuals from the null parametric model are needed to implement the tests, and no specific estimation is required.Although parameter estimation uncertainty has no impact on the asymptotic distribution of the tests, it may have significant impact on the finite-sample distribution, and such an impact may become more substantial as the number of estimated parameters increases. In this paper, we adopt the Wooldridge (1990, Econometric Theory 6, 17-43) device for parametric m-tests to the Hong and Lee (2005) nonparametric tests to reduce the impact of parameter estimation uncertainty. Asymptotic size and power properties of the modified tests are investigated, and simulation studies show that the modified tests generally have better sizes in finite samples and are robust to parameter estimation uncertainty. In the meantime, the size improvement does not cause loss of power against a wide range of alternatives when using the empirical critical values for the tests. These results suggest that the modified generalized spectral derivative tests can be a useful tool in time series conditional mean modeling.
Specification Tests for Time-Varying Coefficient Models

Zhonghao Fu,Yongmiao Hong,Liangjun Su,Xia Wang

DOI: https://doi.org/10.1016/j.jeconom.2022.08.001

IF: 3.363

2023-01-01

Journal of Econometrics

Abstract:Time-varying coefficient models have been widely used to characterize changing relationships among economic and financial variables. The existing literature usually specifies the time-varying coefficient vector as a stationary stochastic process, a deterministic function of time, and a unit root process, respectively. In this paper, we propose two tests to distinguish these three specifications. Both test statistics follow asymptotic normal distributions under the respective null hypotheses and diverge to infinity in probability under the corresponding alternatives. To improve the finite sample performance of the tests, we propose a dependent wild bootstrap to obtain the bootstrap critical value (or P-value) and establish its asymptotic validity. Simulation studies show that our bootstrap-based tests perform reasonably well in finite samples. We apply the proposed tests to the time-varying specifications of the equity return’s predictive model, the U.S. Taylor rule, and inflation persistence, respectively. The results suggest that a unit root process is favored for the first application, whereas a deterministic function of time should be adopted for the latter two applications.
Testing Strict Stationarity With Applications To Macroeconomic Time Series

Yongmiao Hong,Xia Wang,Shouyang Wang

DOI: https://doi.org/10.1111/iere.12250

IF: 1.418

2017-01-01

International Economic Review

Abstract:We propose a model-free test for strict stationarity. The idea is to estimate a nonparametric time-varying characteristic function and compare it with the empirical characteristic function based on the whole sample. We also propose several derivative tests to check time-invariant moments, weak stationarity, and pth order stationarity. Monte Carlo studies demonstrate excellent power of our tests. We apply our tests to various macroeconomic time series and find overwhelming evidence against strict and weak stationarity for both level and first-differenced series. This suggests that the conventional time series econometric modeling strategies may have room to be improved by accommodating these time-varying features.
A General Approach to Testing Volatility Models in Time Series

Yongmiao Hong,Yoon-Jin Lee

DOI: https://doi.org/10.3724/sp.j.1383.201001

2017-01-01

Journal of Management Science and Engineering

Abstract:Volatility models have been playing important roles in economics and finance. Using a generalized spectral second order derivative approach, we propose a new class of generally applicable omnibus tests for the adequacy of linear and nonlinear volatility models. Our tests have a convenient asymptotic null N(0,1) distribution, and can detect a wide range of misspecifications for volatility dynamics, including both neglected linear and nonlinear volatility dynamics. Distinct from the existing diagnostic tests for volatility models, our tests are robust to time-varying higher order moments of unknown form (e.g., time-varying skewness and kurtosis). They check a large number of lags and are therefore expected to be powerful against neglected volatility dynamics that occurs at higher order lags or display long memory properties. Despite using a large number of lags, our tests do not suffer much from the loss of a large number of degrees of freedom, because our approach naturally discounts higher order lags, which is consistent with the stylized fact that economic or financial markets are affected more by the recent past events than by the remote past events. No specific estimation method is required, and parameter estimation uncertainty has no impact on the convenient limit N(0,1) distribution of the test statistics. Moreover, there is no need to formulate an alternative volatility model, and only estimated standardized residuals are needed to implement our tests. We do not have to calculate tedious and model-specific score functions or derivatives of volatility models with respect to estimated parameters, which are required in some existing popular diagnostic tests for volatility models. We examine the finite sample performance of the proposed tests. It is documented that the new tests are rather powerful in detecting neglected nonlinear volatility dynamics which the existing tests can easily miss. They are useful diagnostic tools for practitioners when modelling volatility dynamics.
Testing the Structure of Conditional Correlations in Multivariate Garch Models: A Generalized Cross-Spectrum Approach

Nadine McCloud,Yongmiao Hong

DOI: https://doi.org/10.1111/j.1468-2354.2011.00657.x

IF: 1.418

2011-01-01

International Economic Review

Abstract:We introduce a class of generally applicable specification tests for constant and dynamic structures of conditional correlations in multivariate GARCH models. The tests are robust to the presence of time-varying higher-order conditional moments of unknown form and are pure significance tests. The tests can identify linear and nonlinear misspecifications in conditional correlations. Our approach does not necessitate a particular parameter estimation method and distributional assumption on the error process. The asymptotic distribution of the tests is invariant to the uncertainty in parameter estimation. We assess the finite sample performance of our tests using simulated and real data.
Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

Bin Chen,Yongmiao Hong

DOI: https://doi.org/10.1017/s026646660999048x

IF: 1.968

2010-01-01

Econometric Theory

Abstract:We develop a nonparametric regression-based goodness-of-fit test for multifactor continuous-time Markov models using the conditional characteristic function, which often has a convenient closed form or can be approximated accurately for many popular continuous-time Markov models in economics and finance. An omnibus test fully utilizes the information in the joint conditional distribution of the underlying processes and hence has power against a vast class of continuous-time alternatives in the multifactor framework. A class of easy-to-interpret diagnostic procedures is also proposed to gauge possible sources of model misspecification. All the proposed test statistics have a convenient asymptotic N (0, 1) distribution under correct model specification, and all asymptotic results allow for some data-dependent bandwidth. Simulations show that in finite samples, our tests have reasonable size, thanks to the dimension reduction in nonparametric regression, and good power against a variety of alternatives, including misspecifications in the joint dynamics, but the dynamics of each individual component is correctly specified. This feature is not attainable by some existing tests. A parametric bootstrap improves the finite-sample performance of proposed tests but with a higher computational cost.
Approach to Testing Nonlinear Time Series Models

Yongmiao Hong,Yoon-Jin Lee

2014-01-01

Abstract:This paper proposes a unied approach to testing adequacy of nonlinear time series models. The proposed test can be applied to various nonlinear time series models, including conditional probability distribution models, Markov chain regime-switching models, conditional duration models, conditional intensity models, continuous-time jump di¤usion models, continuous-time regression models, and conditional quantile and interval models. Our approach is built upon the fact that for many nonlinear time series models, model adequacy usually implies that a suitably transformed process is an independent and identically distributed (i.i.d.) sequence with some specied marginal distribution. Examples include the probability integral transform of an autoregressive conditional distribution model, the integrated hazard function of a conditional duration or intensity model, the time-change transform of a continuous-time regression model, and the binary transformation of an autoregressive conditional quantile or interval model. These transforms are, respectively, i.i.d.U[0,1], i.i.d.EXP(1); i.i.d. N(0,1) and i.i.d. Bernoulli( ) for some known 2 (0; 1) when the time series models are correctly specied. The transformed process may be called the generalized residuals of a time series model since they are generalizations of Cox and Snells (1968) concept of generalized residuals to a time series context. The proposed test checks the joint hypothesis of generalized residuals via a frequency domain approach and has omnibus power against a wide range of model misspecications. It has a convenient null asymptotic N(0,1) distribution and is robust to dependent persistence in the underlying time series process. A Monte Carlo simulation study illustrates the merits of the approach.
Detecting Misspecifications in Autoregressive Conditional Duration Models

Yongmiao Hong,Yoon-Jin Lee

DOI: https://doi.org/10.1111/j.1467-9892.2010.00681.x

2011-01-01

Journal of Time Series Analysis

Abstract:We propose a new class of specification tests for Autoregressive Conditional Duration (ACD) models. Both linear and nonlinear ACD models are covered, and standardized innovations can have time-varying conditional dispersion and higher order conditional moments of unknown form. No specific estimation method is required, and the tests have a convenient null asymptotic N(0,1) distribution. To reduce the impact of parameter estimation uncertainty in finite samples, we adopt Wooldridge's (1990a) device to our context and justify its validity. Simulation studies show that the finite sample correction gives better sizes in finite samples and are robust to parameter estimation uncertainty. And, it is important to take into account time-varying conditional dispersion and higher order conditional moments in standardized innovations; failure to do so can cause strong overrejection of a correctly specified ACD model. The proposed tests have reasonable power against a variety of popular linear and nonlinear ACD alternatives.
Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression

Bin Chen,Yongmiao Hong

DOI: https://doi.org/10.3982/ECTA7990

IF: 6.1

2012-01-01

Econometrica

Abstract:Checking parameter stability of econometric models is a long-standing problem. Almost all existing structural change tests in econometrics are designed to detect abrupt breaks. Little attention has been paid to smooth structural changes, which may be more realistic in economics. We propose a consistent test for smooth structural changes as well as abrupt structural breaks with known or unknown change points. The idea is to estimate smooth time-varying parameters by local smoothing and compare the fitted values of the restricted constant parameter model and the unrestricted time-varying parameter model. The test is asymptotically pivotal and does not require prior information about the alternative. A simulation study highlights the merits of the proposed test relative to a variety of popular tests for structural changes. In an application, we strongly reject the stability of univariate and multivariate stock return prediction models in the postwar and post-oil-shocks periods.
On A Robust Test for Setar-Type Nonlinearity in Time Series Analysis

King Chi Hung,Siu Hung Cheung,Wai-Sum Chan,Li-Xin Zhang

DOI: https://doi.org/10.1002/for.1122

2009-01-01

Journal of Forecasting

Abstract:There has been growing interest in exploiting potential forecast gains from the nonlinear structure of self-exciting threshold autoregressive (SETAR) models. Statistical tests have been proposed in the literature to help analysts check for the presence of SETAR-type nonlinearities in observed time series. However, previous studies show that classical nonlinearity tests are not robust to additive outliers. In practice, time series outliers are not uncommonly encountered. It is important to develop a more robust test for SETAR-type nonlinearity in time series analysis and forecasting. In this paper we propose a new robust nonlinearity test and the asymptotic null distribution of the test statistic is derived. A Monte Carlo experiment is carried out to compare the power of the proposed test with other existing tests under the influence of time series outliers. The effects of additive outliers on nonlinearity tests with misspecification of the autoregressive order are also studied. The results indicate that the proposed method is preferable to the classical tests when the observations are contaminated with outliers. Finally, we provide illustrative examples by applying the statistical tests to three real datasets. Copyright © 2009 John Wiley & Sons, Ltd.
Generalized spectral tests for serial dependence

Yongmiao Hong

DOI: https://doi.org/10.1111/1467-9868.00250

2000-01-01

Abstract:Two tests for serial dependence are proposed using a generalized spectral theory in combination with the empirical distribution function. The tests are generalizations of the Cramer-von Mises and Kolmogorov-Smirnov tests based on the standardized spectral distribution function. They do not involve the choice of a lag order, and they are consistent against all types of pairwise serial dependence, including those with zero autocorrelation. They also require no moment condition and are distribution free under serial independence. A simulation study compares the finite sample performances of the new tests and some closely related tests. The asymptotic distribution theory works well in finite samples. The generalized Cramer-von Mises test has good power against a variety of dependent alternatives and dominates the generalized Kolmogorov-Smirnov test. A local power analysis explains some important stylized facts on the power of the tests based on the empirical distribution function.
Testing for Pairwise Serial Independence Via the Empirical Distribution Function

YM Hong

DOI: https://doi.org/10.1111/1467-9868.00134

1998-01-01

Journal of the Royal Statistical Society Series A (Statistics in Society)

Abstract:Summary Built on Skaug and Tjøstheim's approach, this paper proposes a new test for serial independence by comparing the pairwise empirical distribution functions of a time series with the products of its marginals for various lags, where the number of lags increases with the sample size and different lags are assigned different weights. Typically, the more recent information receives a larger weight. The test has some appealing attributes. It is consistent against all pairwise dependences and is powerful against alternatives whose dependence decays to zero as the lag increases. Although the test statistic is a weighted sum of degenerate Cramér–von Mises statistics, it has a null asymptotic N(0, 1) distribution. The test statistic and its limit distribution are invariant to any order preserving transformation. The test applies to time series whose distributions can be discrete or continuous, with possibly infinite moments. Finally, the test statistic only involves ranking the observations and is computationally simple. It has the advantage of avoiding smoothed nonparametric estimation. A simulation experiment is conducted to study the finite sample performance of the proposed test in comparison with some related tests.

Market Timing: Recent Development and a New Test

Pitfalls in market timing test

Testing Independence of Two Autocorrelated Binary Time Series

Test for Market Timing Using Daily Fund Returns

Nonparametric Tests for Market Timing Ability Using Daily Mutual Fund Returns

Generalized Spectral Tests for Conditional Mean Models in Time Series with Conditional Heteroscedasticity of Unknown Form

Diagnostic Checking for the Adequacy of Nonlinear Time Series Models

A Unified Approach to Validating Univariate and Multivariate Conditional Distribution Models in Time Series

One‐sided Testing for Conditional Heteroskedasticity in Time Series Models

An Improved Generalized Spectral Test for Conditional Mean Models in Time Series with Conditional Heteroskedasticity of Unknown Form

Specification Tests for Time-Varying Coefficient Models

Testing Strict Stationarity With Applications To Macroeconomic Time Series

A General Approach to Testing Volatility Models in Time Series

Testing the Structure of Conditional Correlations in Multivariate Garch Models: A Generalized Cross-Spectrum Approach

Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

Approach to Testing Nonlinear Time Series Models

Detecting Misspecifications in Autoregressive Conditional Duration Models

Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression

On A Robust Test for Setar-Type Nonlinearity in Time Series Analysis

Generalized spectral tests for serial dependence

Testing for Pairwise Serial Independence Via the Empirical Distribution Function