BYY harmony learning, independent state space, and generalized APT financial analyses

XuLei

2001-01-01

IEEE Transactions on Neural Networks

Abstract:First, the relationship between factor analysis (FA) and the well-known arbitrage pricing theory (APT) for financial market is discussed comparatively, with a number of to-be-improved problems list...

What problem does this paper attempt to address?

On Generalized Arbitrage Pricing Theory Analysis: Empirical Investigation of the Macroeconomics Modulated Independent State-Space Model

KC Chiu,L Xu

DOI: https://doi.org/10.1109/cifer.2003.1196253

2003-01-01

Abstract:The inception of Markowitz's (1952) modern portfolio theory has also fuelled the development of asset pricing models for empirical finance, ranging from linear single-factor models like the capital asset pricing model to fairly complex multi-factor models such as the arbitrage pricing theory (APT). It is well-known in the literature of finance that APT could be used for modelling the underlying security returns generation process. We investigate a generalized version of the APT model, called the macroeconomics modulated independent state-space model, in terms of model specification adequacy as well as its performance on prediction. Empirical results reveal that the model is not only well-specified, but also superior to the temporal factor analysis model in stock price and index forecasting, thanks to its salient capabilities of modelling both short-term and long-term market dynamics.
NFA FOR FACTOR NUMBER DETERMINATION IN APT

KAI-CHUN CHIU,LEI XU

DOI: https://doi.org/10.1142/S021902490400244X

2011-01-01

International Journal of Theoretical and Applied Finance

Abstract:In the context of quantitative analysis of the arbitrage pricing theory (APT) model, con- ventional factor analytic approaches such as maximum likelihood factor analysis (MLFA) cannot provide satisfactory answers to two important questions. The rst one concerns the correct identication of factor number while the second one is related to the rota- tion indeterminacy of factor loadings. In the literature, MLFA followed by likelihood ratio (LR) test and the analysis of eigenvalues of sample covariance matrix were two popular approaches used to determine the appropriate number of factors. However, it was shown empirically that both of them suered from dieren t kinds of biases. We nd the recently developed non-gaussian factor analysis (NFA) model by Xu (24) provides a new perspective for the determination of the appropriate factor number k in APT, with promising empirical results demonstrated.
Advances on BYY Harmony Learning: Information Theoretic Perspective, Generalized Projection Geometry, and Independent Factor Autodetermination

L Xu

DOI: https://doi.org/10.1109/tnn.2004.828767

2004-01-01

IEEE Transactions on Neural Networks

Abstract:The nature of Bayesian Ying-Yang harmony learning is reexamined from an information theoretic perspective. Not only its ability for model selection and regularization is explained with new insights, but also discussions are made on its relations and differences from the studies of minimum description length (MDL), Bayesian approach, the bit-back based MDL, Akaike information criterion (AIC), maximum likelihood, information geometry, Helmholtz machines, and variational approximation. Moreover, a generalized projection geometry is introduced for further understanding such a new mechanism. Furthermore, new algorithms are also developed for implementing Gaussian factor analysis (FA) and non-Gaussian factor analysis (NFA) such that selecting appropriate factors is automatically made during parameter learning.
A comparative study of Gaussian TFA learning and statistical tests on the factor number in APT

Kai Chun Chiu,Lei Xu

DOI: https://doi.org/10.1109/IJCNN.2002.1007490

2002-01-01

Abstract:The temporal factor analysis (TFA) model is found to be useful for determining factor number k in classical financial arbitrage pricing theory (APT) analysis. In this paper, comparisons of factor number determination using different techniques will be shown. Results reveal that TFA is superior to MLFA as well as eigenvalue analysis
An Application of Independent Component Analysis in the Arbitrage Pricing Theory

F Yip,L Xu

DOI: https://doi.org/10.1109/ijcnn.2000.861471

2000-01-01

Abstract:The arbitrage pricing theory is a normative equilibrium theory, the theory infers that there may be a multitude of risk factors driving asset returns. Broadly speaking, three approaches can be used to identify these factors, they are the fundamental model, macroeconomic model and statistical model. In the traditional approach, the statistical model applies principal component analysis (PCA) to decompose the covariance matrix of asset returns. We discuss the relationship between macroeconomic variables and statistical factors and we apply independent component analysis (ICA) and a newly proposed ICA factor selection criterion in the statistical model, using ICA as a plug-in of the statistical model. Experiments have shown that it gives a better indication of the underlying structure of the stock market than PCA by using the same number of components.
A structural analysis of price dynamics for a heterogeneous asset-pricing model with market marker

Jun Yin,Shaoyong Lai

2012-01-01

Abstract:Heterogeneous beliefs have been widely regarded as the basic premise for construction of asset pricing models. By taking the market maker scenario as market clearing mechanism, a heterogeneous asset pricing (HAP) model with market maker is constructed and investigated in this paper. The bifurcation theory is applied to analyze the underling deterministic system and the wavelet analysis is used to study the stochastic model. The study shows that the asset price dynamics is highly associated with the behavior of the market maker, the level of activity of the fundamentalists and trend followers. Copyright © 2012 Watam Press.
Financial APT-Based Gaussian TFA Learning for Adaptive Portfolio Management

Kai Chun Chiu,Lei Xu

DOI: https://doi.org/10.1007/3-540-46084-5_165

2002-01-01

Abstract:Adaptive portfolio management has been studied in the literature of neural nets and machine learning. The recently developed Temporal Factor Analysis (TFA) model mainly targeted for further study of the Arbitrage Pricing Theory (APT) is found to have potential applications in portfolio management. In this paper, we aim to illustrate the superiority of APT-based portfolio management over return-based portfolio management.
A Comparative Investigation on Model Selection in Independent Factor Analysis

Yujia An,Xuelei Hu,Lei Xu

DOI: https://doi.org/10.1007/s10852-005-9021-2

2006-01-01

Journal of Mathematical Modelling and Algorithms

Abstract:With uncorrelated Gaussian factors extended to mutually independent factors beyond Gaussian, the conventional factor analysis is extended to what is recently called independent factor analysis. Typically, it is called binary factor analysis (BFA) when the factors are binary and called non-Gaussian factor analysis (NFA) when the factors are from real non-Gaussian distributions. A crucial issue in both BFA and NFA is the determination of the number of factors. In the literature of statistics, there are a number of model selection criteria that can be used for this purpose. Also, the Bayesian Ying-Yang (BYY) harmony learning provides a new principle for this purpose. This paper further investigates BYY harmony learning in comparison with existing typical criteria, including Akaik’s information criterion (AIC), the consistent Akaike’s information criterion (CAIC), the Bayesian inference criterion (BIC), and the cross-validation (CV) criterion on selection of the number of factors. This comparative study is made via experiments on the data sets with different sample sizes, data space dimensions, noise variances, and hidden factors numbers. Experiments have shown that for both BFA and NFA, in most cases BIC outperforms AIC, CAIC, and CV while the BYY criterion is either comparable with or better than BIC. In consideration of the fact that the selection by these criteria has to be implemented at the second stage based on a set of candidate models which have to be obtained at the first stage of parameter learning, while BYY harmony learning can provide not only a new class of criteria implemented in a similar way but also a new family of algorithms that perform parameter learning at the first stage with automated model selection, BYY harmony learning is more preferred since computing costs can be saved significantly.
Arbitrage Pricing Theory-Based Gaussian Temporal Factor Analysis For Adaptive Portfolio Management

Kc Chiu,L Xu

DOI: https://doi.org/10.1016/S0167-9236(03)00082-4

IF: 6.969

2004-01-01

Decision Support Systems

Abstract:Ever since the inception of Markowitz's modem portfolio theory, static portfolio optimization techniques were gradually phased out by dynamic portfolio management due to the growth of popularity in automated trading. In view of the intensive computational needs, it is common to use machine learning approaches on Sharpe ratio maximization for implementing dynamic portfolio optimization. In the literature, return-based approaches which directly used security prices or returns to control portfolio weights were often used. Inspired by the arbitrage pricing theory (APT), some other efforts concentrate on indirect modelling using hidden factors. On the other hand, with regard to the proper risk measure in the Sharpe ratio, downside risk was considered a better substitute for variance. In this paper, we investigate how the Gaussian temporal factor analysis (TFA) technique can be used for portfolio optimization. Since TFA is based on the classical APT model and has the benefit of removing rotation indeterminacy via temporal modelling, using TFA for portfolio management allows portfolio weights to be indirectly controlled by several hidden factors. Moreover, we extend the approach to some other variants tailored for investors according to their investment objectives and degree of risk tolerance. (C) 2003 Elsevier B.V. All rights reserved.
Bayesian Ying-Yang Learning on Orthogonal Binary Factor Analysis

Ke Sun,Lei Xu

DOI: https://doi.org/10.1007/978-3-540-87536-9_27

2008-01-01

Abstract:Binary Factor Analysis (BFA) aims to discover latent binary structures in high dimensional data. Parameter learning in BFA suffers from exponential complexity and a large number of local optima. Model selection in BFA is therefore difficult. The traditional approach for model selection is implemented in a two phase procedure. On a prefixed range of model scales, maximum likelihood (ML) learning is performed for each candidate scale. After this enumeration, the optimum scale is selected according to some criterion. In contrast, the Bayesian Ying-Yang (BYY) learning starts from a high dimensional model and automatically deducts the dimension during parameter learning. The enumeration overhead in the two phase approach is saved. This paper investigates a subclass of BFA called Orthogonal Binary Factor Analysis (OBFA). A BYY machine for OBFA is constructed. The harmony measure, which serves as the objective function in the BYY harmony learning, is more accurately estimated by recovering a term that was missing in the previous studies on BYY learning based BFA. Comparison with traditional two phase implementations shows good performance of the proposed approach.
TESTS OF GAUSSIAN TEMPORAL FACTOR LOADINGS IN FINANCIAL APT

Kai Chun Chiu,Lei Xu

2001-01-01

Abstract:The main difficulty of financial APT analysis concerns iden- tifying unambiguously the hidden statistical factors. Lack of effective techniques to retrieve the true factors often leads to inappropriate interpretation of the underlying factor struc- ture. In literature, PCA and MLFA, assuming multivariate Gaussian distributions, and ICA, assuming non-Gaussian distributions, are used to extract factors and determine the corresponding factor loadings. Recently, a new technique called TFA is proposed in (1, 2) which seeks to solve the problem of rotation indeterminacy encountered in conven- tional factor analysis. In this paper we will focus on statisti- cal tests and inference on the APT temporal factor loadings recovered by TFA.
Machine Learning and Causal Analyses for Modeling Financial and Economic Data

Lei Xu

DOI: https://doi.org/10.1186/s40535-018-0058-5

2018-01-01

Applied Informatics

Abstract:Instead of aiming at a systematic survey, we consider further developments on several typical linear models and their mixture extensions for prediction modeling, portfolio management and market analyses. The focus is put on outlining the studies by the author’s research group, featured by (a) extensions of AR, ARCH and GARCH models into finite mixture or mixture-of-experts; (b) improvements of Sharpe ratio by maximizing the expected return and the upside volatility while minimizing the downside risk, with the help of a priori aided diversification; (c) developments of arbitrage pricing theory (APT) into temporal factor analysis (TFA)-based temporal APT, macroeconomics-modulated temporal APT and a general formulation for market modeling, together with applications to temporal prediction and dynamic portfolio management; (d) Bayesian Ying–Yang (BYY) harmony learning is adopted to implement these developments, featured with automatic model selection. After a brief introduction on BYY harmony learning, gradient-based algorithms and EM-like algorithms are provided for learning alternative mixture-of-experts-based AR, ARCH and GARCH models; and (e) path analysis for linear causal analyses is briefly reviewed, a recent development on ρ-diagram is refined for cofounder discovery, and a causal potential theory is proposed. Also, further discussions are made on structural equation modeling and its relations to modulated TFA-APT and nGCH-driven M-TFA-O.
Parameterizations make different model selections: Empirical findings from factor analysis

Shikui Tu,Lei Xu

DOI: https://doi.org/10.1007/s11460-011-0150-2

2011-01-01

Frontiers of Electrical and Electronic Engineering in China

Abstract:How parameterizations affect model selection performance is an issue that has been ignored or seldom studied since traditional model selection criteria, such as Akaike’s information criterion (AIC), Schwarz’s Bayesian information criterion (BIC), difference of negative log-likelihood (DNLL), etc., perform equivalently on different parameterizations that have equivalent likelihood functions. For factor analysis (FA), in addition to one traditional model (shortly denoted by FA-a), it was previously found that there is another parameterization (shortly denoted by FA-b) and the Bayesian Ying-Yang (BYY) harmony learning gets different model selection performances on FA-a and FA-b. This paper investigates a family of FA parameterizations that have equivalent likelihood functions, where each one (shortly denoted by FA- r ) is featured by an integer r , with FA-a as one end that r = 0 and FA-b as the other end that r reaches its upper-bound. In addition to the BYY learning in comparison with AIC, BIC, and DNLL, we also implement variational Bayes (VB). Several empirical finds have been obtained via extensive experiments. First, both BYY and VB perform obviously better on FA-b than on FA-a, and this superiority of FA-b is reliable and robust. Second, both BYY and VB outperform AIC, BIC, and DNLL, while BYY further outperforms VB considerably, especially on FA-b. Moreover, with FA-a replaced by FA-b, the gain obtained by BYY is obviously higher than the one by VB, while the gain by VB is better than no gain by AIC, BIC, and DNLL. Third, this paper also demonstrates how each part of priors incrementally and jointly improves the performances, and further shows that using VB to optimize the hyperparameters of priors deteriorates the performances while using BYY for this purpose can further improve the performances.
Arbitrage-Free Asset Pricing in General State Space

Xiaotie Deng,Shunming Zhang

DOI: https://doi.org/10.1007/3-540-44491-2_80

2000-01-01

Abstract:This paper studies asset pricing in abitrage-free financial markets in general state space. The mathematical formulation is based on a locally convex topological space for weakly arbitrage-free securities' structure and a separable Banach space for strictly arbitrage-free securities' structure. We establish, for these two types of spaces, the weakly arbitrage-free pricing theorem and the strictly arbitrage-free pricing theorem, respectively.
Fundamentals, Challenges, And Advances Of Statistical Learning For Knowledge Discovery And Problem Solving: A Byy Harmony Perspective

lei xu

DOI: https://doi.org/10.1109/ICNNB.2005.1614547

2005-01-01

Abstract:In this paper, an intelligent system is featured by both its abilities of interpreting what are observed via discovering knowledge about the world it survives, and its problem solving skills of handling each issue encountered in the world. Correspondingly, the abilities and skills are obtained by two types of learning via evidences or data from the world. Due to noises in observation and a finite size of samples, learning is statistical in nature, which faces two key challenges. One is finding appropriate mathematical representations to suit various dependence structures underlying world. The other is getting a good theory to guide learning such that dependence structures are not only learned into mathematical representations but also with an appropriate complexity that matches the size of samples (i.e., learning reliable structures of underlying world). This paper consists of part parts. The first two parts summarize typical dependence structures for tackling the challenge one and typical learning theories for tackling for tackling the challenge two. The third part introduces Bayesian Ying Yang (BYY) system as a general framework that unifies typical dependence structures and BYY harmony learning for the challenge two, with several favorable features. To illustrate this BYY learning, in the fourth part we further introduce fundamentals of independence subspaces and advances obtained from BYY harmony learning on typical independence subspaces, including PCA, MCA, DCA, ICA, FA, TFA, NFA, BFA, LMSER, as well as their temporal extensions. Finally, a concluding remark is made and new results of BYY learning in other learning areas are also briefly listed.
Local Factor Analysis with Automatic Model Selection and Data Smoothing Based Regularization

Lei Shi,Lei Xu

2006-01-01

Abstract:Local factor analysis (LFA) is regarded as an efficient approach that implements local feature extraction and dimensionality reduction. A further investigation is made on an automatic BYY harmony data smoothing LFA (LFA-HDS) from the Bayesian Ying-Yang (BYY) harmony learning point of view. On the level of reg- ularization, an data smoothing based regularization technique is adapted into this automatic LFA-HDS learning for problems with small sample sizes, while on the level of model selection, the proposed automatic LFA-HDS algorithm makes pa- rameter learning with automatic determination of both the component number and the factor number in each component. A comparative study has been conducted on simulated data sets and several real problem data sets. The algorithm has been compared with not only a recent approach called Incremental Mixture of Factor Analysers (IMoFA) but also the conventional two-stage implementation of maxi- mum likelihood (ML) plus model selection, namely, using the EM algorithm for parameter learning on a series candidate models, and selecting one best candidate by AIC, CAIC, BIC, and cross-validation (CV). Experiments have shown that IMoFA and ML-BIC, ML-CV outperform ML-AIC or ML-CAIC. Interestingly, the data smoothing BYY harmony learning obtains comparably desired results compared to IMoFA and ML-BIC but with much less computational cost.
Evaluating Asset Pricing Models in Absence of Arbitrage: Econometric Approach and Empirical Applications

Yuewu Xu,Haitao Li,Xiaoyan Zhang

DOI: https://doi.org/10.2139/ssrn.891125

2005-01-01

Abstract:We develop asset pricing tests that explicitly require that a true asset pricing model has to be arbitrage free, i.e., its stochastic discount factor has to be strictly positive. The no-arbitrage restriction is especially important in applications that involve dynamic trading strategies and derivatives. One prominent example is performance evaluation of actively managed portfolios, such as mutual funds and hedge funds. Empirical results show that the no-arbitrage restriction makes significant differences in asset pricing tests involving either the traditional Fama-French size and book-to-market portfolios or hedge fund style portfolios. Ignoring the no-arbitrage restriction, we reach the misleading conclusion that certain models can satisfactorily price both sets of assets. However, these models are overwhelmingly rejected by our tests because their stochastic discount factors take negative values with high probabilities. The no-arbitrage restriction also leads to better identified parameters, better behaved models, and more insights on potential sources of model misspecifications.
White Noise Tests And Apt Economic Factor Syntheses Using Temporal Factor Analysis

Kai Chun Chiu,Lei Xu

2002-01-01

Abstract:The well-known Arbitrage Pricing Theory (APT) in finance relates security returns to variations of several economic factors. Previous success using Temporal Factor Analysis (TFA) to extract statistically uncorrelated factors has shredded light on the possibility of further identification of hidden driving economic factors. In this paper, we will first perforin white noise test on the residuals of the TFA model for model adequacy Next, we will show how correlated economic factors can be synthesized from uncorrelated temporal Gaussian factors in TFA.
Stock Price and Index Forecasting by Arbitrage Pricing Theory-Based Gaussian TFA Learning

Kai Chun Chiu,Lei Xu

DOI: https://doi.org/10.1007/3-540-45675-9_54

2002-01-01

Abstract:Viewed as a promising application of neural networks, financial time series forecasting was studied in the literature of neural nets and machine learning. The recently developed Temporal Factor Analysis (TFA) model mainly targeted at further study of the Arbitrage Pricing Theory (APT) is found to have potential application in the prediction of stock price and index. In this paper, we aim to illustrate the superiority of using the APT-based Gaussian TFA model as compared to three conventional approaches which are not financial model-based.
Byy Harmony Learning, Model Selection, And Information Approach: Further Results

L Xu

2001-01-01

Abstract:After main results and the fundamentals of Bayesian Ying Yang (BYY) system and harmony learning is outlined, its ability on regularization and model selection is explained not only via its least complexity nature that minimizes the inner representation complexity, but also from an information transfer perspective. Moreover, with Ying-Yang pairs described in full distributions instead of simply in conditional distributions, this learning framework is further extended to a more general form for regularization and model selection in,a more complicated BYY system, via controlling both the complexity of inner representation and the complexity of parameters of all the parts in the system.

BYY harmony learning, independent state space, and generalized APT financial analyses

On Generalized Arbitrage Pricing Theory Analysis: Empirical Investigation of the Macroeconomics Modulated Independent State-Space Model

NFA FOR FACTOR NUMBER DETERMINATION IN APT

Advances on BYY Harmony Learning: Information Theoretic Perspective, Generalized Projection Geometry, and Independent Factor Autodetermination

A comparative study of Gaussian TFA learning and statistical tests on the factor number in APT

An Application of Independent Component Analysis in the Arbitrage Pricing Theory

A structural analysis of price dynamics for a heterogeneous asset-pricing model with market marker

Financial APT-Based Gaussian TFA Learning for Adaptive Portfolio Management

A Comparative Investigation on Model Selection in Independent Factor Analysis

Arbitrage Pricing Theory-Based Gaussian Temporal Factor Analysis For Adaptive Portfolio Management

Bayesian Ying-Yang Learning on Orthogonal Binary Factor Analysis

TESTS OF GAUSSIAN TEMPORAL FACTOR LOADINGS IN FINANCIAL APT

Machine Learning and Causal Analyses for Modeling Financial and Economic Data

Parameterizations make different model selections: Empirical findings from factor analysis

Arbitrage-Free Asset Pricing in General State Space

Fundamentals, Challenges, And Advances Of Statistical Learning For Knowledge Discovery And Problem Solving: A Byy Harmony Perspective

Local Factor Analysis with Automatic Model Selection and Data Smoothing Based Regularization

Evaluating Asset Pricing Models in Absence of Arbitrage: Econometric Approach and Empirical Applications

White Noise Tests And Apt Economic Factor Syntheses Using Temporal Factor Analysis

Stock Price and Index Forecasting by Arbitrage Pricing Theory-Based Gaussian TFA Learning

Byy Harmony Learning, Model Selection, And Information Approach: Further Results