Abstract:We develop a present-value model where the fundamental and non-fundamental components switch between distinct regimes. The non-fundamental component is specified as a periodically collapsing bubble of Balke and Wohar [Balke, N. S., & Wohar, M. E. (2009). Market fundamentals versus rational bubbles in stock prices: A Bayesian perspective. Journal of Applied Econometrics, 24(1), 35–75. https://doi.org/10.1002/jae.1025]. The fundamental component is constructed as in van Binsbergen and Koijen [van Binsbergen, J. H., & Koijen, R. S. J. (2010). Predictive regressions: A present-value approach. The Journal of Finance, 65(4), 1439–1471. https://doi.org/10.1111/j.1540-6261.2010.01575.x], by treating the expectations of market fundamentals as latent variables. Unlike existing methods, e.g. [Zhu, X. (2015). Tug-of-war: Time-varying predictability of stock returns and dividend growth. Review of Finance, 19(6), 2317–2358. https://doi.org/10.1093/rof/rfu047; Choi, K. H., Kim, C., & Park, C. (2017). Regime shifts in price-dividend ratios and expected stock returns: A present-value approach. Journal of Money, Credit and Banking, 49(2–3), 417–441. https://doi.org/10.1111/jmcb.12384; Chan, J. C., & Santi, C. (2021). Speculative bubbles in present-value models: A Bayesian Markov-switching state space approach. Journal of Economic Dynamics and Control, 127, 1–26], ours requires no unnecessary approximations, accommodates flexible forms of regime-switching, and the resulting present-value formula is internally consistent.

On Some Geometric Behavior of Value Iteration on the Orthant: Switching System Perspective

On Value Iteration Convergence in Connected MDPs

Analytic Value Function for Optimal Regime-Switching Pairs Trading Rules

Value Iteration is Optic Composition

Asynchronous value iteration for markov decision processes with continuous state spaces

Model-free Value Iteration Algorithm for Continuous-time Stochastic Linear Quadratic Optimal Control Problems

Incremental Value Iteration for Time-Aggregated Markov-Decision Processes

A policy iteration algorithm for non-Markovian control problems

Inverse Policy Evaluation for Value-based Sequential Decision-making

Deflated Dynamics Value Iteration

Value Maximization under Stochastic Quasi-Hyperbolic Discounting

On the continuity and smoothness of the value function in reinforcement learning and optimal control

Final Iteration Convergence Bound of Q-Learning: Switching System Approach

Switching Games Of Stochastic Differential Systems

Developing a Regime-Switching Present Value Model: Switching Fundamentals and Bubbles

Invariance Principles and Observability in Switched Systems with an Application in Consensus

Common Value Experimentation.

Stochastic Knapsack Problem Revisited: Switch-Over Policies and Dynamic Pricing

Stopping Criteria for Value Iteration on Stochastic Games with Quantitative Objectives

Stochastic optimal switching and systems of variational inequalities with interconnected obstacles