Abstract:Portfolio optimization aims at constructing a realistic portfolio with significant out-of-sample performance, which is typically measured by the out-of-sample Sharpe ratio. However, due to in-sample optimism, it is inappropriate to use the in-sample estimated covariance to evaluate the out-of-sample Sharpe, especially in the high dimensional settings. In this paper, we propose a novel method to estimate the out-of-sample Sharpe ratio using only in-sample data, based on random matrix theory. Furthermore, portfolio managers can use the estimated out-of-sample Sharpe as a criterion to decide the best tuning for constructing their portfolios. Specifically, we consider the classical framework of Markowits mean-variance portfolio optimization with known mean vector and the high dimensional regime of $p/n \to c \in (0,\infty)$, where $p$ is the portfolio dimension and $n$ is the number of samples or time points. We propose to correct the sample covariance by a regularization matrix and provide a consistent estimator of its Sharpe ratio. The new estimator works well under either of three conditions: (1) bounded covariance spectrum, (2) arbitrary number of diverging spikes when $c < 1$, and (3) fixed number of diverging spikes when $c \ge 1$. We can also extend the results to construct global minimum variance portfolio and correct out-of-sample efficient frontier. We demonstrate the effectiveness of our approach through comprehensive simulations and real data experiments. Our results highlight the potential of this methodology as a powerful tool for portfolio optimization in high dimensional settings.

Econometric identification of the attainable maximal sharpe ratio by optimal shrinkage of the cross-section of asset returns

Prediction of Volatility Based on Realized-Garch-kernel-type Models: Evidence from China and the U.S.

REGULARIZED GMM FOR TIME‐VARYING MODELS WITH APPLICATIONS TO ASSET PRICING

Adaptive Shrinkage Estimation of High Dimensional Moment Condition Model with Smooth Structural Changes

A Globally Optimal Portfolio for m-Sparse Sharpe Ratio Maximization

Combining the MGHyp distribution with nonlinear shrinkage in modeling financial asset returns

Conditional inference on the asset with maximum Sharpe ratio

Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks

Maximizing the Sharpe Ratio: A Genetic Programming Approach

Ergodic robust maximization of asymptotic growth

Optimal Choice under Short Sell Limit with Sharpe Ratio as Criterion among Multiple Assets

Regularizing stock return covariance matrices via multiple testing of correlations

Estimation of Out-of-Sample Sharpe Ratio for High Dimensional Portfolio Optimization

Portfolio optimization under multivariate affine generalized hyperbolic distributions

Sharpe portfolio using a cross-efficiency evaluation

Efficient Bias Robust Cross Section Factor Models

Optimal shrinkage-based portfolio selection in high dimensions

Shrinkage regression for multivariate inference with missing data, and an application to portfolio balancing

Connecting Sharpe ratio and Student t-statistic, and beyond

Asset selection based on high frequency Sharpe ratio

Sparse and stable Markowitz portfolios