Stochastic Gradient Descent in the Optimal Control of Execution Costs

Simeon Kolev
2024-12-15
Abstract:Bertsimas and Lo's seminal work laid the groundwork for addressing the implementation shortfall dilemma in institutional investing, emphasizing the significance of market microstructure and price dynamics in minimizing execution costs. However, the ability to derive a theoretical Optimum market order policy is an unrealistic assumption for many investors. This study aims to bridge this gap by proposing an approach that leverages stochastic gradient descent (SGD) to derive alternative solutions for optimizing execution cost policies in dynamic markets where explicit mathematical solutions may not yet exist. The proposed methodology assumes the existence of a mathematically derived optimal solution that is a function of the underlying market dynamics. By iteratively refining strategies using SGD, economists can adapt their approaches over time based on evolving execution strategies. While these SGD-based solutions may not achieve optimality, they offer valuable insights into optimizing policies under complex market frameworks. These results serve as a bridge for economists and mathematicians, facilitating the study of the Optimum policy volatile markets while offering SGD driven implementable policies that closely approximate optimal outcomes within shorter time frames.
Trading and Market Microstructure
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to optimize the execution costs in a dynamic market, especially in cases where explicit mathematical solutions are difficult to obtain, by using Stochastic Gradient Descent (SGD) to derive approximate optimal trading strategies. ### Problem Background Large - scale institutional investors face specific challenges when managing profits and trading costs. Due to the large scale of assets managed by these institutions, they need to give priority to efficient trading execution in order to minimize trading costs (such as commissions, bid - ask spreads and order - size costs). However, the traditional "optimal strategies" assumptions in the market are often unrealistic, because these strategies rely on accurate modeling of market microstructure and price dynamics, and in practice, such accurate modeling is often difficult to achieve. ### Research Objectives This research aims to provide a new solution for complex market environments where explicit mathematical solutions cannot be obtained by introducing the Stochastic Gradient Descent (SGD) method. Specifically, the author hopes that by iteratively adjusting the strategies, economists can continuously optimize trading strategies in the process of market dynamic changes. Even if these strategies may not be globally optimal, they can still provide valuable references and approach the optimal results in a relatively short time. ### Method Overview The paper proposes four SGD - based optimization algorithms: 1. **Adaptive Gradient Algorithm (AdaGrad)** 2. **Root Mean Square Propagation (RMSprop)** 3. **Adaptive Moment Estimation (Adam)** 4. **Custom - made SGD Algorithm** These algorithms optimize trading strategies through different learning - rate adjustment mechanisms and conduct a comparative analysis with classical optimal strategies. The experimental results show that although the SGD algorithms have not completely surpassed the classical optimal strategies, they can reach relatively close optimal solutions in practice and show lower execution - cost fluctuations in some cases. ### Main Conclusions Although the SGD algorithms have not completely defeated the classical optimal strategies proposed by Bertsimas and Lo, they can converge to results close to the optimal solutions in practice. In particular, the custom - made SGD algorithm and the AdaGrad algorithm show the smallest cumulative execution costs and lower standard deviations, indicating that in some cases, simple SGD algorithms may be sufficient to deal with complex market dynamics. In conclusion, this research provides practical alternatives for complex markets where explicit mathematical solutions cannot be obtained, which has important theoretical and practical significance.