JAPO: Learning Join and Pushdown Order for Cloud-Native Join Optimization

Yuchen Yuan,Xiaoyue Feng,Bo Zhang,Pengyi Zhang,Jie Song
DOI: https://doi.org/10.1007/s11704-024-3937-z
IF: 2.6688
2024-01-01
Frontiers of Computer Science
Abstract:In this paper, we introduce JAPO which learn the join and pushdown order through DRL. The main idea is that the DRL agent learns better decisions based on the experiences by monitoring the rewards and latencies via trying different actions. The results show that our method can generate good plans both on join order and pushdown order. We also show that our method can select the well-performed distributed index placement via experiments. In the future, we plan to deploy JAPO to real systems execution and consider more factors in JAPO, such as different join types.
What problem does this paper attempt to address?