Opengauss

Guoliang Li,Xuanhe Zhou,Ji Sun,Yu Xiang,Yue Han,Lianyuan Jin,Wenbo Li,Tianqing Wang,Shifu Li

DOI: https://doi.org/10.14778/3476311.3476380

IF: 2.5

2021-01-01

Proceedings of the VLDB Endowment

Abstract:Although learning-based database optimization techniques have been studied from academia in recent years, they have not been widely deployed in commercial database systems. In this work, we build an autonomous database framework and integrate our proposed learning-based database techniques into an open-source database system openGauss. We propose effective learning-based models to build learned optimizers (including learned query rewrite, learned cost/cardinality estimation, learned join order selection and physical operator selection) and learned database advisors (including self-monitoring, self-diagnosis, self-configuration, and self-optimization). We devise an effective validation model to validate the effectiveness of learned models. We build effective training data management and model management platforms to easily deploy learned models. We have evaluated our techniques on real-world datasets and the experimental results validated the effectiveness of our techniques. We also provide our learnings of deploying learning-based techniques.