Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques

Pohsun Feng,Ziqian Bi,Yizhu Wen,Benji Peng,Junyu Liu,Caitlyn Heqi Yin,Tianyang Wang,Keyu Chen,Sen Zhang,Ming Li,Jiawei Xu,Ming Liu,Xuanhe Pan,Jinlang Wang,Qian Niu
2024-10-13
Abstract:This manuscript presents a comprehensive guide to Automated Machine Learning (AutoML), covering fundamental principles, practical implementations, and future trends. The paper is structured to assist both beginners and experienced practitioners, with detailed discussions on popular AutoML tools such as TPOT, AutoGluon, and Auto-Keras. It also addresses emerging topics like Neural Architecture Search (NAS) and AutoML's applications in deep learning. We believe this work will contribute to ongoing research and development in the field of AI and machine learning.
Machine Learning
What problem does this paper attempt to address?
The paper attempts to address the application and development of automated machine learning (AutoML) in the fields of big data and deep learning. Specifically, the paper focuses on the following aspects: 1. **Automating manual processes**: Improving efficiency and productivity by automating the manual steps in the machine learning process. 2. **Lowering the entry barrier**: Making it easier for beginners to enter the field of machine learning, reducing the reliance on specialized knowledge. 3. **Addressing challenges brought by automation**: Discussing the potential job displacement and changes in the labor market due to automation, and exploring how AutoML can be used as a complementary tool rather than a replacement. The paper also provides a detailed introduction to the basic concepts of AutoML, its historical development, application scenarios, and the usage methods and parameter tuning techniques of several popular AutoML tools (such as TPOT and AutoGluon). Through this content, the paper aims to provide readers with a comprehensive knowledge system of AutoML, helping them better apply these technologies in practical projects.