Abstract:Deep learning has been successfully explored in addressing different multimedia topics recent years, ranging from object detection, semantic classification, entity annotation, to multimedia captioning, multimedia question answering and storytelling. Open source libraries and platforms such as Tensorflow, Caffe, MXnet significantly help promote the wide deployment of deep learning in solving real-world applications. On one hand, deep learning practitioners, while not necessary to understand the involved math behind, are able to set up and make use of a complex deep network. One recent deep learning tool based on Keras even provides the graphical interface to enable straightforward 'drag and drop' operation for deep learning programming. On the other hand, however, some general theoretical problems of learning such as the interpretation and generalization, have only achieved limited progress. Most deep learning papers published these days follow the pipeline of designing/modifying network structures - tuning parameters - reporting performance improvement in specific applications. We have even seen many deep learning application papers without one single equation. Theoretical interpretation and the science behind the study are largely ignored. While excited about the successful application of deep learning in classical and novel problems, we multimedia researchers are responsible to think and solve the fundamental topics in deep learning science. Prof. Guanrong Chen recently wrote an editorial note titled 'Science and Technology, not SciTech' [1]. This panel falls into similar discussion and aims to invite prestigious multimedia researchers and active deep learning practitioners to discuss the positioning of deep learning research now and in the future. Specifically, each panelist is asked to present their opinions on the following five questions: 1)How do you think the current phenomenon that deep learning applications are explosively growing, while the general theoretical problems remain slow progress? 2)Do you agree that deployment of deep learning techniques is getting easy (with a low barrier), while deep learning research is difficult (with a high barrier) 3)What do you think are the core problems for deep learning techniques? 4)What do you think are the core problems for deep learning science? 5)What's your suggestion on the multimedia research in the post-deep learning era?

AutoML and Meta-learning for Multimedia

Techniques for Automated Machine Learning

Automated Machine Learning: From Principles to Practices

Multimodality in meta-learning: A comprehensive survey

Multimedia Analysis with Deep Learning

Deep Learning for Multimedia: Science or Technology?

Multimedia Intelligence: when Multimedia Meets Artificial Intelligence

AutoML in The Wild: Obstacles, Workarounds, and Expectations

Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture

A Comprehensive Overview and Survey of Recent Advances in Meta-Learning

Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows

Out-of-distribution Generalization and Its Applications for Multimedia

Taking Human out of Learning Applications: A Survey on Automated Machine Learning.

AutoML for Deep Recommender Systems: Fundamentals and Advances.

AutoML: A survey of the state-of-the-art

AutoML from Software Engineering Perspective: Landscapes and Challenges

UniAutoML: A Human-Centered Framework for Unified Discriminative and Generative AutoML with Large Language Models

Curriculum Learning: Theories, Approaches, Applications, Tools, and Future Directions in the Era of Large Language Models

Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques

Learning in High-Dimensional Multimedia Data: the State of the Art

A General Recipe for Automated Machine Learning in Practice