Deep learning, explained: Fundamentals, explainability, and bridgeability to process-based modelling

Saman Razavi
DOI: https://doi.org/10.1016/j.envsoft.2021.105159
2021-10-01
Abstract:Recent breakthroughs in artificial intelligence (AI), and particularly in deep learning (DL), have created tremendous excitement and opportunities in the earth and environmental sciences communities. To leverage these new 'data-driven' technologies, however, one needs to understand the fundamental concepts that give rise to DL and how they differ from 'process-based', mechanistic modelling. This paper revisits those fundamentals and addresses 10 questions often posed by earth and environmental scientists with the aid of a real-world modelling experiment. The overarching objective is to contribute to a future of AI-assisted earth and environmental sciences where DL models can (1) embrace the typically ignored knowledge base available, (2) function credibly in 'true' out-of-sample prediction, and (3) handle non-stationarity in earth and environmental systems. Comparing and contrasting earth and environmental problems with prominent AI applications, such as playing chess and trading in stock markets, provides critical insights for better directing future research in this field.Plain Language Summary.The recent unprecedented performance of deep learning (DL) in image and language processing has accelerated applications in non-native areas such as earth and environmental sciences where knowledge-driven, process-based modelling has dominated to date. A major challenge, however, is DL and process-based modelling are rooted in different worldviews towards problem solving. This paper explains the 'whats' and 'whys' of DL from first principles and how they are different from those of process-based modelling. A hydrologic modelling experiment is presented to illustrate the fundamental differences between the two worldviews, and to shed light on some critical, but often ignored, issues DL may face in practice. These issues largely arise from the fact that earth and environmental systems are complex, with behaviors that can change in ways that are physically explainable but not seen in the period of record, due to factors such as climate change and human interventions. Such issues must be addressed at the heart of the endeavor to extend DL techniques that embrace the knowledge base available, in anticipation of breakthroughs in an age of big data and computational power.
environmental sciences,engineering, environmental,water resources,computer science, interdisciplinary applications
What problem does this paper attempt to address?