Abstract:Deep learning has gained tremendous traction from the developer and researcher communities. It plays an increasingly significant role in a number of application domains. Deep learning frameworks are proposed to help developers and researchers easily leverage deep learning technologies, and they attract a great number of discussions on popular platforms, i.e., Stack Overflow and GitHub. To understand and compare the insights from these two platforms, we mine the topics of interests from these two platforms. Specifically, we apply Latent Dirichlet Allocation (LDA) topic modeling techniques to derive the discussion topics related to three popular deep learning frameworks, namely, Tensorflow, PyTorch and Theano. Within each platform, we compare the topics across the three deep learning frameworks. Moreover, we make a comparison of topics between the two platforms. Our observations include 1) a wide range of topics that are discussed about the three deep learning frameworks on both platforms, and the most popular workflow stages are Model Training and Preliminary Preparation. 2) the topic distributions at the workflow level and topic category level on Tensorflow and PyTorch are always similar while the topic distribution pattern on Theano is quite different. In addition, the topic trends at the workflow level and topic category level of the three deep learning frameworks are quite different. 3) the topics at the workflow level show different trends across the two platforms. e.g., the trend of the Preliminary Preparation stage topic on Stack Overflow comes to be relatively stable after 2016, while the trend of it on GitHub shows a stronger upward trend after 2016. Besides, the Model Training stage topic still achieves the highest impact scores across two platforms. Based on the findings, we also discuss implications for practitioners and researchers.

Deep Learning Framework Testing Via Hierarchical and Heuristic Model Generation.

Toward Understanding Deep Learning Framework Bugs

Audee: Automated Testing for Deep Learning Frameworks

Mutation-Based Deep Learning Framework Testing Method in JavaScript Environment

DevMuT: Testing Deep Learning Framework Via Developer Expertise-Based Mutation

Deep Learning Framework Fuzzing Based on Model Mutation

DeepCov: Coverage Guided Deep Learning Framework Fuzzing

Generative Model-Based Test Case Generation and Operational Testing for Deep Learning

Validating a Deep Learning Framework by Metamorphic Testing

DeepMutation: Mutation Testing of Deep Learning Systems

LLM-BRC: A large language model-based bug report classification framework

Graph-based Fuzz Testing for Deep Learning Inference Engines

Graph-Based Fuzz Testing for Deep Learning Inference Engine

RGChaser: A RL-guided Fuzz and Mutation Testing Framework for Deep Learning Systems

What Do Programmers Discuss about Deep Learning Frameworks

NeuRI: Diversifying DNN Generation via Inductive Rule Inference

NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers

An Adaptive Placement and Parallelism Framework for Accelerating RLHF Training

CITADEL: Context Similarity Based Deep Learning Framework Bug Finding

Coverage-guided fuzzing for deep reinforcement learning systems

Fuzzing Deep Learning Compilers with HirGen