Abstract:There has been an increased interest in the use of deep learning approaches for software analytics tasks. State-of-the-art techniques leverage modern deep learning techniques such as LSTMs, yielding competitive performance, albeit at the price of longer training times. Recently, Galke and Scherp [18] showed that at least for image recognition, a decades-old feedforward neural network can match the performance of modern deep learning techniques. This motivated us to try the same in the SE literature. Specifically, in this paper, we apply feedforward networks with some preprocessing to two analytics tasks: issue close time prediction, and vulnerability detection. We test the hypothesis laid by Galke and Scherp [18], that feedforward networks suffice for many analytics tasks (which we call, the "Old but Gold" hypothesis) for these two tasks. For three out of five datasets from these tasks, we achieve new high-water mark results (that out-perform the prior state-of-the-art results) and for a fourth data set, Old but Gold performed as well as the recent state of the art. Furthermore, the old but gold results were obtained orders of magnitude faster than prior work. For example, for issue close time, old but gold found good predictors in 90 seconds (as opposed to the newer methods, which took 6 hours to run). Our results supports the "Old but Gold" hypothesis and leads to the following recommendation: try simpler alternatives before more complex methods. At the very least, this will produce a baseline result against which researchers can compare some other, supposedly more sophisticated, approach. And in the best case, they will obtain useful results that are as good as anything else, in a small fraction of the effort. To support open science, all our scripts and data are available on-line at <a class="link-external link-https" href="https://github.com/fastidiouschipmunk/simple" rel="external noopener nofollow">this https URL</a>.

Applications of psychological science for actionable analytics

Can You Explain That, Better? Comprehensible Text Analytics for SE Applications

Common, uncommon, and novel applications of random forest in psychological research

Learning Effective Changes for Software Projects

Learning Actionable Analytics from Multiple Software Projects

Software Analytics As a Learning Case in Practice: Approaches and Experiences

Psychological AI: Designing Algorithms Informed by Human Psychology

Dive into Decision Trees and Forests: A Theoretical Demonstration

Performance Factors Analysis - A New Alternative to Knowledge Tracing

Decoding Human Behavior with Big Data? Critical, Constructive Input from the Decision Sciences

TuPAQ: An Efficient Planner for Large-scale Predictive Analytic Queries

Improving Decision Analytics with Deep Learning: The Case of Financial Disclosures

Old but Gold: Reconsidering the value of feedforward learners for software analytics

PsychFM: Predicting your next gamble

Fast, Optimal, and Targeted Predictions using Parametrized Decision Analysis

Deterministic parallel analysis: An improved method for selecting factors and principal components

Better Software Analytics via "DUO": Data Mining Algorithms Using/Used-by Optimizers

Application of the symbolic regression program AI-Feynman to psychology

Technical Analysis on Financial Forecasting

Supply of engineering techniques and software design patterns in psychoanalysis and psychometrics sciences

Time-varying Learning and Content Analytics via Sparse Factor Analysis