Abstract:Incremental and parallel builds are crucial features of modern build systems. Parallelism enables fast builds by running independent tasks simultaneously, while incrementality saves time and computing resources by processing the build operations that were affected by a particular code change. Writing build definitions that lead to error-free incremental and parallel builds is a challenging task. This is mainly because developers are often unable to predict the effects of build operations on the file system and how different build operations interact with each other. Faulty build scripts may seriously degrade the reliability of automated builds, as they cause build failures, and non-deterministic and incorrect build results. To reason about arbitrary build executions, we present buildfs, a generally-applicable model that takes into account the specification (as declared in build scripts) and the actual behavior (low-level file system operation) of build operations. We then formally define different types of faults related to incremental and parallel builds in terms of the conditions under which a file system operation violates the specification of a build operation. Our testing approach, which relies on the proposed model, analyzes the execution of single full build, translates it into buildfs, and uncovers faults by checking for corresponding violations. We evaluate the effectiveness, efficiency, and applicability of our approach by examining hundreds of Make and Gradle projects. Notably, our method is the first to handle Java-oriented build systems. The results indicate that our approach is (1) able to uncover several important issues (245 issues found in 45 open-source projects have been confirmed and fixed by the upstream developers), and (2) orders of magnitude faster than a state-of-the-art tool for Make builds.

A Quantitative Study of Java Software Buildability

Local Software Buildability across Java Versions (Registered Report)

An Empirical Study of Bugs in Build Process

Why is My Code Change Abandoned?

An Empirical Study of Bugs in Software Build System

Identifying Bugs in Make and JVM-Oriented Builds

Understanding Build Issue Resolution in Practice: Symptoms and Fix Patterns

The Java Build Framework: Large Scale Compilation

A large-scale empirical study of compiler errors in continuous integration.

Accelerating Build Dependency Error Detection Via Virtual Build.

A Model of the Commit Size Distribution of Open Source

State‐of‐the‐practice in quality assurance in Java‐based open source software development

State-Of-The-Practice in Quality Assurance in Java-Based Open Source Software Development

Extracting Build Changes with BUILDDIFF

An Empirical Investigation into a Large-Scale Java Open Source Code Repository

An Empirical Study of Developer Quality

JSS Special Issue Program Debugging and Repair.

Empirical study of software quality evolution in open source projects using agile practices

An Empirical Analysis of Software Changes on Statement Entity in Java Open Source Projects

An Empirical Study of Build Failures in the Docker Context

Reproducibility of Build Environments through Space and Time