Abstract:Software testing has received much attention over the last years and has reached such critical importance that agile software development practices put software testing at its core. Agile software development is successfully applied in large-scale industrial software developments but due to its granular responsibilities with roles assigned to various members of the development team, these practices may not be applicable to scientific code development, especially in an academic environment, where it is not uncommon that the codebase is developed, maintained and used by a single person. Even for collaborative scientific software development, financed through external grants, the end-users are typically still part of the development team. This is in contrast to how software is developed in many industries, where the development team and end-users are two separate entities. There are, however, many good code development practices that can be adopted for scientific software projects. Specifically, the intention of this article is to take the centrepiece of agile software development and tailor it to scientific and academic, single-user code development. In this study, a c++ starter project is developed and made available, based on the meson build system, which provides native support for software testing. It is used to show how a simple linear algebra application, found in many scientific and academic applications, can be developed and how simple unit, integration and system tests can be created that are managed through the meson build system. In this way, we are able to minimise software defects and reduce the risk to interpret incorrect data generated by erroneous software that may result in the wrong conclusions to be drawn. Each layer of testing presents one additional layer of protection and we will explore how these may be incorporated with minimum overhead to produce bug-free software.

Testing Modules for Experiments in Stellar Astrophysics (MESA)

Modules for Experiments in Stellar Astrophysics (MESA): Time-dependent Convection, Energy Conservation, Automatic Differentiation, and Infrastructure

Modules for Experiments in Stellar Astrophysics (MESA): Convective Boundaries, Element Diffusion, and Massive Star Explosions

MESA-Web: A cloud resource for stellar evolution in astronomy curricula

Experiences with Automated Build and Test for Geodynamics Simulation Codes

Simulations of Dense Stellar Systems with the AMUSE Software Toolkit

The Software Package for Astronomical Reductions with KMOS: SPARK

Overview and Validation of the Asteroseismic Modeling Portal v2.0

A ground automatic testing system for the BGO calorimeter of dark matter particle explorer satellite

Promoting open science in test-driven software experiments

An asynchronous object-oriented approach to the automation of the 0.8-meter George Mason University campus telescope in Python

The Astronomy Commons Platform: A Deployable Cloud-Based Analysis Platform for Astronomy

Control and systems software for the Cosmology Large Angular Scale Surveyor (CLASS)

A practical guide towards agile test-driven development for scientific software projects

The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations

Continuous Integration for Concurrent Computational Framework and Application Development

MAUS: the MICE analysis user software

E-TEST prototype design report

Testing Mars 2020 Flight Software and Hardware in the Surface System Development Environment

OffLine simulation and reconstruction software framework for the JEM-EUSO missions

Simulation of Stellar Image Observation and Unit Testing on Small Focal Panel System of LAMOST