Abstract:This paper presents Mathematical Execution (ME), a new, unified approach for testing numerical code. The key idea is to (1) capture the desired testing objective via a representing function and (2) transform the automated testing problem to the minimization problem of the representing function. The minimization problem is to be solved via mathematical optimization. The main feature of ME is that it directs input space exploration by only executing the representing function, thus avoiding static or symbolic reasoning about the program semantics, which is particularly challenging for numerical code. To illustrate this feature, we develop an ME-based algorithm for coverage-based testing of numerical code. We also show the potential of applying and adapting ME to other related problems, including path reachability testing, boundary value analysis, and satisfiability checking. To demonstrate ME's practical benefits, we have implemented CoverMe, a proof-of-concept realization for branch coverage based testing, and evaluated it on Sun's C math library (used in, for example, Android, Matlab, Java and JavaScript). We have compared CoverMe with random testing and Austin, a publicly available branch coverage based testing tool that supports numerical code (Austin combines symbolic execution and search-based heuristics). Our experimental results show that CoverMe achieves near-optimal and substantially higher coverage ratios than random testing on all tested programs, across all evaluated coverage metrics. Compared with Austin, CoverMe improves branch coverage from 43% to 91%, with significantly less time (6.9 vs. 6058.4 seconds on average).

OMEI: An Open Mathematical Engine Interface

Object Oriented Finite Element Method and Its Application in C++

LOCAL AND REMOTE USER INTERFACE FOR ELIMINO THROUGH OMEI

Integrated Engineering Development Environment

Improvement and Implementation of ODMG Object Manipulating Language

The Internet Accessible Mathematical Computation Framework

Structured Open-Equation Modeling on the Large-Scale Process System

OMP-Engineer: Bridging Syntax Analysis and In-Context Learning for Efficient Automated OpenMP Parallelization

The Object Management System

Open Equation Modeling for Process Systems Based on Object-oriented Method

Real-time Optimization Method MEO Based on Mnemonic Enhancement

Interoperability in the OpenDreamKit Project: The Math-in-the-Middle Approach

User interfaces for computational science: a domain specific language for OOMMF embedded in Python

IAMC architecture and prototyping: a progress report

MOF: A Modular Framework for Rapid Application of Optimization Methodologies to General Engineering Design Problems

Enhancing conceptual models with computational capabilities: A methodical approach to executable integrative modeling

Object-oriented Analysis of ELIMINO

Openeuler: Advancing a Hardware and Software Application Ecosystem

Mathematical Execution: A Unified Approach for Testing Numerical Code

Language-Driven Engineering An Interdisciplinary Software Development Paradigm

Design and Implementation of Object-Oriented 3D Graphics Engine