Abstract:Neural networks are important computational models used in the domains of artificial intelligence and software engineering. Parameters of a neural network are obtained via training it against a specific dataset with a standard process, which guarantees each sample within that set is mapped to the correct class. In general, for a trained neural network, there is no warranty of high-level properties, such as fairness, robustness, etc. In this case, one need to tune the parameters in an alternative manner, and it is called repairing. In this paper, we present AutoRIC (Automated Repair wIth Constraints), an analytical-approach-based white-box repairing framework against general properties that could be quantitatively measured. Our approach is mainly based on constrained optimization, namely, we treat the properties of neural network as the optimized objective described by a quadratic formula about the faulty parameters. To ensure the classification accuracy of the repaired neural network, we impose linear inequality constraints to the inputs that obtain incorrect outputs from the neural network. In general, this may generate a huge amount of constraints, resulting in the prohibitively high cost in the problem solving, or even making the problem unable to be solved by the constraint solver. To circumvent this, we present a selection strategy to diminish the restrictions, i.e., we always select the most ‘strict’ ones into the constraint set each time. Experimental results show that repairing with constraints performs efficiently and effectively. AutoRIC tends to achieve a satisfactory repairing result whereas brings in a negligible accuracy drop. AutoRIC enjoys a notable time advantage and this advantage becomes increasingly evident as the network complexity rises. Moreover, experiment results also demonstrate that repairing based on unconstrained optimizations are not stable, which embodies the necessity of constraints.

A Robust Optimisation Perspective on Counterexample-Guided Repair of Neural Networks

Interpretability Based Neural Network Repair

VeRe: Verification Guided Synthesis for Repairing Deep Neural Networks.

Towards Robust Neural Networks: Exploring Counterfactual Causality-Based Repair

Counterexample-Guided Repair of Reinforcement Learning Systems Using Safety Critics

SpecRepair: Counter-Example Guided Safety Repair of Deep Neural Networks

Towards Repairing Neural Networks Correctly

Causality-based Neural Network Repair

ADVREPAIR:Provable Repair of Adversarial Attack

Provably Robust and Plausible Counterfactual Explanations for Neural Networks via Robust Optimisation

Neural Network Repair with Reachability Analysis

Sound and Complete Neural Network Repair with Minimality and Locality Guarantees

Neural Program Repair with Execution-based Backpropagation

Automated Repair of AI Code with Large Language Models and Formal Verification

AutoRIC: Automated Neural Network Repairing Based on Constrained Optimization

Architecture-Preserving Provable Repair of Deep Neural Networks

Where to Look When Repairing Code? Comparing the Attention of Neural Models and Developers

Neural Control and Certificate Repair via Runtime Monitoring

Repairing Neural Networks by Leaving the Right Past Behind

Robust Counterfactual Explanations for Neural Networks With Probabilistic Guarantees

Quantitative Verification with Neural Networks