Abstract:Credibility building activities in computational research include verification and validation, reproducibility and replication, and uncertainty quantification. Though orthogonal to each other, they are related. This paper presents validation and replication studies in electromagnetic excitations on nanoscale structures, where the quantity of interest is the wavelength at which resonance peaks occur. The study uses the open-source software PyGBe : a boundary element solver with treecode acceleration and GPU capability. We replicate a result by Rockstuhl et al. (2005, doi:10/dsxw9d) with a two-dimensional boundary element method on silicon carbide (SiC) particles, despite differences in our method. The second replication case from Ellis et al. (2016, doi:10/f83zcb) looks at aspect ratio effects on high-order modes of localized surface phonon-polariton nanostructures. The results partially replicate: the wavenumber position of some modes match, but for other modes they differ. With virtually no information about the original simulations, explaining the discrepancies is not possible. A comparison with experiments that measured polarized reflectance of SiC nano pillars provides a validation case. The wavenumber of the dominant mode and two more do match, but differences remain in other minor modes. Results in this paper were produced with strict reproducibility practices, and we share reproducibility packages for all, including input files, execution scripts, secondary data, post-processing code and plotting scripts, and the figures (deposited in Zenodo). In view of the many challenges faced, we propose that reproducible practices make replication and validation more feasible. This article is part of the theme issue ‘Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico ’.

Digging through the (statistical) dirt: A reproducible method for single-molecule flicker noise analysis

New Insights into the Physics-Based Statistical Compact Modeling of Flicker Noise in Advanced FinFET Technology

The Evolution of the Charge Transport Mechanism in Single‐Molecule Break Junctions Revealed by Flicker Noise Analysis

Methods in fluctuation (noise) spectroscopy and continuous analysis for high-throughput measurements

Delta-T Flicker Noise Demonstrated with Molecular Junctions

Quantifying noise effects in optical measures of excited state transport

Origin and Mechanism Analysis of Asymmetric Current Fluctuations in Single-Molecule Junctions

Making Every Photon Count: A Quantum Polyspectra Approach to the Dynamics of Blinking Quantum Emitters at Low Photon Rates Without Binning

A Python toolbox for unbiased statistical analysis of fluorescence intermittency of multi-level emitters

Comprehensive Understanding of Flicker Noise in Advanced FinFET Technology: from Noise Sources Separation to Physical-based Modeling

Physics-based Compact Modeling of Statistical Flicker Noise in FinFET Technology

Analytical tools for single-molecule fluorescence imaging in cellulo

On the statistical foundation of a recent single molecule FRET benchmark

Statistical approaches for probing single-molecule dynamics photon-by-photon

Crackling noise microscopy

Stochasticity in single-molecule nanoelectrochemistry: origins, consequences, and solutions

Generalized Noise Study of Solid-State Nanopores at Low Frequencies.

Statistical Molecule Counting in Super-Resolution Fluorescence Microscopy: Towards Quantitative Nanoscopy

Reproducible validation and replication studies in nanoscale physics

Reliability and accuracy of single-molecule FRET studies for characterization of structural dynamics and distances in proteins

Quantitative comparison of single-cell RNA sequencing versus single-molecule RNA imaging for quantifying transcriptional noise