Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START)

Caitlin Condon,Philip Jensen,Patrick Royer,Harish Gadey,Mark Abkowitz,Robert Claypool,Steven Maheras,Matt Feldman

2023-06-16

Abstract:The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START.

Computers and Society,Adaptation and Self-Organizing Systems

What problem does this paper attempt to address?

The paper primarily discusses the Verification and Validation (V&V) process of the Stakeholder Tool for Assessing Radioactive Transportation (START). START is a web-based geospatial decision support tool used to evaluate various route options and other related matters for transporting nuclear waste (including Spent Nuclear Fuel, SNF, and High-Level Radioactive Waste, HLW) across the continental United States.

The goal of verification and validation is to independently assess the START tool to ensure it can accurately provide the expected results. Various methods were employed during the V&V process, ranging from independent manual calculations to comparisons with results from other codes. Specifically, the process focused on the transportation route attributes generated by START, including route distance and the total population and population density within the route buffer zone. These outputs are considered key parts of the START code and were included in the V&V tasks for examination.

Several areas for improvement were identified during the V&V process, such as standardizing the base population data in START, changing the projection method of population raster data, and improving the population density calculation method to enhance its applicability to the intended users. Additionally, improvements to some shapefile fragments within START were also suggested.

After a series of formal test route V&V processes, the buffer population and route distance in START version 3.2.1 showed good consistency with the independent assessment results. For over 200 test routes, the percentage difference in population within the buffer zone was less than ±5%, and in most cases, it was below ±1%. The differences in route distances also remained within a small range.

Currently, V&V activities are ongoing to further refine the START tool, such as evaluating population density and estimated radiation doses, and automating the V&V process to allow non-professional GIS users to more easily run larger-scale test routes. These improvements will make the V&V process a valuable tool for the development team and stakeholders to ensure that each new version of START can easily undergo quality and consistency checks.