Abstract:Context: The benefits of programmatic assessment are well-established. Evidence from multiple assessment formats is accumulated and triangulated to inform progression committee decisions. Committees are consistently challenged to ensure consistency and fairness in programmatic deliberations. Traditional statistical and psychometric techniques are not well-suited to aggregating different assessment formats accumulated over time. Some of the strengths of programmatic assessment are also vulnerabilities viewed through this lens. While emphasis is often placed on data richness and considered input of qualified experts, committees reasonably wish for practical, defensible solutions to these challenges. Methods: We draw upon on existing literature regarding Bayesian Networks (BN), noting their utility and application in educational systems. We provide illustrative examples of how they could potentially be used in contexts that embed programmatic principles. We show a simple BN for a knowledge domain before presenting a full-scale 'proof of concept' BN to support committee decisions. We zoom in on one 'node' to demonstrate the capacity of incorporating disparate evidence throughout the network. Conclusions: Bayesian Networks offer an approach that is theoretically well-supported for programmatic assessment. They can aid committees in managing evidence accumulation, help them make inferences under conditions of uncertainty, and buttress decisions by adding a layer of defensibility to the process. They are a pragmatic tool adding value to the programmatic space by applying a complementary statistical framework. We see four major benefits of BNs in programmatic assessment: BNs allow for visual capturing of evidentiary arguments by committees during decision-making; 'recommendations' from probabilistic pathways can be used by committees to confirm their qualitative judgments; BNs can ensure precedents are maintained and consistency occurs over time; and the imperative to capture data richness is maintained without resorting to questionable methodological strategies such as adding qualitatively different things together. Further research into their feasibility and robustness in practice is warranted.

Methods of Bayesian Networks for Situation Assessment

Application of Bayesian Networks in Tactical Situation Assessment

Research on Modeling Method of Language Knowledge of Brand Style on Bayesian Network

A Mixed Bayesian Network for Two-Dimensional Decision Modeling of Departure Time and Mode Choice

Network Situation Assessment Method Based on Improved BP Neural Network

Research on Anti-missile Situation Assessment

BN-Mapping:Visual Analysis of Geospatial Data with Bayesian Network

Using Bayesian Network to develop a probability assessment approach for construction safety risk

A Hybrid Approach for Identifying the Structure of a Bayesian Network Model

Development of An Improved Bayesian Network Method for Maritime Accident Safety Assessment Based on Multiscale Scenario Analysis Theory

Auto Diagnosing: An Intelligent Assessment System Based on Bayesian Networks

A Model of Network Security Situation Assessment Based on BPNN Optimized by SAA-SSA

Using Situation Lattices to Model and Reason about Context?

The potential use of Bayesian Networks to support committee decisions in programmatic assessment

Bayesian network modeling of accident investigation reports for aviation safety assessment

Using Bayesian Network to Develop an Approach for Construction Safety Risk Assessment

Network Security Situation Assessment Based on Attack Graph Techniques

Distributed Situation Assessment for Traffic Emergent Events

Environmental Assessment Model of Green Ecological Residential Buildings Based on Bayesian Network

Bayes Nets in Educational Assessment: Where Do the Numbers Come From?

A network security situation assessment model based on BP neural network optimized by D-S evidence theory