A Layered Meta-Data Approach to the Design of Joint Experimentation Data Warehouse

Lì Jiāng,Maria Boyle,Kevin Johns,Chitra Subramanian,Sanat Kumar Bista
DOI: https://doi.org/10.36334/modsim.2021.m8.jiang
2021-01-01
Abstract:Force design activities such as Force Structure Planning (FSP), wargaming and experimentation generate large amounts of data in different formats.Current in-house data management systems are limited in their ability to store and manage data efficiently.The development of a Joint Analytics and Reporting System (JARS) as a data warehouse for experimentation activities will provide the necessary infrastructure to support data storage, management and retrieval.Availability of quality, fit-forpurpose data via JARS will also enable the use of advanced analytics techniques to support evidencebased decision-making.Using historical experimentation data to support the planning of future activities is challenging as data sources, formats and data quality are often variable.In this paper, we propose JARS as a practical solution and present a layered metadata model approach based on our research and analysis of the historical data.As part of this endeavour, we conducted requirements discovery workshops to assist in the design of JARS.The JARS schema was developed based on database theory, metadata design principles, and best industry practices such as the FAIR principles (Findability, Accessibility, Interoperability, and Reusability of digital assets).Furthermore, we considered the tradeoffs between the principles of database design, data integrity, data processing complexity, and completeness and efficiency of querying.The metadata model contains three-layers of information: Campaign layer, Activity layer, and Extensible layer.The Campaign layer contains Campaign name, Campaign objectives, and so forth.The Activity Layer contains metadata information such as Name, Status, Location and Scenario used.The Extensible Layer contains more information and data required for finding nuanced information.This layered structure provides a flexible and effective way to store and query various metadata information as required.It can also assist in achieving a balance between information integrity and data complexity, and between completeness of information and efficiency of data retrieval.The latter is often a challenge in database design.This paper aims to present the results of our past research and ongoing work.The significance of JARS and the future work are also discussed.
What problem does this paper attempt to address?