Abstract:Objective: This paper proposes a framework to support the scientific research
of standards so that they can be better measured, evaluated, and designed.
Methods: Beginning with the notion of common models, the framework describes
the general standard problem - the seeming impossibility of creating a
singular, persistent and definitive standard which is not subject to change
over time in an open system. Results: The standard problem arises from
uncertainty driven by variations in operating context, standard quality,
differences in implementation, and drift over time. As a result, fitting work
using conformance services is needed to repair these gaps between a standard
and what is required for real-world use. To guide standards design and repair,
a framework for measuring performance in context is suggested, based on signal
detection theory and technomarkers. Based on the type of common model in
operation, different conformance strategies are identified: (a) Universal
conformance (all agents access the same standard); (b) Mediated conformance (an
interoperability layer supports heterogeneous agents) and (c) Localized
conformance (autonomous adaptive agents manage their own needs). Conformance
methods include incremental design, modular design, adaptors, and creating
interactive and adaptive agents. Discussion: Machine learning should have a
major role in adaptive fitting. Research to guide the choice and design of
conformance services may focus on the stability and homogeneity of shared
tasks, and whether common models are shared ahead of time or adjusted at task
time. Conclusion: This analysis conceptually decouples interoperability and
standardization. While standards facilitate interoperability, interoperability
is achievable without standardization.
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is "The Standard Problem", that is, in an open system, it is almost impossible to create a single, persistent and well - defined standard, because these standards will be affected by changes over time, resulting in a gap between the standards and actual needs. Specifically, the paper explores the following aspects:
1. **Why do standards vary**: The paper analyzes the differences in standards over different times and spaces. These differences are mainly caused by changes in the operating environment, uncertainty in standard definitions, differences in standard quality, deviations in the implementation process, and the drift of standards over time.
2. **How to measure the performance of standards**: Given the variability of standards, research on standards requires measurement methods that can be quantitatively compared. The paper proposes that signal detection theory and technomarkers can be used to evaluate the effectiveness of standards in a specific context.
3. **How to adjust standards to manage unnecessary variation**: The paper discusses "fitting work", that is, in order to reduce the gap between standards and practice, methods that may require adjustments to the standards, their implementation, or the target tasks. This includes task adaptation, implementation adaptation, standard adaptation, and interoperability adaptation.
4. **How to handle the co - existence of multiple standards**: When multiple standards exist simultaneously, how to effectively convert between them to support the completion of collaborative tasks. The paper proposes three different conformance service models: Universal Conformance, Mediated Conformance, and Localized Conformance.
5. **Are there other ways to conceptualize the standard problem**: The paper also explores re - examining the relationship between interoperability and standardization, considering whether different technical design and usage methods can be explored by separating these two concepts.
Through research in these aspects, the paper aims to provide a framework for standard research, so as to better measure, evaluate, and design standards, and ultimately improve the effectiveness and adaptability of standards in practical applications.