Abstract:Modern Mixed-Criticality Systems (MCSs) rely on hardware heterogeneity to satisfy ever-increasing computational demands. However, most of the heterogeneous co-processors are designed to achieve high throughput, with their micro-architectures executing the workloads in a streaming manner. This streaming execution is often non-preemptive or limited-preemptive, preventing tasks' prioritisation based on their importance and resulting in frequent occurrences of algorithmic priority and/or criticality inversions. Such problems present a significant barrier to guaranteeing the systems' real-time predictability, especially when co-processors dominate the execution of the workloads (e.g., DNNs and transformers). In contrast to existing works that typically enable coarse-grained context switch by splitting the workloads/algorithms, we demonstrate a method that provides fine-grained context switch on a widely used open-source DNN accelerator by enabling instruction-level preemption without any workloads/algorithms modifications. As a systematic solution, we build a real system, i.e., Make Each Switch Count (MESC), from the SoC and ISA to the OS kernel. A theoretical model and analysis are also provided for timing guarantees. Experimental results reveal that, compared to conventional MCSs using non-preemptive DNN accelerators, MESC achieved a 250x and 300x speedup in resolving algorithmic priority and criticality inversions, with less than 5\% overhead. To our knowledge, this is the first work investigating algorithmic priority and criticality inversions for MCSs at the instruction level.

A Management Model for Peripherals of Priority Inversion Inhibition

Analysis Of One Fast Networked Control System For Parallel Operation Of Inverters

Modeling and Analysis of Switching Frequency Circulating Currents in Parallel Inverter Systems

A Data Processor To Enhance Robustness Of Networked Control System For Parallel-Connected Inverters

Statistical performance analysis of strict priority and generalised processor sharing two-stage scheduling system under exponentially bounded burstiness input model

A model for the integration of buffer management and packet scheduling

Design and Implementation of Improved Priority Ceiling Protocol

On Removing Algorithmic Priority Inversion from Mission-critical Machine Inference Pipelines

A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

Improvement on Μc/os-Ii Real-time System Task Scheduling

Work-in-Progress: A Flattened Priority Framework for Mixed-Criticality Real-Time Systems

Modeling and Performance Analysis of Statistical Priority-based Multiple Access Protocol

A Flattened-Priority Framework for Mixed-Criticality Systems

Modeling and Analyzing the Performance of High-Speed Packet I/O

TS-Preemption Threshold and Priority Optimization for the Process Scheduling in Integrated Modular Avionics.

Dynamic Markov-based Queuing Models and Strategies with Heterogeneous Processing Capabilities to Optimize Machine Utilization

Buffer Management Algorithm Oriented to Length-Varied Packets with Dynamic Thresholds for Multiple Priorities

Towards Power Efficient High Performance Packet I/O

Modeling and parameter optimization of statistical priority-based multiple access protocol

MESC: Re-thinking Algorithmic Priority and/or Criticality Inversions for Heterogeneous MCSs

A Priority-Based Processor Sharing Model for TDM Passive Optical Networks