Abstract:Resource-efficient Convolutional Neural Networks (CNNs) are gaining more attention. These CNNs have relatively low computational and memory requirements. A common denominator among such CNNs is having more heterogeneity than traditional CNNs. This heterogeneity is present at two levels: intra-layer type and inter-layer type. Generic accelerators do not capture these levels of heterogeneity, which harms their efficiency. Consequently, researchers have proposed model-specific accelerators with dedicated engines. When designing an accelerator with dedicated engines, one option is to dedicate one engine per CNN layer. We refer to accelerators designed with this approach as single-engine single-layer (SESL). This approach enables optimizing each engine for its specific layer. However, such accelerators are resource-demanding and unscalable. Another option is to design a minimal number of dedicated engines such that each engine handles all layers of one type. We refer to these accelerators as single-engine multiple-layer (SEML). SEML accelerators capture the inter-layer-type but not the intra-layer-type heterogeneity. We propose the Fixed Budget Hybrid CNN Accelerator (FiBHA), a hybrid accelerator composed of an SESL part and an SEML part, each processing a subset of CNN layers. FiBHA captures more heterogeneity than SEML while being more resource-aware and scalable than SESL. Moreover, we propose a novel module, Fused Inverted Residual Bottleneck (FIRB), a fine-grained and memory-light SESL architecture building block. The proposed architecture is implemented and evaluated using high-level synthesis (HLS) on different Field Programmable Gate Arrays representing various resource budgets. Our evaluation shows that FiBHA improves the throughput by up to 4 x and 2.5 x compared to state-of-the-art SESL and SEML accelerators, respectively. Moreover, FiBHA reduces memory and energy consumption compared to an SEML accelerator. The evaluation also shows that FIRB reduces the required memory by up to 54%, and energy requirements by up to 35% compared to traditional pipelining.

FuSeBMC AI: Acceleration of Hybrid Approach through Machine Learning

MAB-BMC: A Formal Verification Enhancer by Harnessing Multiple BMC Engines Together

Automating Shift-Scheduling Calibration by Using Bionic Optimization and Personalized Driver Models

Scaling up statistical model checking of cyber-physical systems via algorithm ensemble and parallel simulations over HPC infrastructures

An Open-Source ML-Based Full-Stack Optimization Framework for Machine Learning Accelerators

Hybrid CNN-SVM Inference Accelerator on FPGA Using HLS

Enhancing Functional Safety in Automotive AMS Circuits through Unsupervised Machine Learning

Chimera: A Hybrid Machine Learning Driven Multi-Objective Design Space Exploration Tool for FPGA High-Level Synthesis

A hybrid‐ensemble model for software defect prediction for balanced and imbalanced datasets using AI‐based techniques with feature preservation: SMERKP‐XGB

A dynamic parallel method for performance optimization on hybrid CPUs

Machine Learning Steered Symbolic Execution Framework for Complex Software Code

An Efficient Hybrid Deep Learning Accelerator for Compact and Heterogeneous CNNs

Towards the Certification of Hybrid Architectures: Analysing Interference on Hardware Accelerators through PML

Seismic response prediction of FRC rectangular columns using intelligent fuzzy-based hybrid metaheuristic techniques

Hybrid enhanced Monte Carlo simulation coupled with advanced machine learning approach for accurate and efficient structural reliability analysis

Integrating Machine Learning for Predicting Internal Combustion Engine Performance and Segment-Based CO2 Emissions Across Urban and Rural Settings

A2: Towards Accelerator Level Parallelism for Autonomous Micromobility Systems

Deep Learning-Based Hybrid Fuzz Testing

Hybrid disease prediction approach leveraging digital twin and metaverse technologies for health consumer

Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components