Abstract:Deep learning and signal processing are closely correlated in many IoT scenarios such as anomaly detection to empower intelligence of things. Many IoT processors utilize digital signal processors (DSPs) for signal processing and build deep learning frameworks on this basis. While deep learning is usually much more computing-intensive than signal processing, the computing efficiency of deep learning on DSPs is limited due to the lack of native hardware support. In this case, we present a contrary strategy and propose to enable signal processing on top of a classical deep learning accelerator (DLA). With the observation that irregular data patterns such as butterfly operations in FFT are the major barrier that hinders the deployment of signal processing on DLAs, we propose a programmable data shuffling fabric and have it inserted between the input buffer and computing array of DLAs such that the irregular data is reorganized and the processing is converted to be regular. With the online data shuffling, the proposed architecture, SigDLA, can adapt to various signal processing tasks without affecting the deep learning processing. Moreover, we build a reconfigurable computing array to suit the various data width requirements of both signal processing and deep learning. According to our experiments, SigDLA achieves an average performance speedup of 4.4$\times$, 1.4$\times$, and 1.52$\times$, and average energy reduction of 4.82$\times$, 3.27$\times$, and 2.15$\times$ compared to an embedded ARM processor with customized DSP instructions, a DSP processor, and an independent DSP-DLA architecture respectively with 17% more chip area over the original DLAs.

Energy-efficient Pipelined DTW Architecture on Hybrid Embedded Platforms

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Accelerating Dynamic Time Warping with Memristor-Based Customized Fabrics.

TATA: Throughput-Aware TAsk Placement in Heterogeneous Stream Processing with Deep Reinforcement Learning

Accelerating subsequence similarity search based on dynamic time warping distance with FPGA.

DTW-Based Subsequence Similarity Search on AMD Heterogeneous Computing Platform

MDA: A Reconfigurable Memristor-Based Distance Accelerator for Time Series Mining on Data Centers.

DHS: Adaptive Memory Layout Organization of Sketch Slots for Fast and Accurate Data Stream Processing

Energy-efficient stream task scheduling scheme for embedded multimedia applications on multi-issued stream architectures.

Exploiting Stable Data Dependency in Stream Processing Acceleration on FPGAs

Estimating Similarity over Data Streams Based on Dynamic Time Warping

A Hierarchical Dataflow-Driven Heterogeneous Architecture for Wireless Baseband Processing

Hardware-Conscious Stream Processing

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

SHE: A Generic Framework for Data Stream Mining over Sliding Windows.

Accelerating Time Series Similarity Search under Move-Split-Merge Distance Via Dissimilarity Space Embedding

SigDLA: A Deep Learning Accelerator Extension for Signal Processing

Towards Ultra-High Performance and Energy Efficiency of Deep Learning Systems: An Algorithm-Hardware Co-Optimization Framework

Low Overhead Online Data Flow Tracking for Intermittently Powered Non-Volatile FPGAs

Intelligent computing for WPT–MEC-aided multi-source data stream

Edge-Stream: a Stream Processing Approach for Distributed Applications on a Hierarchical Edge-computing System