Abstract:The astounding development of optical sensing imaging technology, coupled with the impressive improvements in machine learning algorithms, has increased our ability to understand and extract information from scenic events. In most cases, Convolution neural networks (CNNs) are largely adopted to infer knowledge due to their surprising success in automation, surveillance, and many other application domains. However, the convolution operations' overwhelming computation demand has somewhat limited their use in remote sensing edge devices. In these platforms, real-time processing remains a challenging task due to the tight constraints on resources and power. Here, the transfer and processing of non-relevant image pixels act as a bottleneck on the entire system. It is possible to overcome this bottleneck by exploiting the high bandwidth available at the sensor interface by designing a CNN inference architecture near the sensor. This paper presents an attention-based pixel processing architecture to facilitate the CNN inference near the image sensor. We propose an efficient computation method to reduce the dynamic power by decreasing the overall computation of the convolution operations. The proposed method reduces redundancies by using a hierarchical optimization approach. The approach minimizes power consumption for convolution operations by exploiting the Spatio-temporal redundancies found in the incoming feature maps and performs computations only on selected regions based on their relevance score. The proposed design addresses problems related to the mapping of computations onto an array of processing elements (PEs) and introduces a suitable network structure for communication. The PEs are highly optimized to provide low latency and power for CNN applications. While designing the model, we exploit the concepts of biological vision systems to reduce computation and energy. We prototype the model in a Virtex UltraScale+ FPGA and implement it in Application Specific Integrated Circuit (ASIC) using the TSMC 90nm technology library. The results suggest that the proposed architecture significantly reduces dynamic power consumption and achieves high-speed up surpassing existing embedded processors' computational capabilities.

Enhanced Convolutional Neural Network for Image Processing in 6G Smart City Environments

6G Traffic Prediction with a Novel Parallel Convolutional Neural Networks Architecture and Matrix Format Method Integration

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Optimizing the Learning Accuracy in Mobile Augmented Reality Systems with CNN

Exploiting Sparsity to Accelerate Fully Connected Layers of CNN-Based Applications on Mobile SoCs

A Visual Cortex-Attentive Deep Convolutional Neural Network for Digital Image Design

Beyond REM: A New Approach to the Use of Image Classifiers for the Management of 6G Networks

Towards an Efficient CNN Inference Architecture Enabling In-Sensor Processing

An Efficient and Lightweight Convolutional Neural Network for Remote Sensing Image Scene Classification

CS-CNN: Enabling Robust and Efficient Convolutional Neural Networks Inference for Internet-of-Things Applications

Visual E 2 C: AI-Driven Visual End-Edge-Cloud Architecture for 6G in Low-Carbon Smart Cities

Optimizing network slicing in 6G networks through a hybrid deep learning strategy

Neural Architecture Search for Robust Networks in 6G-Enabled Massive IoT Domain

Rotating Kernel CNN Optimization for Efficient IoT Surveillance on Low-Power Devices

Citywide Traffic Flow Prediction Based on Multiple Gated Spatio-temporal Convolutional Neural Networks

Revisiting Convolutional Neural Networks for Citywide Crowd Flow Analytics

A multi-task convolutional neural network for mega-city analysis using very high resolution satellite imagery and geospatial data

CSINet: A Cross-Scale Interaction Network for Lightweight Image Super-Resolution

Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

Medical Image Classifications for 6G IoT-Enabled Smart Health Systems

A New Approach to Compute CNNs for Extremely Large Images