Abstract:Deploying image target detection algorithms on embedded devices is critical. Previous studies assumed that fewer model parameters and computations improved the inference speed. However, many models with few parameters and computations have slow inference speeds. Therefore, developing a remote sensing image target detection model that can perform real-time inference on embedded devices is required. We propose a fast target detection model for remote sensing images leveraging roofline analysis on edge computing devices (FTD-RLE). It comprises three parts: (1) We analyze the hardware characteristics of embedded devices using RoofLine and incorporate global features to design a model structure based on the operational intensity (OI) and arithmetic intensity (AI) of embedded devices. (2) The mirror ring convolution (MRC) is designed for extracting global features. The global information-aware module (GIAM) extracts local features from key areas using the global feature guidance model. The global-local feature pyramid module (GLFPM) is proposed to combine global and local features. (3) Additionally, hardware deployment and inference acceleration technologies are implemented to enable the model's deployment on edge devices. TensorRT and quantization methods are used to ensure fast inference speed. The proposed algorithm achieves an average detection accuracy of 92.3% on the VHR-10 dataset and 95.2% on the RSOD dataset. It has 1.26 M model parameters, and the inference time for processing one image on Jetson Orin Nx is 8.43ms, which is 1.90 ms and 1.98 ms faster than the mainstream lightweight algorithms ShufflenetV2 and GhostNet, respectively.

Real-Time Target Detection Technology of Large View-Field Infrared Image Based on Multicore Dsp Parallel Processing

Infrared Small Target Tracking Based on Sopc

Fast and Sub-Pixel Precision Target Tracking Algorithm for Intelligent Dual-Resolution Camera.

Real-time target detection in hyperspectral images based on spatial-spectral information extraction

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

An FPGA-based real-time infrared target detection system with visual image positioning

Real-time Motion Detection with High-speed Vision and Local Parallel Processing

Simd Massively Parallel Processing System For Real-Time Image Processing

FPGA implementation of collaborative representation algorithm for real-time hyperspectral target detection

A FPGA Based High-Speed Binocular Active Vision System for Tracking Circle-Shaped Target

A Real-Time Tree Crown Detection Approach for Large-Scale Remote Sensing Images on FPGAs

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype

Infrared Real-time Imaging System Based on DSP

A Fast Target Detection Model for Remote Sensing Images Leveraging Roofline Analysis on Edge Computing Devices

Fast Infrared Small Target Detection by Using Hadamard Product for Spatial-Temporal Matrices

Edge Real-Time Object Detection and DPU-Based Hardware Implementation for Optical Remote Sensing Images

Lightweight and Real-Time Infrared Image Processor Based on FPGA

Real time imaging processing of ground-based SAR based on multicore DSP

On-Board, Real-Time Preprocessing System for Optical Remote-Sensing Imagery

FPGA-based Acceleration System for Visual Tracking

A High Performance Parallel Computing Architecture For Robust Image Features