Abstract:Despite the rapid advancement of object detection algorithms, processing high-resolution images on embedded devices remains a significant challenge. Theoretically, the fully convolutional network architecture used in current real-time object detectors can handle all input resolutions. However, the substantial computational demands required to process high-resolution images render them impractical for real-time applications. To address this issue, real-time object detection models typically downsample the input image for inference, leading to a loss of detail and decreased accuracy. In response, we developed Octave-YOLO, designed to process high-resolution images in real-time within the constraints of embedded systems. We achieved this through the introduction of the cross frequency partial network (CFPNet), which divides the input feature map into low-resolution, low-frequency, and high-resolution, high-frequency sections. This configuration enables complex operations such as convolution bottlenecks and self-attention to be conducted exclusively on low-resolution feature maps while simultaneously preserving the details in high-resolution maps. Notably, this approach not only dramatically reduces the computational demands of convolution tasks but also allows for the integration of attention modules, which are typically challenging to implement in real-time applications, with minimal additional cost. Additionally, we have incorporated depthwise separable convolution into the core building blocks and downsampling layers to further decrease latency. Experimental results have shown that Octave-YOLO matches the performance of YOLOv8 while significantly reducing computational demands. For example, in 1080x1080 resolution, Octave-YOLO-N is 1.56 times faster than YOLOv8, achieving nearly the same accuracy on the COCO dataset with approximately 40 percent fewer parameters and FLOPs.

Development of a Productive Transport Detection System Using Convolutional Neural Networks

RT-VENet: A Convolutional Network for Real-time Video Enhancement.

Differential Image-Based Scalable YOLOv7-Tiny Implementation for Clustered Embedded Systems

Development of Real-time ADAS Object Detector for Deployment on CPU

TOD: Transprecise Object Detection to Maximise Real-Time Accuracy on the Edge

Developing a Compressed Object Detection Model based on YOLOv4 for Deployment on Embedded GPU Platform of Autonomous System

A Deep Learning Framework Performance Evaluation to Use YOLO in Nvidia Jetson Platform

FPGA-Based Vehicle Detection and Tracking Accelerator

Effect of neural network structure in accelerating performance and accuracy of a convolutional neural network with GPU/TPU for image analytics

A Unified Optimization Approach for CNN Model Inference on Integrated GPUs

Understanding of Object Detection Based on CNN Family and YOLO

Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems

Parallelizing Convolutional Neural Networks On Intel (R) Many Integrated Core Architecture

Performance Analysis of GPU-Based Convolutional Neural Networks

YOLOv4: Optimal Speed and Accuracy of Object Detection

An Optimized DNN Model for Real-Time Inferencing on an Embedded Device

Latency and Throughput Characterization of Convolutional Neural Networks for Mobile Computer Vision

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

Lightweight convolutional neural network for real-time 3D object detection in road and railway environments

Octave-YOLO: Cross frequency detection network with octave convolution

Making You Only Look Once Faster: Toward Real-Time Intelligent Transportation Detection