Abstract:The low-power computer vision (LPCV) challenge is an annual competition for the best technologies in image classification and object detection measured by both efficiency (execution time and energy consumption) and accuracy (precision/recall). Our Amazon team has won three awards from LPCV challenges: 1st prize for interactive object detection challenge in 2018 and 2019 and 2nd prize for interactive image classification challenge in 2018. This paper is to share our award-winning methods, which can be summarized as four major steps. First, 8-bit quantization friendly model is one of the key winning points to achieve the short execution time while maintaining the high accuracy on edge devices. Second, network architecture optimization is another winning keypoint. We optimized the network architecture to meet the 100ms latency requirement on Pixel2 phone. The third one is dataset filtering. We removed the images with small objects from the training dataset after deeply analyzing the training curves, which significantly improved the overall accuracy. And the forth one is non-maximum suppression optimization. By combining all the above steps together with the other training techniques, for example, cosine learning function and transfer learning, our final solutions were able to win the top prizes out of large number of submitted solutions across worldwide. Take-aways: Discusses the methods involved in the winning solutions over the years. Explains the impacts of each method (quantization, architecture search, hyperparameter tuning) Reduces the resolutions to improve performance Discusses the methods involved in the winning solutions over the years. Explains the impacts of each method (quantization, architecture search, hyperparameter tuning) Reduces the resolutions to improve performance The low-power computer vision (LPCV) challenge is an annual competition for the best technologies in image classification and object detection measured by both efficiency and accuracy. Competitions encourage diligent development of technologies. The goal of Low-Power Image Recognition Challenge (LPIRC) is to achieve the best accuracy within the wall-time constraint by evaluating the accuracy and the execution time using TensorFlow models. Although no power or energy constraint is explicitly measured for this track, latency correlates reasonably with energy consumption. After diligent hard-work, our Amazon team won the two awards out of all submitted solutions at 2018: the first place for interactive object detection challenge and the second place for interactive image classification challenge. Quantization is crucial for deep learning inference on edge devices, which have very limited budget for power and memory consumption. The fastest way to improve the latency of a deep learning network is to reduce the input image resolution.

The 2020 Low-Power Computer Vision Challenge

Low-Power Computer Vision: Status, Challenges, and Opportunities.

Low-Power Computer Vision: Status, Challenges, Opportunities

2023 Low-Power Computer Vision Challenge (LPCVC) Summary

2018 Low-Power Image Recognition Challenge

Survey on Energy-Efficient Deep Neural Networks for Computer Vision

Guided Design for Efficient On-device Object Detection Model

Optical Convolution Based Computational Method for Low-Power Image Processing

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

A Survey of Computer Vision Detection, Visual SLAM Algorithms, and Their Applications in Energy-Efficient Autonomous Systems

Real-time Object Detection Towards High Power Efficiency.

Rebooting Computing and Low-Power Image Recognition Challenge

Power Efficient Video Super-Resolution on Mobile NPUs with Deep Learning, Mobile AI & AIM 2022 challenge: Report

Computation-efficient Deep Learning for Computer Vision: A Survey

Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision

AI City Challenge 2020 – Computer Vision for Smart Transportation Applications

Survey on Computer Vision Techniques for Internet-of-Things Devices

The Challenges and Emerging Technologies for Low-Power Artificial Intelligence IoT Systems

Energy-Efficient & Real-Time Computer Vision with Intelligent Skipping via Reconfigurable CMOS Image Sensors

Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices

Toward Intelligent Visual Sensing and Low-cost Analysis: A Collaborative Computing Approach