EcoSense: Energy-Efficient Intelligent Sensing for In-Shore Ship Detection through Edge-Cloud Collaboration

Wenjun Huang,Hanning Chen,Yang Ni,Arghavan Rezvani,Sanggeon Yun,Sungheon Jeon,Eric Pedley,Mohsen Imani

2024-07-29

Abstract:Detecting marine objects inshore presents challenges owing to algorithmic intricacies and complexities in system deployment. We propose a difficulty-aware edge-cloud collaborative sensing system that splits the task into object localization and fine-grained classification. Objects are classified either at the edge or within the cloud, based on their estimated difficulty. The framework comprises a low-power device-tailored front-end model for object localization, classification, and difficulty estimation, along with a transformer-graph convolutional network-based back-end model for fine-grained classification. Our system demonstrates superior performance (mAP@0.5 +4.3%}) on widely used marine object detection datasets, significantly reducing both data transmission volume (by 95.43%) and energy consumption (by 72.7%}) at the system level. We validate the proposed system across various embedded system platforms and in real-world scenarios involving drone deployment.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### What problems does this paper attempt to solve?

This paper aims to solve multiple challenges in ship detection in near - shore waters. Specifically, the authors propose an edge - cloud - collaborative intelligent perception system (EcoSense) to address the following main issues:

1. **Algorithm complexity**:
- In the In - Shore Marine Object Detection (IMOD) task, the class differences between different ships are small, making it difficult for traditional machine - learning algorithms to distinguish these targets.
- Existing methods such as AIS and RADAR have limitations. AIS depends on all ships being equipped with and actively transmitting signals, while RADAR is prone to blind spots and cannot provide detailed physical features.

2. **Practical deployment difficulties**:
- The sensors of the IMOD system (such as coastal webcams, drones, and mobile cameras) are usually deployed in complex environments and are widely distributed along the long and narrow coastline.
- Platform and environmental constraints need to be considered, and the utilization of computing resources needs to be optimized.

3. **Data transmission and energy consumption problems**:
- Centralized methods (all data are sent to a central server for processing) will lead to high - bandwidth requirements and system reliability issues.
- Distributed methods (deploying detection models near each sensor) save bandwidth but are limited by the battery life, execution time, and overall performance of edge devices.

To solve the above problems, the authors propose an edge - cloud - collaborative framework, dividing the task into two parts: object location and fine - grained classification. The front - end model runs on low - power edge devices and is responsible for object location, difficulty estimation, and preliminary classification; the back - end model runs in the cloud and is responsible for fine - grained classification. This design significantly reduces the amount of data transmission and energy consumption while ensuring performance.