Abstract:UAVs are widely used in marine environment monitoring and ecological protection, and accurate segmentation of UAV images is the basis for achieving these applications. However, the marine images taken by UAVs often have the problems of large intra-class scale changes and high inter-class similarity, resulting in a sharp decline in the performance of traditional semantic segmentation methods in this segmentation task. In order to alleviate this dilemma, we construct a new semantic segmentation network (EMFNet) combining transformer and multi-scale feature fusion to achieve accurate segmentation of UAV ocean images. For larger intra-class variations, we introduce transformer blocks made up of external attention (EA) to capture potential correlations between data samples. For the high similarity between different semantic categories, we specially construct feature fusion branches to learn diverse feature information. Inspired by camouflage object detection, in the fusion branch, we design a mixed convolutional attention (MCA) module to increase the receptive field and a dual attention fusion module (DAFM) to realize cross-level learnin. At the same time, we apply the auxiliary segmentation head to the fused features to refine the segmentation results layer by layer and discard all auxiliary segmentation headers in the inference stage to maintain real-time inference. Experimental results show that our designed EMFNet achieves 77.13% MIoU on the public dataset Cityscapes and 61.41% MIoU on our UAV-OUC-SEG dataset, respectively, and maintains a real-time inference speed of 61.6FPS.

Study of Multi-View UAV Target Recognition

Detection and Recognition Method of Fast Low-Altitude Unmanned Aerial Vehicle Based on Dual Channel

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

Fast Detection and Recognition Method of UAV in Sky Background

Realizing Small UAV Targets Recognition via Multi-Dimensional Feature Fusion of High-Resolution Radar

Research on Spatial Target Recognition Method Based on Multi-source Sensor Fusion

Ground Target Localization Algorithm Based on UAV Aerial Image Analysis

Detection, tracking and recognition of multi-targets using fusion data from different sensors

A Vision-based UAV Tracker Aiming at Aerial Targets

UAV Target Detection under Complex Sky Background

Multi UAV Target Tracking Based on the Vision and Communication Information.

Target Tracking Algorithm of Radar and Infrared Sensor Based on Multi-Source Information Fusion

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

Re-weighting Fusion-based Electromagnetic Target Situation Mapping Method with Multi-Uav

Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data

Recognition of flying small target based on enhanced quadratic time-frequency analysis

Development of UAV-Based Target Tracking and Recognition Systems

Multi-modal Object Detection of UAV Remote Sensing Based on Joint Representation Optimization and Specific Information Enhancement

Alleviating Spatial Misalignment and Motion Interference for UAV-based Video Recognition

An Efficient Target Detection and Recognition Method in Aerial Remote-sensing Images Based on Multiangle Regions-of-Interest

Real-Time Multi-Modal Active Vision for Object Detection on UAVs Equipped With Limited Field of View LiDAR and Camera