Abstract:Deep learning approaches have been widely used in building automatic extraction tasks and have made great progress in recent years. However, the missing detection and wrong detection causing by spectrum confusion is still a great challenge. The existing fully convolutional networks (FCNs) cannot effectively distinguish whether the feature differences are from one building or the building and its adjacent non-building objects. In order to overcome the limitations, a building multi-feature fusion refined network (BMFR-Net) was presented in this paper to extract buildings accurately and completely. BMFR-Net is based on an encoding and decoding structure, mainly consisting of two parts: the continuous atrous convolution pyramid (CACP) module and the multiscale output fusion constraint (MOFC) structure. The CACP module is positioned at the end of the contracting path and it effectively minimizes the loss of effective information in multiscale feature extraction and fusion by using parallel continuous small-scale atrous convolution. To improve the ability to aggregate semantic information from the context, the MOFC structure performs predictive output at each stage of the expanding path and integrates the results into the network. Furthermore, the multilevel joint weighted loss function effectively updates parameters well away from the output layer, enhancing the learning capacity of the network for low-level abstract features. The experimental results demonstrate that the proposed BMFR-Net outperforms the other five state-of-the-art approaches in both visual interpretation and quantitative evaluation.

Building Detection from Panchromatic and Multispectral Images with Dual-Stream Asymmetric Fusion Networks

Dual-Branch Feature Fusion Network for Salient Object Detection

TfNet: Building Detection in Remote Sensing Images Using Multi-Scale Feature Fusion

A Hybrid Attention-Aware Fusion Network (HAFNet) for Building Extraction from High-Resolution Imagery and LiDAR Data

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

Building Multi-Feature Fusion Refined Network for Building Extraction from High-Resolution Remote Sensing Images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

DAF-Net: A Dual-Branch Feature Decomposition Fusion Network with Domain Adaptive for Infrared and Visible Image Fusion

A Multi-Branch Feature Fusion Network for Building Detection in Remote Sensing Images

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

DSA-Net: Infrared and Visible Image Fusion via Dual-Stream Asymmetric Network

ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images

Multi-View Adaptive Fusion Network for 3D Object Detection

Asymmetric Adaptive Fusion in a Two-Stream Network for RGB-D Human Detection

Adaptive and azimuth-aware fusion network of multimodal local features for 3D object detection

Efficient Object Detection Based on Deep Feature Fusion Network

ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detection

Multiscale Fusion Network for Rural Newly Constructed Building Detection in Unmanned Aerial Vehicle Imagery

Multi-Modal Fusion Based on Depth Adaptive Mechanism for 3D Object Detection

A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images

Frustum FusionNet: Amodal 3D Object Detection with Multi-Modal Feature Fusion