Abstract:The rapid development of deep learning provides a significant improvement of salient object detection combining both RGB and thermal images. However, existing deep learning-based models suffer from two major shortcomings. First, the computation and memory demands of Transformer-based models with quadratic complexity are unbearable, especially in handling high-resolution bi-modal feature fusion. Second, even if learning converges to an ideal solution, there remains a frequency gap between the prediction and ground truth. Therefore, we propose a purely fast Fourier transform-based model, namely deep Fourier-embedded network (DFENet), for learning bi-modal information of RGB and thermal images. On one hand, fast Fourier transform efficiently fetches global dependencies with low complexity. Inspired by this, we design modal-coordinated perception attention to fuse the frequency gap between RGB and thermal modalities with multi-dimensional representation enhancement. To obtain reliable detailed information during decoding, we design the frequency-decomposed edge-aware module (FEM) to clarify object edges by deeply decomposing low-level features. Moreover, we equip proposed Fourier residual channel attention block in each decoder layer to prioritize high-frequency information while aligning channel global relationships. On the other hand, we propose co-focus frequency loss (CFL) to steer FEM towards minimizing the frequency gap. CFL dynamically weights hard frequencies during edge frequency reconstruction by cross-referencing the bi-modal edge information in the Fourier domain. This frequency-level refinement of edge features further contributes to the quality of the final pixel-level prediction. Extensive experiments on four bi-modal salient object detection benchmark datasets demonstrate our proposed DFENet outperforms twelve existing state-of-the-art models.

Deep Learning Based Detection for Spectrally Efficient FDM Systems

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Iterative Detection with Soft Decision in Spectrally Efficient FDM Systems

SDR Implementation of Spectrum Sensing Using Deep Learning

Fingerprint Extraction and Classification of Wireless Channels Based on Deep Convolutional Neural Networks.

Spectral Network Combining Fourier Transformation and Deep Learning for Remote Sensing Object Detection

Deep Learning for Spectrum Sensing.

Deep Learning Based Detection for Communications Systems With Radar Interference

A New Deep Learning Framework for HF Signal Detection in Wideband Spectrogram

Deep Learning Algorithms for Signal Recognition in Long Perimeter Monitoring Distributed Fiber Optic Sensors

SDR implementation of a light deep learning model based CNN for joint spectrum sensing and AMC

Augmenting SEFDM Performance in High-Doppler Channels

An Event Recognition Method for Fiber Distributed Acoustic Sensing Systems Based on the Combination of MFCC and CNN

A Deep Learning Framework for Signal Detection and Modulation Classification

Deep Fourier-embedded Network for Bi-modal Salient Object Detection

Deep Learning-Based Spectrum Sensing in Cognitive Radio: A CNN-LSTM Approach

High performance few-mode fiber-based light field direction sensing system using deep convolutional neural network: fiber speckle demodulation network (FSDNET)

Design and Implementation of Spectrally Efficient Frequency Division Multiplexing Receiver

DeepSweep: Parallel and Scalable Spectrum Sensing via Convolutional Neural Networks

Faster Region-Based CNN Spectrum Sensing and Signal Identification in Cluttered RF Environments

Spectrum Monitoring for Radar Bands using Deep Convolutional Neural Networks