Exploration, fusion, and refinement: a multivariate features interaction network for visual camouflaged detection

Zhen Huang,Yongjian Zhu,Qiao Zhang,Hongyan Zang,Tengfei Lei
DOI: https://doi.org/10.1007/s00371-024-03658-y
IF: 2.835
2024-10-07
The Visual Computer
Abstract:Camouflaged object detection (COD) aims to find objects hidden in the surrounding environment. Camouflaged objects are usually fused with the background and have high intrinsic similarity, and the sizes and appearances of camouflaged objects vary, causing most previous single-stage methods to fail. To this end, we propose a multivariate feature interaction network (MFINet) based on a multistage design. Specifically, the MFINet consists of three stages: a feature exploration stage, a feature fusion stage, and a feature refinement stage. In the feature exploration phase, we design three key components: a global information exploration unit (GIEU), a spatial information exploration unit (SIEU), and a multi-scale exploration unit (MEU). The GIEU locates the position of the camouflaged object by integrating the global contextual information. The SIEU aggregates effective spatial information. The MEU explores the rich multi-scale information. In the feature fusion stage, we design a multielement feature fusion module to integrate the consistency and complementarity of multi-scale features to fully explore the valuable clues in the context by exploiting the global semantics and spatial details. In the feature refinement phase, we design a cross-layer consistency refinement module to facilitate information transfer between neighboring layers and refine camouflage features by mutual guidance of low-level and high-level features. The proposed MFINet is evaluated on four challenging COD benchmark datasets (i.e., CAMO, CHAMELEON, COD10K, and NC4K) using four widely used metrics. These evaluations demonstrate that our proposed method is superior to other existing cutting-edge methods for camouflaged object detection. The code will be released at https://github.com/ZYJ9224/MFINet.
computer science, software engineering
What problem does this paper attempt to address?