Deformations of large N = (4, 4) 2D SCFT from 3D gauged supergravity

Parinya Karndumri

DOI: https://doi.org/10.1007/JHEP05(2014)087

2013-11-29

Abstract:

What problem does this paper attempt to address?

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

Ran Yan,Kailun Yang,Kaiwei Wang

DOI: https://doi.org/10.1109/robio54168.2021.9739390

2021-01-01

Abstract:In recent years, intelligent driving navigation has made considerable progress, and semantic segmentation is one of the most advanced scene perception methods. At present, traditional semantic segmentation methods can use RGB images for detection of obstacles that are clearly visible in outdoor scenes. However, in the face of complex realistic driving scenes, RGB images cannot provide sufficient information. We need some other modal information to supplement the RGB information. In this paper, we propose Non-Local Fusion Network (NLFNet), which is a semantic segmentation network that can selectively fuse multimodal input information in an adaptive manner. It can use complementary information collected by different optical sensors to extract effective features for fusion. Thereby, it improves the segmentation accuracy of the network and solves the problem of object recognition in various challenging real-world scenes. We conduct comprehensive experiments to verify the effectiveness and generalization ability of the framework across RGB-Depth, RGB-Polarization, and RGB-Thermal image semantic segmentation, which is especially suitable for autonomous driving and robot vision applications.
Detecting Camouflaged Objects via Multi-Stage Coarse-to-Fine Refinement

Yuye Wang,Tianyou Chen,Xiaoguang Hu,Jiaqi Shi,Zichong Jia

DOI: https://doi.org/10.1109/access.2024.3380893

IF: 3.9

2024-03-30

IEEE Access

Abstract:Camouflaged objects are typically assimilated into their surroundings. Consequently, in contrast to generic object detection/segmentation, camouflaged object detection proves to be considerably more intricate due to the indistinct boundaries and heightened intrinsic similarities between foreground targets and the surrounding environment. Despite the proposition of numerous algorithms that have demonstrated commendable performance across various scenarios, these approaches may still grapple with blurred boundaries, leading to the inadvertent omission of camouflaged targets in challenging scenes. In this paper, we introduce a multi-stage framework tailored for segmenting camouflaged objects through a process of coarse-to-fine refinement. Specifically, our network encompasses three distinct decoders, each fulfilling a unique role in the model. In the initial decoder, we introduce the Bi-directional Locating Module to excavate foreground and background cues, enhancing target localization. The second decoder focuses on leveraging boundary information to augment overall performance, incorporating the Multi-level Feature Fusion Module to generate prediction maps with finer boundaries. Subsequently, the third decoder introduces the Mask-guided Fusion Module, designed to process high-resolution features under the guidance of the second decoder's results. This approach enables the preservation of structural details and the generation of fine-grained prediction maps. Through the integration of the three decoders, our model effectively identifies and segments camouflaged targets. Extensive experiments are conducted on three commonly used benchmark datasets. The results of these experiments demonstrate that, even without the application of pre-processing or post-processing techniques, our model outperforms 14 state-of-the-art algorithms.

computer science, information systems,telecommunications,engineering, electrical & electronic
ShareCMP: Polarization-Aware RGB-P Semantic Segmentation

Zhuoyan Liu,Bo Wang,Lizhi Wang,Chenyu Mao,Ye Li

2023-12-10

Abstract:Multimodal semantic segmentation is developing rapidly, but the modality of RGB-Polarization remains underexplored. To delve into this problem, we construct a UPLight RGB-P segmentation benchmark with 12 typical underwater semantic classes. In this work, we design the ShareCMP, an RGB-P semantic segmentation framework with a shared dual-branch architecture, which reduces the number of parameters by about 26-33% compared to previous dual-branch models. It encompasses a Polarization Generate Attention (PGA) module designed to generate polarization modal images with richer polarization properties for the encoder. In addition, we introduce the Class Polarization-Aware Loss (CPALoss) to improve the learning and understanding of the encoder for polarization modal information and to optimize the PGA module. With extensive experiments on a total of three RGB-P benchmarks, our ShareCMP achieves state-of-the-art performance in mIoU with fewer parameters on the UPLight (92.45(+0.32)%), ZJU (92.7(+0.1)%), and MCubeS (50.99(+1.51)%) datasets compared to the previous best methods. The code is available at <a class="link-external link-https" href="https://github.com/LEFTeyex/ShareCMP" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Transparent Objects Segmentation Based on Polarization Imaging and Deep Learning

Ruoning Yu,Wenyi Ren,Man Zhao,Jian Wang,Dan Wu,Yingge Xie

DOI: https://doi.org/10.1016/j.optcom.2023.130246

IF: 2.4

2024-01-01

Optics Communications

Abstract:Previous investigations relied on intensity, degree of linear polarization, and angle of linear polarization for transparent object (TO) segmentation. However, no research have examined TO segmentation using other polarization parameters. This paper presents an edge-enhanced and input extensible TO segmentation network that is capable of selecting the most optimal combination of inputs from 12 polarization parameters in an identical epoch. This study employed a laboratory-built system with polarized illumination and polarization camera to build a multi-polarization cue-based TO dataset. The optimal polarization scheme has been determined based on segmentation accuracy, support by comparative studies. To verify the feasibility of this optimal network, several ablation and comparison experiments have been conducted. It provides a prospective TO recognition strategy for industrial detection.
Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusion

Kaite Xiang,Kailun Yang,Kaiwei Wang

DOI: https://doi.org/10.1364/OE.416130

2021-01-23

Abstract:Semantic Segmentation (SS) is promising for outdoor scene perception in safety-critical applications like autonomous vehicles, assisted navigation and so on. However, traditional SS is primarily based on RGB images, which limits the reliability of SS in complex outdoor scenes, where RGB images lack necessary information dimensions to fully perceive unconstrained environments. As preliminary investigation, we examine SS in an unexpected obstacle detection scenario, which demonstrates the necessity of multimodal fusion. Thereby, in this work, we present EAFNet, an Efficient Attention-bridged Fusion Network to exploit complementary information coming from different optical sensors. Specifically, we incorporate polarization sensing to obtain supplementary information, considering its optical characteristics for robust representation of diverse materials. By using a single-shot polarization sensor, we build the first RGB-P dataset which consists of 394 annotated pixel-aligned RGB-Polarization images. A comprehensive variety of experiments shows the effectiveness of EAFNet to fuse polarization and RGB information, as well as the flexibility to be adapted to other sensor combination scenarios.

Computer Vision and Pattern Recognition,Robotics,Image and Video Processing
Polarization motivating high-performance weak targets’ imaging based on a dual-discriminator GAN

Hongping Zhou,Xinbao Zeng,Bing Lin,Dekui Li,Syed Afaq Ali Shah,Bingyi Liu,Kai Guo,Zhongyi Guo

DOI: https://doi.org/10.1364/oe.504918

IF: 3.8

2024-01-22

Optics Express

Abstract:High-level detection of weak targets under bright light has always been an important yet challenging task. In this paper, a method of effectively fusing intensity and polarization information has been proposed to tackle this issue. Specifically, an attention-guided dual-discriminator generative adversarial network (GAN) has been designed for image fusion of these two sources, in which the fusion results can maintain rich background information in intensity images while significantly completing target information from polarization images. The framework consists of a generator and two discriminators, which retain the texture and salient information as much as possible from the source images. Furthermore, attention mechanism is introduced to focus on contextual semantic information and enhance long-term dependency. For preserving salient information, a suitable loss function has been introduced to constrain the pixel-level distribution between the result and the original image. Moreover, the real scene dataset of weak targets under bright light has been built and the effects of fusion between polarization and intensity information on different weak targets have been investigated and discussed. The results demonstrate that the proposed method outperforms other methods both in subjective evaluations and objective indexes, which prove the effectiveness of achieving accurate detection of weak targets in bright light background.

optics
Polarization image fusion method with image enhancement

Chenguang Wang,Ruyue Ma,Deli Yan,Huiliang Cao,Chong Shen

DOI: https://doi.org/10.1088/1402-4896/ad1a2f

2024-01-18

Physica Scripta

Abstract:Abstract Because of their complementary characteristics, intensity images and polarization images are often fused to produce information-rich images. However, the polarization characteristics are easily affected by the object’s environment, and the image fusion process may lose important information. In this paper, we propose an unsupervised end-to-end network framework based on a CNN for intensity images and degree of linear polarization images. First, we construct our own polarization dataset to solve the limitations of the training dataset; a hybrid loss function is designed to form an unsupervised learning process; and a Laplace operator enhancement layer is introduced into the network to further improve the quality of the fused images. Subjective and objective comparison experiments prove that the proposed fusion network is visually superior to several classical fusion methods.

physics, multidisciplinary
Towards Accurate Camouflaged Object Detection with Mixture Convolution and Interactive Fusion

Geng Chen,Xinrui Chen,Bo Dong,Mingchen Zhuge,Yongxiong Wang,Hongbo Bi,Jian Chen,Peng Wang,Yanning Zhang

2024-07-19

Abstract:Camouflaged object detection (COD), which aims to identify the objects that conceal themselves into the surroundings, has recently drawn increasing research efforts in the field of computer vision. In practice, the success of deep learning based COD is mainly determined by two key factors, including (i) A significantly large receptive field, which provides rich context information, and (ii) An effective fusion strategy, which aggregates the rich multi-level features for accurate COD. Motivated by these observations, in this paper, we propose a novel deep learning based COD approach, which integrates the large receptive field and effective feature fusion into a unified framework. Specifically, we first extract multi-level features from a backbone network. The resulting features are then fed to the proposed dual-branch mixture convolution modules, each of which utilizes multiple asymmetric convolutional layers and two dilated convolutional layers to extract rich context features from a large receptive field. Finally, we fuse the features using specially-designed multilevel interactive fusion modules, each of which employs an attention mechanism along with feature interaction for effective feature fusion. Our method detects camouflaged objects with an effective fusion strategy, which aggregates the rich context information from a large receptive field. All of these designs meet the requirements of COD well, allowing the accurate detection of camouflaged objects. Extensive experiments on widely-used benchmark datasets demonstrate that our method is capable of accurately detecting camouflaged objects and outperforms the state-of-the-art methods.

Computer Vision and Pattern Recognition
Camouflaged target detection based on multimodal image input pixel-level fusion

Ruihui Peng,Jie Lai,Xueting Yang,Dianxing Sun,Shuncheng Tan,Yingjuan Song,Wei Guo

DOI: https://doi.org/10.1631/fitee.2300503

IF: 2.526

2024-10-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Camouflaged targets are a type of nonsalient target with high foreground and background fusion and minimal target feature information, making target recognition extremely difficult. Most detection algorithms for camouflaged targets use only the target's single-band information, resulting in low detection accuracy and a high missed detection rate. We present a multimodal image fusion camouflaged target detection technique (MIF-YOLOv5) in this paper. First, we provide a multimodal image input to achieve pixel-level fusion of the camouflaged target's optical and infrared images to improve the effective feature information of the camouflaged target. Second, a loss function is created, and the K -Means++ clustering technique is used to optimize the target anchor frame in the dataset to increase camouflage personnel detection accuracy and robustness. Finally, a comprehensive detection index of camouflaged targets is proposed to compare the overall effectiveness of various approaches. More crucially, we create a multispectral camouflage target dataset to test the suggested technique. Experimental results show that the proposed method has the best comprehensive detection performance, with a detection accuracy of 96.5%, a recognition probability of 92.5%, a parameter number increase of 1×10 4 , a theoretical calculation amount increase of 0.03 GFLOPs, and a comprehensive detection index of 0.85. The advantage of this method in terms of detection accuracy is also apparent in performance comparisons with other target algorithms.

engineering, electrical & electronic,computer science, information systems, software engineering
Edge-Guided Camouflaged Object Detection Via Multi-Level Feature Integration.

Kangwei Liu,Tianchi Qiu,Yinfeng Yu,Songlin Li,Xiuhong Li

DOI: https://doi.org/10.3390/s23135789

IF: 3.9

2023-01-01

Sensors

Abstract:Camouflaged object detection (COD) aims to segment those camouflaged objects that blend perfectly into their surroundings. Due to the low boundary contrast between camouflaged objects and their surroundings, their detection poses a significant challenge. Despite the numerous excellent camouflaged object detection methods developed in recent years, issues such as boundary refinement and multi-level feature extraction and fusion still need further exploration. In this paper, we propose a novel multi-level feature integration network (MFNet) for camouflaged object detection. Firstly, we design an edge guidance module (EGM) to improve the COD performance by providing additional boundary semantic information by combining high-level semantic information and low-level spatial details to model the edges of camouflaged objects. Additionally, we propose a multi-level feature integration module (MFIM), which leverages the fine local information of low-level features and the rich global information of high-level features in adjacent three-level features to provide a supplementary feature representation for the current-level features, effectively integrating the full context semantic information. Finally, we propose a context aggregation refinement module (CARM) to efficiently aggregate and refine the cross-level features to obtain clear prediction maps. Our extensive experiments on three benchmark datasets show that the MFNet model is an effective COD model and outperforms other state-of-the-art models in all four evaluation metrics (Sα, Eϕ, Fβw, and MAE).
Exploiting Polarized Material Cues for Robust Car Detection

Wen Dong,Haiyang Mei,Ziqi Wei,Ao Jin,Sen Qiu,Qiang Zhang,Xin Yang

2024-01-05

Abstract:Car detection is an important task that serves as a crucial prerequisite for many automated driving functions. The large variations in lighting/weather conditions and vehicle densities of the scenes pose significant challenges to existing car detection algorithms to meet the highly accurate perception demand for safety, due to the unstable/limited color information, which impedes the extraction of meaningful/discriminative features of cars. In this work, we present a novel learning-based car detection method that leverages trichromatic linear polarization as an additional cue to disambiguate such challenging cases. A key observation is that polarization, characteristic of the light wave, can robustly describe intrinsic physical properties of the scene objects in various imaging conditions and is strongly linked to the nature of materials for cars (e.g., metal and glass) and their surrounding environment (e.g., soil and trees), thereby providing reliable and discriminative features for robust car detection in challenging scenes. To exploit polarization cues, we first construct a pixel-aligned RGB-Polarization car detection dataset, which we subsequently employ to train a novel multimodal fusion network. Our car detection network dynamically integrates RGB and polarization features in a request-and-complement manner and can explore the intrinsic material properties of cars across all learning samples. We extensively validate our method and demonstrate that it outperforms state-of-the-art detection methods. Experimental results show that polarization is a powerful cue for car detection.

Computer Vision and Pattern Recognition
Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

Yanguang Sun,Chunyan Xu,Jian Yang,Hanyu Xuan,Lei Luo

2024-09-03

Abstract:Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification difficult. Existing methods attempt to reduce the impact of pixel similarity by maximizing the distinguishing ability of spatial features with complicated design, but often ignore the sensitivity and locality of features in the spatial domain, leading to sub-optimal results. In this paper, we propose a new approach to address this issue by jointly exploring the representation in the frequency and spatial domains, introducing the Frequency-Spatial Entanglement Learning (FSEL) method. This method consists of a series of well-designed Entanglement Transformer Blocks (ETB) for representation learning, a Joint Domain Perception Module for semantic enhancement, and a Dual-domain Reverse Parser for feature integration in the frequency and spatial domains. Specifically, the ETB utilizes frequency self-attention to effectively characterize the relationship between different frequency bands, while the entanglement feed-forward network facilitates information interaction between features of different domains through entanglement learning. Our extensive experiments demonstrate the superiority of our FSEL over 21 state-of-the-art methods, through comprehensive quantitative and qualitative comparisons in three widely-used datasets. The source code is available at: <a class="link-external link-https" href="https://github.com/CSYSI/FSEL" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Contrast Enhanced Color Polarization Image Fusion

Jianwen Meng,Wenyi Ren,Ruoning Yu,Dan Wu,Rui Zhang,Yingge Xie,Jian Wang

DOI: https://doi.org/10.1016/j.ijleo.2023.170935

IF: 3.1

2023-01-01

Optik

Abstract:Polarization image fusion is commonly employed to improve the quality of images in various fields such as object recognition and detection. There have been limited investigations on color-based polarization image fusion methods, which predominantly rely on pseudo-color approaches and are primarily suited for human perception. We propose a contrast-enhanced method for color polarization image fusion based on local contrast and multiscale decomposition to effectively reflect the multidimensional information and assist subsequent vision tasks. The method created a basic local contrast map from the luminance channel of intensity and grayscale map of the degree of linear polarization (DoLP), then extracted high-frequency features to fuse with the local contrast map utilizing rolling fast guided filtering and least squares. Finally, the local contrast map and high-frequency features of DoLP were combined and injected into the color-intensity image. The quantitative and qualitative evaluation based on nine color image fusion methods and eight blind image assessment measures revealed that the proposed algorithm not only achieved image contrast improvement and effective information fusion, but also preserved the color information.
Real-Time Segmentation of Artificial Targets Using a Dual-Modal Efficient Attention Fusion Network

Ying Shen,Xiancai Liu,Shuo Zhang,Yixuan Xu,Dawei Zeng,Shu Wang,Feng Huang

DOI: https://doi.org/10.3390/rs15184398

IF: 5

2023-09-08

Remote Sensing

Abstract:The fusion of spectral–polarimetric information can improve the autonomous reconnaissance capability of unmanned aerial vehicles (UAVs) in detecting artificial targets. However, the current spectral and polarization imaging systems typically suffer from low image sampling resolution, which can lead to the loss of target information. Most existing segmentation algorithms neglect the similarities and differences between multimodal features, resulting in reduced accuracy and robustness of the algorithms. To address these challenges, a real-time spectral–polarimetric segmentation algorithm for artificial targets based on an efficient attention fusion network, called ESPFNet (efficient spectral–polarimetric fusion network) is proposed. The network employs a coordination attention bimodal fusion (CABF) module and a complex atrous spatial pyramid pooling (CASPP) module to fuse and enhance low-level and high-level features at different scales from the spectral feature images and the polarization encoded images, effectively achieving the segmentation of artificial targets. Additionally, the introduction of the residual dense block (RDB) module refines feature extraction, further enhancing the network's ability to classify pixels. In order to test the algorithm's performance, a spectral–polarimetric image dataset of artificial targets, named SPIAO (spectral–polarimetric image of artificial objects) is constructed, which contains various camouflaged nets and camouflaged plates with different properties. The experimental results on the SPIAO dataset demonstrate that the proposed method accurately detects the artificial targets, achieving a mean intersection-over-union (MIoU) of 80.4%, a mean pixel accuracy (MPA) of 88.1%, and a detection rate of 27.5 frames per second, meeting the real-time requirement. The research has the potential to provide a new multimodal detection technique for enabling autonomous reconnaissance by UAVs in complex scenes.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Robust Localization-Guided Dual-Branch Network for Camouflaged Object Segmentation

Chuanjiang Wang,Yuepeng Li,Guohui Wei,Xiankai Hou,Xiujuan Sun

DOI: https://doi.org/10.3390/electronics13050821

IF: 2.9

2024-02-21

Electronics

Abstract:The existence of camouflage targets is widespread in the natural world, as they blend seamlessly or closely resemble their surrounding environment, making it difficult for the human eye to identify them accurately. In camouflage target segmentation, challenges often arise from the high similarity between the foreground and background, resulting in segmentation errors, imprecise edge detection, and overlooking of small targets. To address these issues, this paper presents a robust localization-guided dual-branch network for the recognition of camouflaged targets. Two crucial branches, i.e., a localization branch and an overall refinement branch are designed and incorporated. The localization branch achieves accurate preliminary localization of camouflaged targets by incorporating the robust localization module, which integrates different high-level feature maps in a partially decoded manner. The overall refinement branch optimizes segmentation accuracy based on the output predictions of the localization branch. Within this branch, the edge refinement module is devised to effectively reduce false negative and false positive interference. By conducting context exploration on each feature layer from top to bottom, this module further enhances the precision of target edge segmentation. Additionally, our network employs five jointly trained output prediction maps and introduces attention-guided heads for diverse prediction maps in the overall refinement branch. This design adjusts the spatial positions and channel weights of different prediction maps, generating output prediction maps based on the emphasis of each output, thereby further strengthening the perception and feature representation capabilities of the model. To improve its ability to generate highly confident and accurate prediction candidate regions, tailored loss functions are designed to cater to the objectives of different prediction maps. We conducted experiments on three publicly available datasets for camouflaged object detection to assess our methodology and compared it with state-of-the-art network models. On the largest dataset COD10K, our method achieved a Structure-measure of 0.827 and demonstrated superior performance in other evaluation metrics, outperforming recent network models.

engineering, electrical & electronic,computer science, information systems,physics, applied
Learning based polarization image fusion under an alternative paradigm

Jianwen Meng,Wenyi Ren,Ruoning Yu,Xu Ma,Gonzalo R. Arce,Dan Wu,Rui Zhang,Yingge Xie

DOI: https://doi.org/10.1016/j.optlastec.2023.109969

2023-09-01

Abstract:Polarization image fusion is a crucial component of polarization imaging applications. Most of the existing polarization fusion algorithms concentrate on fusing the intensity and the degree of linear polarization (DoLP). The information encoded in the angle of linear polarization (AoLP), such as surface orientation and illumination, is not introduced in existing fusion frameworks due to the noise-sensitive property, the π -ambiguity and diffuse/specular-ambiguity. To address this problem, we adopt a new polarization mapping paradigm as an alternative to improve feature utilization and information interpretability. A learning based polarization image fusion network is proposed to learn the potential features and recreate the intuitively understandable images. Four public polarization datasets are introduced in the experiments. The linear polarization information was effectively fused by the proposed method. The noise and distortion introduced by DoLP and AoLP are suppressed meanwhile. According to the evaluation and analysis, it found that the fused images acquired by the proposed method outperform the state-of-the-art methods in the aspects of target surface orientation representation, low-illumination object recognition, and texture enhancement.

optics,physics, applied
Polarization Fusion Algorithm Based on NSCT Decomposition and Improved Dual-Channel PCNN Model

Chao Hu,Bin Fan,Jiang Bian,Shuo Zhong,Wang Lun,Mengxia Hou,Bo Qi

DOI: https://doi.org/10.1117/12.3021457

2024-01-01

Abstract:Polarization imaging is capable of effectively showcasing the polarization properties of objects while also mitigating the impact of strong light and enhancing the visibility of weak light. As a result, it compensates for the limitations of intensity imaging in low-light environments. To fully utilize the advantages of intensity and polarization images, this paper proposes a method that combines NSCT decomposition and an improved dual-channel PCNN model. The method enhances the traditional PCNN model by extending the input to dual channels, employing adaptively calculated parameters, and applying adaptive linking weights to the high- and low-frequency images obtained from NSCT decomposition. The highfrequency image utilizes the MSMG operator, while the low-frequency image employs a weight map controlled by multiple parameters. This method is utilized for fusion processing of intensity and polarization images.By conducting comparative experiments with six commonly used algorithms, the results demonstrate the superior performance of this method in terms of preserving texture details, providing high-quality images, achieving information-rich fusion, generating fused images with rich grayscale levels, and maintaining structural similarity. In summary, the proposed method exhibits significant advantages in fusing intensity and polarization images.
A bioinspired three-stage model for camouflaged object detection

Tianyou Chen,Jin Xiao,Xiaoguang Hu,Guofeng Zhang,Shaojie Wang

2023-06-06

Abstract:Camouflaged objects are typically assimilated into their backgrounds and exhibit fuzzy boundaries. The complex environmental conditions and the high intrinsic similarity between camouflaged targets and their surroundings pose significant challenges in accurately locating and segmenting these objects in their entirety. While existing methods have demonstrated remarkable performance in various real-world scenarios, they still face limitations when confronted with difficult cases, such as small targets, thin structures, and indistinct boundaries. Drawing inspiration from human visual perception when observing images containing camouflaged objects, we propose a three-stage model that enables coarse-to-fine segmentation in a single iteration. Specifically, our model employs three decoders to sequentially process subsampled features, cropped features, and high-resolution original features. This proposed approach not only reduces computational overhead but also mitigates interference caused by background noise. Furthermore, considering the significance of multi-scale information, we have designed a multi-scale feature enhancement module that enlarges the receptive field while preserving detailed structural cues. Additionally, a boundary enhancement module has been developed to enhance performance by leveraging boundary information. Subsequently, a mask-guided fusion module is proposed to generate fine-grained results by integrating coarse prediction maps with high-resolution feature maps. Our network surpasses state-of-the-art CNN-based counterparts without unnecessary complexities. Upon acceptance of the paper, the source code will be made publicly available at <a class="link-external link-https" href="https://github.com/clelouch/BTSNet" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Local to global purification strategy to realize collaborative camouflaged object detection

Jinghui Tong,Yaqiu Bi,Cong Zhang,Hongbo Bi,Ye Yuan

DOI: https://doi.org/10.1016/j.cviu.2024.103932

IF: 4.886

2024-01-14

Computer Vision and Image Understanding

Abstract:The purpose of camouflaged object detection is to detect objects in images that are not easily perceived by human eyes. Aiming at the problems of low recognition performance and unsatisfied texture information extraction in the complex environment in the current camouflaged object detection algorithms, we propose to improve the accuracy by simultaneously detecting a group of images containing the same camouflaged category. Therefore, we put forward a novel method termed local to global purification network (LGPNet) for collaborative camouflaged object detection. Our method comprises two main modules: the Local Detail Mining module (LDM) and the Global Intra-group Feature Extraction module (GIFE). The LDM is designed to exploit diversified detail information via different adaptive kernels and receptive field mechanisms locally, and the GIFE module is invented for feature enhancement and multi-level information aggregation. Specifically, the GIFE first utilizes channel attention and spatial attention mechanisms to enhance high-level semantic information and then aggregates the intra-group characteristics by level. Extensive experiments on CoCOD8K dataset and 4 COD benchmark datasets illustrate the effectiveness and superiority of our method compared to SOTAs.

computer science, artificial intelligence,engineering, electrical & electronic
Polarized Prior Guided Fusion Network for Infrared Polarization Images

Kunyuan Li,Meibin Qi,Shuo Zhuang,Yimin Liu

DOI: https://doi.org/10.1109/tgrs.2024.3389976

IF: 8.2

2024-04-27

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Typical infrared polarization image fusion aims to integrate background details in the infrared intensity and salient target in the degree of linear polarization (DoLP). Many fusion methods show advanced network architecture, but few works can form effective feature representations for the differences in prior distributions of the infrared intensity and DoLP, and the interference of DoLP with noise makes fusion more challenging. This article uses a learned low-rank decomposition model to extract low-rank representations containing background details in infrared intensity and sparse features with salient targets in DoLP. To reduce noise interference, we design a fusion module based on an attention-guided filter, where the infrared intensity serves as a guide map to suppress the background in DoLP. Moreover, a novel loss constraint is proposed to improve the fusion performance. Specifically, the fusion network is trained by reconstructing polarized images in different directions from the fused image. Quantitative and qualitative experimental results validate the effectiveness of our approach. In comparison to existing methods, our fusion model can better preserve the polarization salient target and suppress the background interference with fewer parameters. The source code is available at https://github.com/lkyahpu/PIPFNet.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics

Deformations of large N = (4, 4) 2D SCFT from 3D gauged supergravity

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

Detecting Camouflaged Objects via Multi-Stage Coarse-to-Fine Refinement

ShareCMP: Polarization-Aware RGB-P Semantic Segmentation

Transparent Objects Segmentation Based on Polarization Imaging and Deep Learning

Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusion

Polarization motivating high-performance weak targets’ imaging based on a dual-discriminator GAN

Polarization image fusion method with image enhancement

Towards Accurate Camouflaged Object Detection with Mixture Convolution and Interactive Fusion

Camouflaged target detection based on multimodal image input pixel-level fusion

Edge-Guided Camouflaged Object Detection Via Multi-Level Feature Integration.

Exploiting Polarized Material Cues for Robust Car Detection

Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

Contrast Enhanced Color Polarization Image Fusion

Real-Time Segmentation of Artificial Targets Using a Dual-Modal Efficient Attention Fusion Network

Robust Localization-Guided Dual-Branch Network for Camouflaged Object Segmentation

Learning based polarization image fusion under an alternative paradigm

Polarization Fusion Algorithm Based on NSCT Decomposition and Improved Dual-Channel PCNN Model

A bioinspired three-stage model for camouflaged object detection

Local to global purification strategy to realize collaborative camouflaged object detection

Polarized Prior Guided Fusion Network for Infrared Polarization Images