Abstract:Skin cancer images have hair occlusion problems, which greatly affects the accuracy of diagnosis and classification. Current dermoscopic hair removal methods use segmentation networks to locate hairs, and then uses repair networks to perform image repair. However, it is difficult to segment hair and capture the overall structure between hairs because of the hair being thin, unclear, and similar in color to the entire image. When conducting image restoration tasks, the only available images are those obstructed by hair, and there is no corresponding ground truth (supervised data) of the same scene without hair obstruction. In addition, the texture information and structural information used in existing repair methods are often insufficient, which leads to poor results in skin cancer image repair. To address these challenges, we propose the intersection-union dual-stream cross-attention Lova-SwinUnet (IUDC-LS). Firstly, we propose the Lova-SwinUnet module, which embeds Lovasz loss function into Swin-Unet, enabling the network to better capture features of various scales, thus obtaining better hair mask segmentation results. Secondly, we design the intersection-union (IU) module, which takes the mask results obtained in the previous step for pairwise intersection or union, and then overlays the results on the skin cancer image without hair to generate the labeled training data. This turns the unsupervised image repair task into the supervised one. Finally, we propose the dual-stream cross-attention (DC) module, which makes texture information and structure information interact with each other, and then uses cross-attention to make the network pay attention to the more important texture information and structure information in the fusion process of texture information and structure information, so as to improve the effect of image repair. The experimental results show that the PSNR index and SSIM index of the proposed method are increased by 5.4875 and 0.0401 compared with the other common methods. Experimental results unequivocally demonstrate the effectiveness of our approach, which serves as a potent tool for skin cancer detection, significantly surpassing the performance of comparable methods.

Follicular Unit Registration Based on Binocular Stereo Vision for Hair Transplantation Surgery Robot.

Human-Computer Interaction System Based on Binocular Stereo Vision

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Vision-Based Automatic Hair Follicular Unit Separation

A New Dataset for Hair Follicle Recognition and Classification in Robot-Aided Hair Transplantation

Reconstruction of 3D Retina from Multi-viewed Stereo Fundus Images via Dynamic Registration

VPDet: Refined region CNN for hair follicle recognition in arbitrary angle

A Novel Registration Method for Image-Guided Neurosurgery System Based on Stereo Vision

Automatic Tool Landmark Detection for Stereo Vision in Robot-Assisted Retinal Surgery

An accurate stereo matching method based on color segments and edges

Stereo matching of binocular laparoscopic images with improved densely connected neural architecture search

Robotic hair harvesting system: a new proposal

A Binocular Reconstruction Based on Perspective Projection Constraints and Its Application on Robot Eye‐hand Coordination

Intersection-union dual-stream cross-attention Lova-SwinUnet for skin cancer hair segmentation and image repair

Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery

Strand-accurate multi-view facial hair reconstruction and tracking

Robust Registration for Ultra-Field Infrared and Visible Binocular Images

Constrained High Accuracy Stereo Reconstruction Method for Surgical Instruments Positioning.

Dynamic Detection of Global Microfeatures in Multimodal Retinal Images

Hair-YOLO: A Hair Follicle Detection Model Based on YOLOv8

3D Pose Estimation of Large and Complicated Workpieces Based on Binocular Stereo Vision.