Abstract:The identification of vascular network structures is one of the key fields of research in medical imaging. The segmentation of dorsal hand vein patterns form NIR images is not only the basis for reliable biometric identification, but would also provide a significant tool in assisting medical intervention. Precise vein extraction would help medical workers to exactly determine the needle entry point to efficiently gain intravenous access for different clinical purposes, such as intravenous therapy, parenteral nutrition, blood analysis and so on. It would also eliminate repeated attempts at needle pricks and even facilitate an automatic injection procedure in the near future. In this paper, we present a combination of unsupervised and supervised dorsal hand vein segmentation from near-infrared images in the NCUT database. This method is convenient due to the lack of expert annotations of publicly available vein image databases. The novelty of our work is the automatic extraction of the veins in two phases. First, a geometrical approach identifies tubular structures corresponding to veins in the image. This step is considered gross segmentation and provides labels (Label I) for the second CNN-based segmentation phase. We visually observe that different CNNs obtain better segmentation on the test set. This is the reason for building an ensemble segmentor based on majority voting by nine different network architectures (U-Net, U-Net++ and U-Net3+, all trained with BCE, Dice and focal losses). The segmentation result of the ensemble is considered the second label (Label II). In our opinion, the new Label II is a better annotation of the NCUT database than the Label I obtained in the first step. The efficiency of computer vision algorithms based on artificial intelligence algorithms is determined by the quality and quantity of the labeled data used. Furthermore, we prove this statement by training ResNet–UNet in the same manner with the two different label sets. In our experiments, the Dice scores, sensitivity and specificity with ResNet–UNet trained on Label II are superior to the same classifier trained on Label I. The measured Dice scores of ResNet–UNet on the test set increase from 90.65% to 95.11%. It is worth mentioning that this article is one of very few in the domain of dorsal hand vein segmentation; moreover, it presents a general pipeline that may be applied for different medical image segmentation purposes.

Automatic Venous Segmentation in Venipuncture Robot Using Deep Learning

Semi-supervised Vein Segmentation of Ultrasound Images for Autonomous Venipuncture.

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

VeniBot: Towards Autonomous Venipuncture with Semi-supervised Vein Segmentation from Ultrasound Images

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Vein segmentation and visualization of upper and lower extremities using convolution neural network

Edge AI-Based Vein Detector for Efficient Venipuncture in the Antecubital Fossa

VeniBot: Towards Autonomous Venipuncture with Automatic Puncture Area and Angle Regression from NIR Images

Boosting Unsupervised Dorsal Hand Vein Segmentation with U-Net Variants

Force Sensing Guided Artery-Vein Segmentation via Sequential Ultrasound Images

DCSegNet: Deep Learning Framework Based on Divide-and-Conquer Method for Liver Segmentation

Multi-scale Interactive Network with Artery/Vein Discriminator for Retinal Vessel Classification

Lite-HDNet: A Lightweight Domain-Adaptive Segmentation Framework for Improved Finger Vein Pattern Extraction

Research on Robotic Humanoid Venipuncture Method Based on Biomechanical Model

Hard Attention Net for Automatic Retinal Vessel Segmentation

Joint Learning of Vessel Segmentation and Artery/Vein Classification with Post-processing

Landmark-Assisted Anatomy-Sensitive Retinal Vessel Segmentation Network

Fingertip Blood Collection Point Localization Research Based on Infrared Finger Vein Image Segmentation

Deep Dilated Convolutional Nets for the Automatic Segmentation of Retinal Vessels

Fully Automatic Segmentation of Sublingual Veins from Retrained U-Net Model for Few Near Infrared Images

Multi-scale Generative Adversarial Network for Automatic Sublingual Vein Segmentation