Abstract:The identification of vascular network structures is one of the key fields of research in medical imaging. The segmentation of dorsal hand vein patterns form NIR images is not only the basis for reliable biometric identification, but would also provide a significant tool in assisting medical intervention. Precise vein extraction would help medical workers to exactly determine the needle entry point to efficiently gain intravenous access for different clinical purposes, such as intravenous therapy, parenteral nutrition, blood analysis and so on. It would also eliminate repeated attempts at needle pricks and even facilitate an automatic injection procedure in the near future. In this paper, we present a combination of unsupervised and supervised dorsal hand vein segmentation from near-infrared images in the NCUT database. This method is convenient due to the lack of expert annotations of publicly available vein image databases. The novelty of our work is the automatic extraction of the veins in two phases. First, a geometrical approach identifies tubular structures corresponding to veins in the image. This step is considered gross segmentation and provides labels (Label I) for the second CNN-based segmentation phase. We visually observe that different CNNs obtain better segmentation on the test set. This is the reason for building an ensemble segmentor based on majority voting by nine different network architectures (U-Net, U-Net++ and U-Net3+, all trained with BCE, Dice and focal losses). The segmentation result of the ensemble is considered the second label (Label II). In our opinion, the new Label II is a better annotation of the NCUT database than the Label I obtained in the first step. The efficiency of computer vision algorithms based on artificial intelligence algorithms is determined by the quality and quantity of the labeled data used. Furthermore, we prove this statement by training ResNet–UNet in the same manner with the two different label sets. In our experiments, the Dice scores, sensitivity and specificity with ResNet–UNet trained on Label II are superior to the same classifier trained on Label I. The measured Dice scores of ResNet–UNet on the test set increase from 90.65% to 95.11%. It is worth mentioning that this article is one of very few in the domain of dorsal hand vein segmentation; moreover, it presents a general pipeline that may be applied for different medical image segmentation purposes.

Semi-supervised Vein Segmentation of Ultrasound Images for Autonomous Venipuncture.

VeniBot: Towards Autonomous Venipuncture with Semi-supervised Vein Segmentation from Ultrasound Images

VeniBot: Towards Autonomous Venipuncture with Automatic Puncture Area and Angle Regression from NIR Images

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Automatic Puncture System Based on NIR Image and Ultrasonic Image

Edge AI-Based Vein Detector for Efficient Venipuncture in the Antecubital Fossa

Boosting Unsupervised Dorsal Hand Vein Segmentation with U-Net Variants

Force Sensing Guided Artery-Vein Segmentation via Sequential Ultrasound Images

Vein segmentation and visualization of upper and lower extremities using convolution neural network

Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentation

A Novel Method for Low-Contrast and High-Noise Vessel Segmentation and Location in Venipuncture.

A temporal enhanced semi-supervised training framework for needle segmentation in 3D ultrasound images

Enhanced Uncertainty Estimation in Ultrasound Image Segmentation with MSU-Net

Robust vascular segmentation for raw complex images of laser speckle contrast based on weakly supervised learning

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Automatic ultrasound vessel segmentation with deep spatiotemporal context learning

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process

Deep learning for the rapid automatic segmentation of forearm muscle boundaries from ultrasound datasets

Deep Learning Guided Autonomous Surgery: Guiding Small Needles into Sub-Millimeter Scale Blood Vessels

DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal

Visualizing Veins from Color Skin Images Using Convolutional Neural Networks