Abstract:Background: Accurate measurement of hemoglobin concentration is essential for various medical scenarios, including preoperative evaluations and determining blood loss. Traditional invasive methods are inconvenient and not suitable for rapid, point-of-care testing. Moreover, current models, due to their complex parameters, are not well-suited for mobile medical settings, which limits the ability to conduct frequent and rapid testing. This study aims to introduce a novel, compact, and efficient system that leverages deep learning and smartphone technology to accurately estimate hemoglobin levels, thereby facilitating rapid and accessible medical assessments. Methods: The study employed a smartphone application to capture images of the eye, which were subsequently analyzed by a deep neural network trained on data from invasive blood test data. Specifically, the EGE-Unet model was utilized for eyelid segmentation, while the DHA(C3AE) model was employed for hemoglobin level prediction. The performance of the EGE-Unet was evaluated using statistical metrics including mean intersection over union (MIOU), F1 Score, accuracy, specificity, and sensitivity. The DHA(C3AE) model's performance was assessed using mean absolute error (MAE), mean-square error (MSE), root mean square error (RMSE), and R^2. Results: The EGE-Unet model demonstrated robust performance in eyelid segmentation, achieving an MIOU of 0.78, an F1 Score of 0.87, an accuracy of 0.97, a specificity of 0.98, and a sensitivity of 0.86. The DHA(C3AE) model for hemoglobin level prediction yielded promising outcomes with an MAE of 1.34, an MSE of 2.85, an RMSE of 1.69, and an R^2 of 0.34. The overall size of the model is modest at 1.08 M, with a computational complexity of 0.12 FLOPs (G). Conclusions: This system presents a groundbreaking approach that eliminates the need for supplementary devices, providing a cost-effective, swift, and accurate method for healthcare professionals to enhance treatment planning and improve patient care in perioperative environments. The proposed system has the potential to enable frequent and rapid testing of hemoglobin levels, which can be particularly beneficial in mobile medical settings. Trial registration: The clinical trial was registered on the Chinese Clinical Trial Registry (No. ChiCTR2100044138) on 20/02/2021.

Deep Learning-assisted Smartphone-based Quantitative Microscopy for Label-free Peripheral Blood Smear Analysis

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Automatic whole blood cell analysis from blood smear using label-free multi-modal imaging with deep neural networks

Deep learning enhanced mobile-phone microscopy

Label-free hematology analysis method based on defocusing phase-contrast imaging under illumination of 415 nm light

Automated screening of sickle cells using a smartphone-based microscope and deep learning

Automated Blood Cell Detection and Counting via Deep Learning for Microfluidic Point-of-Care Medical Devices

A smartphone-integrated deep learning strategy-assisted rapid detection system for monitoring dual-modal immunochromatographic assay

Siamese deep learning video flow cytometry for automatic and label-free clinical cervical cancer cell analysis

Multiparameter mobile blood analysis for complete blood count using contrast-enhanced defocusing imaging and machine vision

Real-time non-invasive hemoglobin prediction using deep learning-enabled smartphone imaging

Accurate label-free 3-part leukocyte recognition with single cell lens-free imaging flow cytometry

Machine learning-assisted image label-free smartphone platform for rapid segmentation and robust multi-urinalysis

Deep learning-based virtual H& E staining from label-free autofluorescence lifetime images

Label-Free CD34+ Cell Identification Using Deep Learning and Lens-Free Shadow Imaging Technology

Deep learning and sub-band fluorescence imaging-based method for caries and calculus diagnosis embeddable on different smartphones

Machine learning based lens-free imaging technique for field-portable cytometry

Nanometer precise red blood cell sizing using a cost-effective quantitative dark field imaging system

Automated Detection of Acute Promyelocytic Leukemia in Blood Films and Bone Marrow Aspirates with Annotation-free Deep Learning

Deep Learning in Label-free Cell Classification

Smartphone-Based Quantitative Fluorescence Detection of Flowing Droplets Using Embedded Ambient Light Sensor