Monitoring of Pigmented Skin Lesions Using 3D Whole Body Imaging

David Ahmedt-Aristizabal,Chuong Nguyen,Lachlan Tychsen-Smith,Ashley Stacey,Shenghong Li,Joseph Pathikulangara,Lars Petersson,Dadong Wang

DOI: https://doi.org/10.1016/j.cmpb.2023.107451

2023-02-27

Abstract:Advanced artificial intelligence and machine learning have great potential to redefine how skin lesions are detected, mapped, tracked and documented. Here, We propose a 3D whole-body imaging system known as 3DSkin-mapper to enable automated detection, evaluation and mapping of skin lesions. A modular camera rig arranged in a cylindrical configuration was designed to automatically capture images of the entire skin surface of a subject synchronously from multiple angles. Based on the images, we developed algorithms for 3D model reconstruction, data processing and skin lesion detection and tracking based on deep convolutional neural networks. We also introduced a customised, user-friendly, and adaptable interface that enables individuals to interactively visualise, manipulate, and annotate the images. The proposed system is developed for skin lesion screening, the focus of this paper is to introduce the system instead of clinical study. Using synthetic and real images we demonstrate the effectiveness of the proposed system by providing multiple views of a target skin lesion, enabling further 3D geometry analysis and longitudinal tracking. It takes only a few seconds to capture the entire skin surface, and about half an hour to process and analyse the images. Our experiments show that the proposed system allow fast and easy whole body 3D imaging. It can be used by dermatological clinics to conduct skin screening, detect and track skin lesions over time, identify suspicious lesions, and document pigmented lesions. The system can potentially save clinicians time and effort significantly. The 3D imaging and analysis has the potential to change the paradigm of whole body photography with many applications in skin diseases, including inflammatory and pigmentary disorders.

Computer Vision and Pattern Recognition,Graphics

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the efficiency and accuracy of the detection, evaluation, and tracking of pigmented skin lesions. Specifically, the author proposes a 3D whole - body imaging system named 3DSkin - mapper, aiming to achieve the following goals:

1. **Automated detection and evaluation of skin lesions**: By designing a modular camera mount, the system can simultaneously capture images of the whole - body skin of the subject from multiple angles, thereby achieving the automatic detection and evaluation of skin lesions.
2. **3D model reconstruction**: Based on the captured images, algorithms for 3D model reconstruction, data processing, and skin lesion detection and tracking have been developed, especially using deep convolutional neural networks to improve the detection accuracy.
3. **User - friendly interaction interface**: A customized, user - friendly, and adaptable interface is provided, enabling users to interactively visualize, manipulate, and annotate images. This interface includes the function of mapping 2D skin lesions to the corresponding 3D models.
4. **Longitudinal tracking of skin lesions**: The system can provide multi - view views of the target skin lesions, support further 3D geometric analysis and longitudinal tracking, and help identify suspicious lesions that require more attention.
5. **Reducing the workload of clinicians**: Through fast and simple whole - body 3D imaging, this system can significantly save the time and energy of clinicians, enabling them to provide higher - quality treatment based on more detailed and accurate information.

In summary, the focus of this study is on introducing this innovative 3D whole - body imaging system, rather than conducting clinical research, aiming to change the current method of skin lesion monitoring, especially in the application of early skin cancer detection.