Human‐multimodal deep learning collaboration in 'precise' diagnosis of lupus erythematosus subtypes and similar skin diseases
Qianwen Li,Zhi Yang,Kaili Chen,Ming Zhao,Hai Long,Yueming Deng,Haoran Hu,Chen Jia,Meiyu Wu,Zhidan Zhao,Huan Zhu,Suqing Zhou,Mingming Zhao,Pengpeng Cao,Shengnan Zhou,Yang Song,Guishao Tang,Juan Liu,Jiao Jiang,Wei Liao,Wenhui Zhou,Bingyi Yang,Feng Xiong,Suhan Zhang,Xiaofei Gao,Yiqun Jiang,Wei Zhang,Bo Zhang,Yan‐ling He,Liwei Ran,Chunlei Zhang,Wenting Wu,Quzong Suolang,Hanhuan Luo,Xiaojing Kang,Caoying Wu,Hongzhong Jin,Lei Chen,Qing Guo,Guangji Gui,Shanshan Li,Henan Si,Shuping Guo,Hong‐Ye Liu,Xiguang Liu,Guo‐Zhang Ma,Danqi Deng,Limei Yuan,Jianyun Lu,Jinrong Zeng,Xian Jiang,Xiaoyan Lyu,Liuqing Chen,Bin Hu,Juan Tao,Yuhao Liu,Gang Wang,Guannan Zhu,Zhirong Yao,Qianyue Xu,Bin Yang,Yu Wang,Yan Ding,Xianxu Yang,Hu Kai,Haijing Wu,Qianjin Lu
DOI: https://doi.org/10.1111/jdv.20031
2024-04-16
Journal of the European Academy of Dermatology and Venereology
Abstract:Background Lupus erythematosus (LE) is a spectrum of autoimmune diseases. Due to the complexity of cutaneous LE (CLE), clinical skin image‐based artificial intelligence is still experiencing difficulties in distinguishing subtypes of LE. Objectives We aim to develop a multimodal deep learning system (MMDLS) for human‐AI collaboration in diagnosis of LE subtypes. Methods This is a multi‐centre study based on 25 institutions across China to assist in diagnosis of LE subtypes, other eight similar skin diseases and healthy subjects. In total, 446 cases with 800 clinical skin images, 3786 multicolor‐immunohistochemistry (multi‐IHC) images and clinical data were collected, and EfficientNet‐B3 and ResNet‐18 were utilized in this study. Results In the multi‐classification task, the overall performance of MMDLS on 13 skin conditions is much higher than single or dual modals (Sen = 0.8288, Spe = 0.9852, Pre = 0.8518, AUC = 0.9844). Further, the MMDLS‐based diagnostic‐support help improves the accuracy of dermatologists from 66.88% ± 6.94% to 81.25% ± 4.23% (p = 0.0004). Conclusions These results highlight the benefit of human‐MMDLS collaborated framework in telemedicine by assisting dermatologists and rheumatologists in the differential diagnosis of LE subtypes and similar skin diseases.
dermatology