DeReStainer: H&E to IHC Pathological Image Translation via Decoupled Staining Channels

Linda Wei,Shengyi Hua,Shaoting Zhang,Xiaofan Zhang
2024-09-01
Abstract:Breast cancer is a highly fatal disease among cancers in women, and early detection is crucial for treatment. HER2 status, a valuable diagnostic marker based on Immunohistochemistry (IHC) staining, is instrumental in determining breast cancer status. The high cost of IHC staining and the ubiquity of Hematoxylin and Eosin (H&E) staining make the conversion from H&E to IHC staining essential. In this article, we propose a destain-restain framework for converting H&E staining to IHC staining, leveraging the characteristic that H&E staining and IHC staining of the same tissue sections share the Hematoxylin channel. We further design loss functions specifically for Hematoxylin and Diaminobenzidin (DAB) channels to generate IHC images exploiting insights from separated staining channels. Beyond the benchmark metrics on BCI contest, we have developed semantic information metrics for the HER2 level. The experimental results demonstrated that our method outperforms previous open-sourced methods in terms of image intrinsic property and semantic information.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem this paper attempts to address is the conversion of H&E stained images to IHC stained images to aid in the early detection and diagnosis of breast cancer. Specifically, the paper focuses on the following points: 1. **High cost and time-consuming IHC staining**: IHC staining is very important in pathology, especially in identifying tumor cells, but its process is complex, time-consuming, and costly. 2. **Prevalence of H&E staining**: H&E staining is the most commonly used tissue staining technique, capable of providing rich information on tissue structure and morphology, but it lacks the specific protein information provided by IHC staining. 3. **Need for conversion from H&E to IHC**: Due to the widespread use of H&E staining, researchers hope to develop a method that can automatically convert H&E stained images to IHC stained images, thereby reducing the cost and time of IHC staining. To this end, the paper proposes a framework called DeReStainer, which achieves the conversion from H&E to IHC by decoupling the staining channels (H channel in H&E staining and DAB channel in IHC staining). This framework not only performs well in terms of intrinsic image properties (such as SSIM and PSNR) but also achieves significant improvements in the evaluation of semantic information (particularly HER2 levels).