Label Generation Network based on Self-selected Historical Information for Multiple Disease Classification on Chest Radiography.

Yuelin Hu,Yuejie Zhang,Tao Zhang,Shang Gao,Weiguo Fan
DOI: https://doi.org/10.1109/BIBM49941.2020.9313507
2020-01-01
Abstract:Deep learning has made significant break through’s in image classification, but accurate diagnosis on chest radiography remains challenging due to a variety of potential diseases contained in one scan. Complex relations among diseases have significant clinical meanings, but are always ignored in most of previous work. Thus in this paper, we propose a novel Label Generation Network (LGN) which treats the label sequence as the caption of a radiology image and utilizes RNN to generate the disease labels according to the semantic relations and co-occurrence dependency among them. However, the sequential generation process of RNN makes it hard to capture the complex topological relations among diseases. To mitigate this problem, a Historical Information Module (HIM) is especially introduced to LGN, in which all the generated labels are fully considered when generating a new label. Moreover, a specific self-attention mechanism is applied in HIM to learn the topological disease relations and utilize them to select useful historical information which can provide positive guidance to the prediction of new label. Very positive results have been obtained in our experiments on the benchmark dataset of Chest X-ray14, which significantly outperform the state-of-the-art methods.
What problem does this paper attempt to address?