Knee Osteoarthritis Assessment in X-rays Using Global and Local Attention Enhancement and Joint Loss

Kang Wang,Dong Wen,Yunsheng Xiong,Zikai Gao,Peng Zhang,Yong Dou
DOI: https://doi.org/10.1145/3474198.3478176
2021-05-21
Abstract:Knee osteoarthritis (OA) is a kind of common joint disease that seriously affects mental and physical health of patients. Usually, doctors make knee OA clinical diagnosis by reviewing knee imaging, which are easily influenced by their fatigue and subjective factors. Thus, computer-aided diagnosis of knee OA in X-rays has emerged to assist doctors. Existing methods mainly adopt two-stage approach, including knee joint localization and OA severity prediction. However, there exists several issues: (1) Knee joint localization accuracy of existing methods needs to be further improved, affecting the subsequent knee OA assessment. (2) Current approaches ignore richer semantic information and the prior knowledge of doctors focusing on osteophytes and joint space parts. (3) Increasing inter-class differences is often considered but minimizing intra-class variations is usually neglected. To alleviate above problems, we propose a knee OA assessment method depending on global and local attention enhancement and joint loss. In our model, we add channel and spatial attention modules as global attention module after the last convolutional layer of ResNet34, which is our basic architecture to extract richer semantic information. Based on the medical prior knowledge that doctors give knee OA grades by mainly observing knee joint space and osteophytes, five local feature maps of four osteophytes and joint space parts are extracted and concatenated with global knee feature maps before fully-connected (FC) layers, which is regarded as local attention module to facilitate better feature representations. Finally, Center loss and Softmax loss are weighted and combined to further enhance classification performance. Our proposed method is evaluated on two public datasets: OAI and MOST datasets. Experimental results demonstrate that our method achieves the state-of-the-art result, which may be a potentially useful tool for assisting doctors.
What problem does this paper attempt to address?