Joint Dense-Point Representation for Contour-Aware Graph Segmentation

Kit Mills Bransby,Greg Slabaugh,Christos Bourantas,Qianni Zhang

DOI: https://doi.org/10.1007/978-3-031-43898-1_50

2023-06-21

Abstract:We present a novel methodology that combines graph and dense segmentation techniques by jointly learning both point and pixel contour representations, thereby leveraging the benefits of each approach. This addresses deficiencies in typical graph segmentation methods where misaligned objectives restrict the network from learning discriminative vertex and contour features. Our joint learning strategy allows for rich and diverse semantic features to be encoded, while alleviating common contour stability issues in dense-based approaches, where pixel-level objectives can lead to anatomically implausible topologies. In addition, we identify scenarios where correct predictions that fall on the contour boundary are penalised and address this with a novel hybrid contour distance loss. Our approach is validated on several Chest X-ray datasets, demonstrating clear improvements in segmentation stability and accuracy against a variety of dense- and point-based methods. Our source code is freely available at: <a class="link-external link-http" href="http://www.github.com/kitbransby/Joint_Graph_Segmentation" rel="external noopener nofollow">this http URL</a>

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing

What problem does this paper attempt to address?

The paper attempts to address the limitations of traditional dense pixel-based methods and point-based methods in medical image segmentation tasks. Specifically:

1. **Dense pixel-based methods** perform well overall, but since their loss function is defined at the pixel level, this can lead to unreasonable segmentation boundaries, such as unexpected internal holes or disconnected plaques. These issues are particularly prominent in medical image analysis, where regions with sparse information, occlusion, or artifacts are common, often limiting the network's ability to predict reasonable boundaries.

2. **Point-based methods** generate polygons through Graph Convolutional Networks (GCNs) that can reduce the Hausdorff Distance (HD) and improve segmentation stability and robustness. However, this approach performs poorly in contour details, resulting in lower metrics such as Dice Similarity (DS) and Jaccard Coefficient (JC) compared to dense pixel-based methods.

To overcome the above issues, the paper proposes a new joint architecture and a Hybrid Contour Distance (HCD) loss function, aiming to combine the advantages of both dense pixel-based and point-based methods to generate more accurate and stable contour predictions. The specific contributions include:

- **Joint learning strategy**: By combining the features of dense pixel-based and point-based methods, the model can maintain high accuracy while avoiding topological errors.
- **Hybrid Contour Distance loss**: By precomputing unsigned distance fields for each category and sampling these distance fields as supervision signals during training, the model can more accurately predict contour boundaries, not just point locations.

The paper validates the effectiveness of the proposed method through experiments on multiple chest X-ray datasets, demonstrating its advantages in segmentation stability, accuracy, and computational efficiency.