C2P-GCN: Cell-to-Patch Graph Convolutional Network for Colorectal Cancer Grading

Sudipta Paul,Bulent Yener,Amanda W. Lund

2024-05-13

Abstract:Graph-based learning approaches, due to their ability to encode tissue/organ structure information, are increasingly favored for grading colorectal cancer histology images. Recent graph-based techniques involve dividing whole slide images (WSIs) into smaller or medium-sized patches, and then building graphs on each patch for direct use in training. This method, however, fails to capture the tissue structure information present in an entire WSI and relies on training from a significantly large dataset of image patches. In this paper, we propose a novel cell-to-patch graph convolutional network (C2P-GCN), which is a two-stage graph formation-based approach. In the first stage, it forms a patch-level graph based on the cell organization on each patch of a WSI. In the second stage, it forms an image-level graph based on a similarity measure between patches of a WSI considering each patch as a node of a graph. This graph representation is then fed into a multi-layer GCN-based classification network. Our approach, through its dual-phase graph construction, effectively gathers local structural details from individual patches and establishes a meaningful connection among all patches across a WSI. As C2P-GCN integrates the structural data of an entire WSI into a single graph, it allows our model to work with significantly fewer training data compared to the latest models for colorectal cancer. Experimental validation of C2P-GCN on two distinct colorectal cancer datasets demonstrates the effectiveness of our method.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The paper primarily addresses the issue of grading colorectal cancer histopathology images and proposes a novel method called Cell-to-Patch Graph Convolutional Network (C2P-GCN). Traditional methods typically segment large images into smaller patches and perform training and prediction on these patches, but this approach often fails to capture the information of the entire tissue structure. Additionally, existing methods based on Graph Convolutional Networks (GCNs) can utilize tissue structure information but still rely on a large amount of image patch data for training and find it difficult to establish clear interpretative connections at the whole image level.

To solve the above problems, the authors propose C2P-GCN, a two-stage graph construction method. First, a graph is constructed at the patch level based on cellular organization; second, a graph is constructed at the whole image level based on the similarity between patches. Specifically:

1. **Patch-level Graph**: After segmenting the whole slide image (WSI) into smaller or medium-sized patches, a cellular graph is constructed for each patch, considering the distances between cells to form edges, thereby capturing local structural features.
2. **Image-level Graph**: Each patch is treated as a node, and edges are formed by calculating the similarity between patches, thus establishing meaningful connections at the whole image level.

This method allows the model to work effectively with less training data and to integrate structural information at the whole image scale, giving it significant advantages over existing techniques.

Experimental results show that C2P-GCN achieves performance comparable to or even better than state-of-the-art methods on two different colorectal cancer datasets, while requiring far less training data than other methods.