psudo: Exploring Multi-Channel Biomedical Image Data with Spatially and Perceptually Optimized Pseudocoloring

Simon Warchol,Jakob Troidl,Jeremy L Muhlich,Robert Krueger,John Hoffer,Tica Lin,Johanna Beyer,Elena Glassman,Peter Karl Sorger,Hanspeter Pfister

DOI: https://doi.org/10.1101/2024.04.11.589087

2024-06-15

Abstract:Over the past century, multichannel fluorescence imaging has been pivotal in myriad scientific breakthroughs by enabling the spatial visualization of proteins within a biological sample. With the shift to digital methods and visualization software, experts can now flexibly pseudocolor and combine image channels, each corresponding to a different protein, to explore their spatial relationships. We thus propose psudo, an interactive system that allows users to create optimal color palettes for multichannel spatial data. In psudo, a novel optimization method generates palettes that maximize the perceptual differences between channels while mitigating confusing color blending in overlapping channels. We integrate this method into a system that allows users to explore multi-channel image data and compare and evaluate color palettes for their data. An interactive lensing approach provides on-demand feedback on channel overlap and a color confusion metric while giving context to the underlying channel values. Color palettes can be applied globally or, using the lens, to local regions of interest. We evaluate our palette optimization approach using three graphical perception tasks in a crowdsourced user study with 150 participants, showing that users are more accurate at discerning and comparing the underlying data using our approach. Additionally, we showcase psudo in a case study exploring the complex immune responses in cancer tissue data with a biologist.

Cell Biology

What problem does this paper attempt to address?

The problem discussed in this paper is how to optimize the pseudocolor representation of multi-channel biomedical image data to improve spatial and perceptual analysis. Traditional multi-channel fluorescence imaging techniques play a key role in scientific research, but with the development of digital methods and visualization software, experts can now flexibly apply pseudocolor processing and combination to image channels corresponding to different proteins to explore their spatial relationships. The paper proposes an interactive system called "psudo" that allows users to create optimal color palettes for multi-channel spatial data.

The main innovations of the system include:
1. A novel optimization method that generates color palettes maximizing the perceptual differences between channels and reducing color confusion in overlapping channels.
2. Users can evaluate color confusion and apply the color palette globally or locally based on their needs through an interactive lens method to view channel overlapping.
3. The optimized color palette method was evaluated through crowdsourcing user studies, demonstrating that users can more accurately differentiate and compare underlying data when using this method.

The paper also points out some limitations of pseudocolor, such as color blending making variables difficult to identify separately, color visual equivalence (i.e., chromatic illusion) occurring when visualizing more than three channels simultaneously, and the perceptual non-uniformity of the standard RGB color space. Additionally, the spatial properties of multi-channel data affect the visualization effect, and the overlap of highly correlated variables exacerbates these visual limitations.

Through user studies and case analysis, the paper demonstrates the advantages of psudo in improving graphical perception, particularly in handling multiple channel images, and collaborates with biologists using actual cancer tissue data to prove the practicality of the system.