Abstract:Microscopy is routinely used to image biological structures of interest. Due to imaging constraints, acquired images, also called as micrographs, are typically low-SNR and contain noise. Over the last few years, regression-based tasks like unsupervised denoising and splitting have found utility in working with such noisy micrographs. For evaluation, Structural Similarity (SSIM) is one of the most popular measures used in the field. For such tasks, the best evaluation would be when both low-SNR noisy images and corresponding high-SNR clean images are obtained directly from a microscope. However, due to the following three peculiar properties of the microscopy data, we observe that SSIM is not well suited to this data regime: (a) high-SNR micrographs have higher intensity pixels as compared to low-SNR micrographs, (b) high-SNR micrographs have higher intensity pixels than found in natural images, images for which SSIM was developed, and (c) a digitally configurable offset is added by the detector present inside the microscope which affects the SSIM value. We show that SSIM components behave unexpectedly when the prediction generated from low-SNR input is compared with the corresponding high-SNR data. We explain this by introducing the phenomenon of saturation, where SSIM components become less sensitive to (dis)similarity between the images. We propose an intuitive way to quantify this, which explains the observed SSIM behavior. We introduce MicroSSIM, a variant of SSIM, which overcomes the above-discussed issues. We justify the soundness and utility of MicroSSIM using theoretical and empirical arguments and show the utility of MicroSSIM on two tasks: unsupervised denoising and joint image splitting with unsupervised denoising. Since our formulation can be applied to a broad family of SSIM-based measures, we also introduce MicroMS3IM, a microscopy-specific variation of MS-SSIM.

SSIM Compliant Modeling Framework With Denoising and Deblurring Applications

R-MSSIM: Image quality assessment while performing object detection

MicroSSIM: Improved Structural Similarity for Comparing Microscopy Data

SR-SIM: A Fast and High Performance IQA Index Based on Spectral Residual

Structural Similarity-Optimal Total Variation Algorithm for Image Denoising

Using Marchenko–Pastur SVD and Linear MMSE Estimation for Reducing Image Noise

Simultaneous image denoising and completion through convolutional sparse representation and nonlocal self-similarity

General image denoising framework based on compressive sensing theory

A Mean-Edge Structural Similarity for Image Quality Assessment

Nonlocal Image Restoration with Bilateral Variance Estimation: A Low-Rank Approach

Blind Image Quality Assessment for Noise

A Statistical Learning Based Image Denoising Approach.

An unsupervised deep learning framework for medical image denoising

SSSIC: Semantics-to-Signal Scalable Image Coding with Learned Structural Representations.

An effective and objective criterion for evaluating the performance of denoising filters

Towards Natural Image Denoising by Sparse Code Shrinkage: Improvements and Applications

Principal Component Analysis Using Structural Similarity Index for Images

An effective nonlocal means image denoising framework based on non-subsampled shearlet transform

Image Denoising Using a Compressive Sensing Approach Based on Regularization Constraints

A Harmonic Means Pooling Strategy for Structural Similarity Index Measurement in Image Quality Assessment

Image Denoising with Machine Learning: A Novel Approach to Improve Quantum Image Processing Quality and Reliability