Yair Ben Sahel,Yonina C. Eldar
Abstract:The use of fluorescent molecules to create long sequences of low-density, diffraction-limited images enables highly-precise molecule localization. However, this methodology requires lengthy imaging times, which limits the ability to view dynamic interactions of live cells on short time scales. Many techniques have been developed to reduce the number of frames needed for localization, from classic iterative optimization to deep neural networks. Particularly, deep algorithm unrolling utilizes both the structure of iterative sparse recovery algorithms and the performance gains of supervised deep learning. However, the robustness of this approach is highly dependant on having sufficient training data. In this paper we introduce deep unrolled self-supervised learning, which alleviates the need for such data by training a sequence-specific, model-based autoencoder that learns only from given measurements. Our proposed method exceeds the performance of its supervised counterparts, thus allowing for robust, dynamic imaging well below the diffraction limit without any labeled training samples. Furthermore, the suggested model-based autoencoder scheme can be utilized to enhance generalization in any sparse recovery framework, without the need for external training data.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to improve the quality and speed of image reconstruction in super - resolution microscopic imaging without relying on a large amount of labeled training data, especially when dealing with high - density emitter frame sequences. Traditional single - molecule localization microscopy (SMLM) techniques such as PALM and STORM can achieve high - resolution imaging beyond the diffraction limit, but they require a long - term imaging process and are limited in dynamic cell imaging. In addition, although existing deep - learning methods have improved the reconstruction speed and quality, they are highly dependent on training data, and their performance will decline significantly when the test data is very different from the training data.
To solve these problems, the paper proposes a new method - Self - STORM (Self - Supervised Learning for Super - Resolution Microscopy), which achieves robust reconstruction without labeled training data by combining self - supervised learning and algorithm unrolling techniques. Specifically, Self - STORM utilizes a model - based autoencoder that only learns from the given low - resolution measurements to generate high - resolution molecular - location images. This method not only improves the generalization ability for different data sets but also reduces the need for explicit knowledge of the microscope optical settings while maintaining the interpretability and parameter efficiency of the model.
### Main contributions of the paper:
1. **Self - supervised learning**: Through self - supervised learning, Self - STORM eliminates the dependence on a large amount of labeled training data, enabling the model to have better generalization ability on different data sets.
2. **Algorithm unrolling**: By combining the structure of iterative sparse recovery algorithms (such as ISTA) and the advantages of deep learning, and through the algorithm unrolling technique, it automatically learns to optimize parameters, improving the accuracy and speed of reconstruction.
3. **Model efficiency**: It uses a parameter - efficient neural network architecture. By decomposing convolution operations, it reduces the number of model parameters, avoids over - parameterization, and maintains a large receptive field.
4. **Real - time dynamic imaging**: Self - STORM can achieve real - time dynamic imaging on high - density emitter frame sequences, making it possible for fast - dynamic live - cell imaging.
### Technical details:
- **Problem modeling**: The super - resolution localization task of SMLM is modeled as a sparse recovery problem, and the high - resolution image is estimated by minimizing the reconstruction error.
- **Algorithm unrolling**: Each step of the iterative algorithm (such as ISTA) is replaced by a neural network layer, and the parameters of these layers are optimized through self - supervised learning.
- **Autoencoder architecture**: A model - based autoencoder is used, where the encoder part is used to generate sparse codes (i.e., approximations of molecular positions), and the decoder part simulates the physical measurement process to restore the sparse codes to approximations of the low - resolution input.
- **Training and inference**: During the training process, the autoencoder maps the low - resolution measurements back to themselves; during inference, only the encoder part is used to generate high - resolution images.
### Experimental results:
The paper verifies the effectiveness of Self - STORM through simulation and experimental data. The results show that Self - STORM outperforms other supervised learning methods when dealing with data sets that are very different from the training data, and it performs well when dealing with high - density emitter frame sequences, providing a new solution for fast - dynamic live - cell imaging.
In conclusion, by combining self - supervised learning and algorithm unrolling techniques, Self - STORM overcomes the limitations of traditional SMLM methods in dynamic imaging and data generalization, bringing new breakthroughs to the field of super - resolution microscopic imaging.