Abstract:Deep learning-based Bayer demosaicking methods have achieved superior performance. They require a large amount of paired images, which are challenging to collect. So most of these methods resort to using simulated images, where the raw images are sampled from the RGB images with the Bayer color filter array (CFA). However, there is a domain gap between simulated images and real images, which makes the learned networks less practical in the real world. To address this problem, we propose a simple and effective self-supervised learning framework for Bayer demosaicking. We observe that the Bayer CFA is periodic, and its four equivalent patterns can be transformed into each other through simple translation. Accordingly, we propose the concept of periodic-consistent demosaicking, which means that a demosaicking network should produce an identical demosaicked image for the same scene captured by the four equivalent patterns. Our framework can fine-tune existing demosaicking networks using only single raw images. We demonstrate the effectiveness of our framework on both clean and noisy images. Source code will be released.

Fine-Tuning for Bayer Demosaicking through Periodic-Consistent Self-Supervised Learning