Abstract:Enhancement of Cultural Heritage such as historical images is very crucial to safeguard the diversity of cultures. Automated colorization of black and white images has been subject to extensive research through computer vision and machine learning techniques. Our research addresses the problem of generating a plausible colored photograph of ancient, historically black, and white images of Nepal using deep learning techniques without direct human intervention. Motivated by the recent success of deep learning techniques in image processing, a feed-forward, deep Convolutional Neural Network (CNN) in combination with Inception- ResnetV2 is being trained by sets of sample images using back-propagation to recognize the pattern in RGB and grayscale values. The trained neural network is then used to predict two a* and b* chroma channels given grayscale, L channel of test images. CNN vividly colorizes images with the help of the fusion layer accounting for local features as well as global features. Two objective functions, namely, Mean Squared Error (MSE) and Peak Signal-to-Noise Ratio (PSNR), are employed for objective quality assessment between the estimated color image and its ground truth. The model is trained on the dataset created by ourselves with 1.2 K historical images comprised of old and ancient photographs of Nepal, each having 256 × 256 resolution. The loss i.e., MSE, PSNR, and accuracy of the model are found to be 6.08%, 34.65 dB, and 75.23%, respectively. Other than presenting the training results, the public acceptance or subjective validation of the generated images is assessed by means of a user study where the model shows 41.71% of naturalness while evaluating colorization results.

Grayscale Images Colorization with Convolutional Neural Networks

Scene Guided Colorization Using Neural Networks

Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks

ColorUNet: A convolutional classification approach to colorization

Detecting Colorized Images via Convolutional Neural Networks: Toward High Accuracy and Good Generalization

Colorization Using Neural Network Ensemble.

Image Colorization Using a Deep Convolutional Neural Network

Attention-Based Grayscale Image Colorization

Colorful Image Colorization

Colorizing Grayscale CT Images of Human Lungs Using Deep Learning Methods

Deep Koalarization: Image Colorization using CNNs and Inception-ResNet-v2

Colourization of Black and White Images using Deep Learning

Auto-Colorization of Historical Images Using Deep Convolutional Neural Networks

Automated Colorization of a Grayscale Image with Seed Points Propagation.

Image Colorization Algorithm Based on Deep Learning

Real-Time User-Guided Image Colorization with Learned Deep Priors

SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network

Natural Grayscale Image Colorization via Local Sparse Coding

Broad Colorization

Automatic Image Colourizer

A learning-based approach for automatic image and video colorization