Abstract:Background: Image memorability refers to the phenomenon where certain images are more likely to be remembered than others. It is a quantifiable and intrinsic image attribute, defined as the likelihood of being remembered upon a single exposure. Despite advances in understanding human visual perception and memory, it is unclear what features contribute to an image's memorability. To address this question, we propose a deep learning-based computational modeling approach. Methods: We modeled the subjective experience of visual memorability using an autoencoder based on VGG16 Convolutional Neural Networks (CNNs). The model was trained on images for one epoch, to simulate the single-exposure condition used in human memory tests. We investigated the relationship between memorability and reconstruction error, assessed latent space representations distinctiveness, and developed a Gated Recurrent Unit (GRU) model to predict memorability likelihood. Interpretability analysis was conducted to identify key image characteristics contributing to memorability. Results: Our results demonstrate a significant correlation between the images memorability score and autoencoder's reconstruction error, and the robust predictive performance of its latent representations. Distinctiveness in these representations correlated significantly with memorability. Additionally, certain visual characteristics, such as strong contrasts, distinctive objects, and prominent foreground elements were among the features contributing to image memorability in our model. Conclusions: Images with unique features that challenge the autoencoder's capacity are inherently more memorable. Moreover, these memorable images are distinct from others the model has encountered, and the latent space of the encoder contains features predictive of memorability.

Changing the Image Memorability: From Basic Photo Editing to GANs

Learn, Imagine and Create: Text-to-Image Generation from Prior Knowledge.

Controlling Memorability of Face Images

Generating Memorable Images Based on Human Visual Memory Schemas

MemoryGAN: GAN Generator As Heterogeneous Memory for Compositional Image Synthesis

Modeling Visual Memorability Assessment with Autoencoders Reveals Characteristics of Memorable Images

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Understanding (Un)Intended Memorization in Text-to-Image Generative Models

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Image memorability enhances social media virality

Predicting memorability of face photographs with deep neural networks

Generative Outpainting To Enhance the Memorability of Short-Form Videos

Defining Image Memorability using the Visual Memory Schema

What Images are More Memorable to Machines?

Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation

Memory Replay GANs: Learning to Generate Images from New Categories Without Forgetting

Embedding Space Selection for Detecting Memorization and Fingerprinting in Generative Models

Multiple Generative Adversarial Networks Analysis for Predicting Photographers' Retouching

Evaluation and Comparison of Emotionally Evocative Image Augmentation Methods

Memory augmentation with an adaptive cognitive interface

Memory Triggers: Unveiling Memorization in Text-To-Image Generative Models through Word-Level Duplication