Abstract:Memorability measures how easily an image is to be memorized after glancing, which may contribute to designing magazine covers, tourism publicity materials, and so forth. Recent works have shed light on the visual features that make generic images, object images or face photographs memorable. However, these methods are not able to effectively predict the memorability of outdoor natural scene images. To overcome this shortcoming of previous works, in this paper, we provide an attempt to answer: "what exactly makes outdoor natural scenes memorable". To this end, we first establish a large-scale outdoor natural scene image memorability (LNSIM) database, containing 2,632 outdoor natural scene images with their ground truth memorability scores and the multi-label scene category annotations. Then, similar to previous works, we mine our database to investigate how low-, middle- and high-level handcrafted features affect the memorability of outdoor natural scenes. In particular, we find that the high-level feature of scene category is rather correlated with outdoor natural scene memorability, and the deep features learnt by deep neural network (DNN) are also effective in predicting the memorability scores. Moreover, combining the deep features with the category feature can further boost the performance of memorability prediction. Therefore, we propose an end-to-end DNN based outdoor natural scene memorability (DeepNSM) predictor, which takes advantage of the learned category-related features. Then, the experimental results validate the effectiveness of our DeepNSM model, exceeding the state-of-the-art methods. Finally, we try to understand the reason of the good performance for our DeepNSM model, and also study the cases that our DeepNSM model succeeds or fails to accurately predict the memorability of outdoor natural scenes. Code: <a class="link-external link-http" href="http://github.com/JiaxinLu-home/Natural-Scene-Memorability-Dataset" rel="external noopener nofollow">this http URL</a>.

Facial Memorability Prediction Fusing Geometric and Texture Features

A new facial feature based on the fusion of texture and shape characteristics

Predicting memorability of face photographs with deep neural networks

Learning Computational Models of Video Memorability from Fmri Brain Imaging

A Discriminative Face Geometric Feature-Based Face Recognition

Learning Low-Rank Sparse Representations With Robust Relationship Inference for Image Memorability Prediction

What Images are More Memorable to Machines?

Understanding and Predicting the Memorability of Outdoor Natural Scenes

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

Feature representations useful for predicting image memorability

Diffusing Surrogate Dreams of Video Scenes to Predict Video Memorability

Controlling Memorability of Face Images

Embedding Space Selection for Detecting Memorization and Fingerprinting in Generative Models

Fusing Normal Vector and Curvature Features on the Mesh for 3D Facial Expression Recognition.

AMNet: Memorability Estimation with Attention

Modeling Visual Memorability Assessment with Autoencoders Reveals Characteristics of Memorable Images

Computational Facial Attractiveness Prediction by Aesthetics-Aware Features

3-D Facial Expression Recognition via Attention-Based Multichannel Data Fusion Network

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

Exploring Relationship Between Face and Trustworthy Impression Using Mid-level Facial Features.