Abstract:Memorability measures how easily an image is to be memorized after glancing, which may contribute to designing magazine covers, tourism publicity materials, and so forth. Recent works have shed light on the visual features that make generic images, object images or face photographs memorable. However, these methods are not able to effectively predict the memorability of outdoor natural scene images. To overcome this shortcoming of previous works, in this paper, we provide an attempt to answer: "what exactly makes outdoor natural scenes memorable". To this end, we first establish a large-scale outdoor natural scene image memorability (LNSIM) database, containing 2,632 outdoor natural scene images with their ground truth memorability scores and the multi-label scene category annotations. Then, similar to previous works, we mine our database to investigate how low-, middle- and high-level handcrafted features affect the memorability of outdoor natural scenes. In particular, we find that the high-level feature of scene category is rather correlated with outdoor natural scene memorability, and the deep features learnt by deep neural network (DNN) are also effective in predicting the memorability scores. Moreover, combining the deep features with the category feature can further boost the performance of memorability prediction. Therefore, we propose an end-to-end DNN based outdoor natural scene memorability (DeepNSM) predictor, which takes advantage of the learned category-related features. Then, the experimental results validate the effectiveness of our DeepNSM model, exceeding the state-of-the-art methods. Finally, we try to understand the reason of the good performance for our DeepNSM model, and also study the cases that our DeepNSM model succeeds or fails to accurately predict the memorability of outdoor natural scenes. Code: <a class="link-external link-http" href="http://github.com/JiaxinLu-home/Natural-Scene-Memorability-Dataset" rel="external noopener nofollow">this http URL</a>.

RUC at MediaEval 2018: Visual and Textual Features Exploration for Predicting Media Memorability.

Creating Memorable Video Summaries That Satisfy the User's Intention for Taking the Videos.

Overview of MediaEval 2020 Predicting Media Memorability Task: What Makes a Video Memorable?

Memorable and Rich Video Summarization

Learning User Interest with Improved Triplet Deep Ranking and Web-Image Priors for Topic-Related Video Summarization.

Multi-modal Ensemble Models for Predicting Video Memorability

Diffusing Surrogate Dreams of Video Scenes to Predict Video Memorability

Leveraging Audio Gestalt to Predict Media Memorability

Learning Computational Models of Video Memorability from Fmri Brain Imaging

Overview of the EEG Pilot Subtask at MediaEval 2021: Predicting Media Memorability

An Annotated Video Dataset for Computing Video Memorability

Visualization Assessment - A Machine Learning Approach.

The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System

Delving Deep into Engagement Prediction of Short Videos

Using Saliency and Cropping to Improve Video Memorability

GLA in MediaEval 2018 Emotional Impact of Movies Task

A Dataset and Baselines for Measuring and Predicting the Music Piece Memorability

Memory Enhanced Embedding Learning for Cross-Modal Video-Text Retrieval

Understanding and Predicting the Memorability of Outdoor Natural Scenes

Image memorability enhances social media virality

Visual Memorability for Robotic Interestingness via Unsupervised Online Learning