Abstract:In light of advancements in information technology and the widespread impact of the COVID-19 pandemic, consumer behavior has undergone a significant transformation, shifting from traditional in-store shopping to the realm of online retailing. This shift has notably accelerated the growth of the online retail sector. An essential advantage offered by e-commerce lies in its ability to accumulate and analyze user data, encompassing browsing and purchase histories, through its recommendation systems. Nevertheless, prevailing methodologies predominantly rely on historical user data, which often lack the dynamism required to comprehend immediate user responses and emotional states during online interactions. Recognizing the substantial influence of visual stimuli on human perception, this study leverages eye-tracking technology to investigate online consumer behavior. The research captures the visual engagement of 60 healthy participants while they engage in online shopping, while also taking note of their preferred items for purchase. Subsequently, we apply statistical analysis and machine learning models to unravel the impact of visual complexity, consumer considerations, and preferred items, thereby providing valuable insights for the design of e-commerce platforms. Our findings indicate that the integration of eye-tracking data into e-commerce recommendation systems is conducive to enhancing their performance. Furthermore, machine learning algorithms exhibited remarkable classification capabilities when combined with eye-tracking data. Notably, during the purchase of hedonic products, participants primarily fixated on product images, whereas for utilitarian products, equal attention was dedicated to images, prices, reviews, and sales volume. These insights hold significant potential to augment the effectiveness of e-commerce marketing endeavors.

Inferring the Importance of Product Appearance with Semi-supervised Multi-modal Enhancement: A Step Towards the Screenless Retailing.

Inferring the Importance of Product Appearance: A Step Towards the Screenless Revolution

Better Than Humans: a Method for Inferring Consumer Shopping Intentions by Reading Facial Expressions

Matryoshka Peek: Toward Learning Fine-Grained, Robust, Discriminative Features for Product Search

Interpretable Multimodal Retrieval for Fashion Products.

A self-attention-based destruction and construction learning fine-grained image classification method for retail product recognition

Design of Smart Unstaffed Retail Shop Based on IoT and Artificial Intelligence

VSEM-SAMMI: An Explainable Multimodal Learning Approach to Predict User-Generated Image Helpfulness and Product Sales

Machine learning based approach for exploring online shopping behavior and preferences with eye tracking

When Fashion Meets Big Data: Discriminative Mining of Best Selling Clothing Features

Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-Modal Pretraining

Smart customer service in unmanned retail store enhanced by large language model

Cross-Scenario Clothing Retrieval And Fine-Grained Style Recognition

Image Score: Learning and Evaluating Human Preferences for Mercari Search

SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations

Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval

MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding

When relevance is not Enough: Promoting Visual Attractiveness for Fashion E-commerce

Complete the Look: Scene-based Complementary Product Recommendation

Attending to Customer Attention: A Novel Deep Learning Method for Leveraging Multimodal Online Reviews to Enhance Sales Prediction

Size Prediction for Online Clothing Shopping with Heterogeneous Information