Abstract:The proliferation of cameras and their video data in retail marketing presents new opportunities for academics to study customer behavior with the newer video analytics tools. In collaboration with a large retail chain store in Asia, we obtained a unique video dataset collected from in-store cameras and combined it with customer-transaction data. By leveraging state-of-the-art computer vision techniques, we extracted features of customer demographics, physiological appearance, emotional expression, and contextual dimensions from the videos. We implemented facial-recognition and face-tracking algorithms to extract consumer behavior with a limited amount of human aid and obtained consumer facial features on a scalable basis. We propose herein a novel framework that can use machine learning and deep learning models to analyze combined video and customer-transaction data in any commercial context to predict customer purchase decisions. The results show that our framework could in fact be effectively used to make predictions of consumer offline purchase decisions, which successful outcome reveals the importance of incorporating emotional response into prediction. Overall, our study demonstrates how video-based content can be used to understand customer behavior along multiple dimensions on a scalable basis. Our findings 1) complement the literature that examined customer behavior by incorporating video data into analysis, 2) reveal the multi-dimensional drivers of purchase decisions in a retail setting, and 3) provide for an implementable video analytics tool that can be usefully employed by marketers and practitioners. An important managerial implication, furthermore, is that our framework can be incorporated into the omni-channel retailing context to provide a win-win for both firms and customers and generate possibilities for offline recommendations.

Assessment of Customers' Level of Interest

Analysis of Shopping Behavior Based on Surveillance System

Kinect Sensing of Shopping Related Actions.

Semantic Assessment of Shopping Behavior Using Trajectories, Shopping Related Actions, and Context Information

Better Than Humans: a Method for Inferring Consumer Shopping Intentions by Reading Facial Expressions

Poster: WatchYouWatch A Web-Cam Based Natural Customer Attention Tracking Shelf.

Consumer Shopping Emotion and Interest Database: a Unique Database with a Multimodal Emotion Recognition Method for Retail Service Robots to Infer Consumer Shopping Intentions Better Than Humans

Detecting Customers' Buying Events On A Real-Life Database

Analyzing and Predicting Consumer Response to Short Videos in E-Commerce

Shopping Behavior Recognition Using A Language Modeling Analogy

Smart Shelf System for Customer Behavior Tracking in Supermarkets

ASSESSMENT OF FACIAL EXPRESSIONS IN PRODUCT APPRECIATION

Predicting Consumer In-Store Purchase Using Real-Time Retail Video Analytics

Trajectory clustering based customer movement tracking in a supermarket

Retail store customer behavior analysis system: Design and Implementation

OPAM: Online Purchasing-behavior Analysis using Machine learning

A Software to Detect OCC Emotion, Big-Five Personality and Hofstede Cultural Dimensions of Pedestrians from Video Sequences

Eye-Tracking-Based Classification of Information Search Behavior Using Machine Learning: Evidence from Experiments in Physical Shops and Virtual Reality Shopping Environments

TagBooth: Deep shopping data acquisition powered by RFID tags

Multimodal Affect Analysis for Product Feedback Assessment

Tagbooth: Deep Shopping Data Acquisition Powered By Rpm Tags