Consumer Behaviour in Retail: Next Logical Purchase using Deep Neural Network

Ankur Verma
DOI: https://doi.org/10.48550/arXiv.2010.06952
2020-10-14
Abstract:Predicting future consumer behaviour is one of the most challenging problems for large scale retail firms. Accurate prediction of consumer purchase pattern enables better inventory planning and efficient personalized marketing strategies. Optimal inventory planning helps minimise instances of Out-of-stock/ Excess Inventory and, smart Personalized marketing strategy ensures smooth and delightful shopping experience. Consumer purchase prediction problem has generally been addressed by ML researchers in conventional manners, either through recommender systems or traditional ML approaches. Such modelling approaches do not generalise well in predicting consumer purchase pattern. In this paper, we present our study of consumer purchase behaviour, wherein, we establish a data-driven framework to predict whether a consumer is going to purchase an item within a certain time frame using e-commerce retail data. To model this relationship, we create a sequential time-series data for all relevant consumer-item combinations. We then build generalized non-linear models by generating features at the intersection of consumer, item, and time. We demonstrate robust performance by experimenting with different neural network architectures, ML models, and their combinations. We present the results of 60 modelling experiments with varying Hyperparameters along with Stacked Generalization ensemble and F1-Maximization framework. We then present the benefits that neural network architectures like Multi Layer Perceptron, Long Short Term Memory (LSTM), Temporal Convolutional Networks (TCN) and TCN-LSTM bring over ML models like Xgboost and RandomForest.
Machine Learning,Information Retrieval
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper primarily aims to address the issue of consumer behavior prediction in large-scale retail enterprises, specifically predicting the next purchase behavior of consumers. Accurate prediction of consumer purchasing patterns aids in better inventory planning and efficient personalized marketing strategies. Traditional machine learning methods (such as recommendation systems and other conventional methods) perform poorly in tackling this problem, especially when dealing with a large number of nonlinear interaction parameters. The main contributions of the paper include: 1. **Application of Various Deep Learning Architectures**: The study explored various deep learning architectures (such as Multi-Layer Perceptron, Long Short-Term Memory networks (LSTM), Temporal Convolutional Networks (TCN), etc.) combined with tree-based machine learning algorithms (such as Xgboost and Random Forest) to predict the next purchase behavior of consumers. 2. **Model Performance under Different Hyperparameter Configurations**: Demonstrated the performance of individual models under different hyperparameter configurations. 3. **Stacked Generalization Framework**: Implemented a stacked generalization framework as an ensemble method, where a new model learns how to combine the predictions of multiple existing models. 4. **F1 Maximization Algorithm Design**: Designed and implemented an F1 maximization algorithm to optimize the purchase probability threshold at the consumer level. The paper validated the performance of different models through a series of experiments and ultimately concluded that deep learning models outperform traditional machine learning models in terms of accuracy.