Abstract:With the exponential expansion of e-commerce, an immense volume of historical sales data has been generated and amassed. This influx of data has created an opportunity for more accurate sales forecasting. While various sales forecasting methods and models have been applied in practice, existing ones often struggle to fully harness sales data and manage significant fluctuations. As a result, they frequently fail to make accurate predictions, falling short of meeting enterprise needs. Therefore, it is imperative to explore new models to enhance the accuracy and efficiency of sales forecasting. In this paper, we introduce a model tailored for sales forecasting based on a Transformer with encoder–decoder architecture and multi-head attention mechanisms. We have made specific modifications to the standard Transformer model, such as removing the Softmax layer in the last layer and adapting input embedding, position encoding, and feedforward network components to align with the unique characteristics of sales forecast data and the specific requirements of sales forecasting. The multi-head attention mechanism in our proposed model can directly compute the dot product results in a single step, addressing long-term time-dependent computation challenges while maintaining lower time complexity and greater interpretability. This enhancement significantly contributes to improving the model’s accuracy and efficiency. Furthermore, we provide a comprehensive formula representation of the model for the first time, facilitating better understanding and implementation. We conducted experiments using sales datasets that incorporate various factors influencing sales forecasts, such as seasons, holidays, and promotions. The results demonstrate that our proposed model significantly outperforms seven selected benchmark methods, reducing RMSLE, RMSWLE, NWRMSLE, and RMALE by approximately 48.2%, 48.5%, 45.2, and 63.0%, respectively. Additionally, ablation experiments on the multi-head attention and the number of encoder–decoders validate the rationality of our chosen model parameters.

The Study of a Sales Forecast Model Based on SA-LSTM

Power Load Prediction Model Based on Long Short Term Memory and Sparrow Search Algorithm

Achieving Sales Forecasting with Higher Accuracy and Efficiency: A New Model Based on Modified Transformer

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

A Combination Model for Time Series Prediction using LSTM via Extracting Dynamic Features Based on Spatial Smoothing and Sequential General Variational Mode Decomposition

A New Feature Based Deep Attention Sales Forecasting Model for Enterprise Sustainable Development

Short-Term Demand Forecast of E-Commerce Platform Based on ConvLSTM Network

Prognostication of Sales by Auto Encoder and Long-Term Short Memory

Research on financial assets transaction prediction model based on LSTM neural network

Hybrid convolutional long short‐term memory models for sales forecasting in retail

Sales Forecast of New Energy Vehicles in China Based on LSTM Model

Application of LSTM and CONV1D LSTM Network in Stock Forecasting Model

Livestream sales prediction based on an interpretable deep-learning model

A novel attLSTM framework combining the attention mechanism and bidirectional LSTM for demand forecasting

Research on Sales Forecasting Method for Transmission Parts of Customized Production

Enhancing Vegetable Sales Forecasting with A CNN-LSTM-Transformer Hybrid Model

A Short-Term Residential Load Forecasting Model Based on LSTM Recurrent Neural Network Considering Weather Features

Stock Market Analysis and Prediction Using LSTM: A Case Study on Technology Stocks

Sales Forecast of Marketing Brand Based on BP Neural Network Model

Stock Prediction Based on Optimized LSTM and GRU Models

An Economic Forecasting Method Based on the LightGBM-Optimized LSTM and Time-Series Model