Abstract:With the continuous development of internet economy and e-commerce, the scale of data produced by users on e-commerce platform is increasing explosively. Mining the behavior of individual users and group users from massive user behavior data and analyzing the value and law behind the data are of great significance to the development of e-commerce. Taking the user behavior log data of an e-commerce website as the data source, this paper, firstly, processes and analyzes the original dataset through the data filtering and storage module, and it uses the combination of Kafka and Flume to store the user behavior log with reasonable structure and complete fields in HDFS. Secondly, a hierarchical system of data warehouse is constructed in Hive, and each layer of log data is effectively mined and multidimensionally analyzed with the help of log mining technology. Finally, based on the big data framework and Bi tools, a data warehouse system is designed and implemented, which could store and analyze massive data and visually display the results. The system uses dimensional modeling to build a data warehouse hierarchical system to mine and analyze user behavior data through log mining algorithm deeply. The K-means clustering algorithm and RFM model are used to divide the user behavior characteristics in detail, and AARRR funnel model is used to analyze the logs in a modular way. Through the effective mining and multidimensional visual analysis of user behavior data, the behavior analysis of group users and individual users, as well as the analysis of commodity sales flow and sales linkage are realized, which provides support for internal decision-making and precision marketing.

Online Extracting Sessions of Frequent Users

Mining Access Patterns of Web Active User Based on Tree Structure

A Distributed Data Mining System Framework for Mobile Internet Access Log Based on Hadoop.

Web Usage Mining of Science Platform by Frequent Generalized Subsequences Method

Mining Long-Term Stealthy User Behaviors on High Speed Links

Catching potential customers: an example of Web-mining-aided e-commerce decision-making

Discovering More Accurate Frequent Web Usage Patterns

A Fuzzy Clustering Based Approach for Mining Usage Profiles from Web Log Data

Frequent Pattern Mining of Web Log Files Working Principles

Web Log Data Analysis by Enhanced Fuzzy C Means Clustering

Matrix Dimensionality Reduction for Mining Web Logs

Bottom-up Discovery of Frequent Rooted Unordered Subtrees

Web Usage Mining: Pattern Discovery and Forecasting

Research of Web User Access Pattern Mining Based on Session Classification

Algorithm of Mining Continuous Frequent Paths Based on Web Logs

Discovering Frequent Closed Episodes from an Event Sequence

Frameworks for Web Usage Mining

Data analysis in real-time supply chain based on frequent pattern mining

Session Identification Based on Time Interval in Web Log Mining

Local Nonnegative Matrix Factorization for Mining Typical User Session Profile

Visual Analysis of E-Commerce User Behavior Based on Log Mining