Abstract:Real world Web mining applications usually have different requirements, such as massive data processing, low system latency, and high scalability. In order to meet these different requirements, we proposed a distributed text mining system with a layered architecture that divides the system functions into three layers, namely, the crawling and storage layer, the basic mining layer, and the analysis service layer. Message-oriented middleware are used between these layer components and services to make the communication in a loosely-coupled way. To conquer the data-intensive and storage failure problems, a distributed file system is used to store and manage the raw text data and various indexes. As a case study and example, the design and implementation of an experimental online topic detection application., which can be scaled to handle thousands of Internet news and forum channels and perform online analysis., is also discussed.

Web Data Mining System Based on Web Services

Design and Application of Data Mining System for WSA Process

Web mining of relations from XML and construct database schema

Research on Web Mining Technique Facing Electronic Business and Application

Catching potential customers: an example of Web-mining-aided e-commerce decision-making

Web mining: knowledge discovery on the Web

Wih - The Web Information Collecting System

A Distributed Text Mining System for Online Web Textual Data Analysis

Web Service-Oriented Manufacturing Resource Applications for Networked Product Development

A Research of Data Mining Technologies on Web Search

The Web-Based Manufacturing Resource Sharing Technologies And Application Services In Collaborative Product Development

Research on the Design and Implementation of Web Mining System

Interface Design for Web-based Data Mining Algorithm and Data Warehouse

WebME-Web mining environment

WEB-based Medical Data Mining Integration

The Research And Design Of Web Text Mining System Framework

KDW Survey:Web-based Data Mining

Service-Oriented Distributed Data Mining

Research and Design of Information Retrieval System Based on Web Data Mining

Data Mining System for Remote Sensor Image Based on Distributed Service Model

Manufacturing Deep Web Service Management: Exploring Semantic Web Technologies