Distributed Data Mining Based on Multi-agent System

Yan Zhuang,CHEN Ji-Ming,XU Dan,PAN Jin-Gui
2004-01-01
Abstract:The development of data mining is very fast, but most of the technology of the field is for central processing, which require the dataset to collect in a single data warehouse or database for mining. But with the development of network, data nowadays is stored over many machines in different geographical locations. Besides, the amount of data is getting larger and larger, mining such large dataset locally will take us unacceptable time locale memories costs, while this can be improved in the distributed mining systems with plenty compute resource. So it comes out the requirement of Distributed Data Mining(DDM). In DDM, We want to divide the large and complex task into several small and simple ones. Agent supports such ideals with its collaboration and communication. Agents can mining the different datasets locally and combine the partial results into the global result. The article is focus on the Distributed Data Mining Based on Multi-agent system. We will discuss the ideas of Distributed Data Mining and then show the advantages of agents for DDM. Then we propose the problems in the agent-based system for distributed data mining. At last we give some representative agent-based Distributed Data Mining systems.
What problem does this paper attempt to address?