DM technology and application in data processing

Xu Jiren,Qin Xiaolei,Niu Jihai,Jiang Congjun

DOI: https://doi.org/10.3969/j.issn.1000-0755.2008.03.004

2008-01-01

Abstract:This paper introduce DM(data mining) and work procedure,and then give some problems which are taken in data mining,at last give a concrete sample of data mining.

What problem does this paper attempt to address?

Design and Application of Data Mining System for WSA Process

Tao JIA,Hong-ye SU,Jian CHU

DOI: https://doi.org/10.3969/j.issn.1000-3932.2006.06.009

2006-01-01

Abstract:An implementation procedure for steady-state industrial process data mining based on realtime database is proposed and applied in a wet gas sulphuric acid (WSA) process. The established system can perform data preprocess and analysis automatically as specific object online or offline, assist the technicians by providing effective information for operational parameters optimization. The implementation procedure can be extended to establish the data mining system for general industrial process.
Research on Web Mining Technique Facing Electronic Business and Application

DONG De-min,HE Qin-ming

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.01.029

2006-01-01

Abstract:Enterprise and organize face a series of problems to capture information of web.Technique of solving these problems were summed up including web content mining,web structure mining and web usage mining.And some application of web mining was intro-duced,such as intelligent search engine,enterprise crisis management,client relation management and personalization service system.
Application of Data Mining in Supplier Evaluation System

Wenjun Yan

2006-01-01

Abstract:Data mining is a process to discover the patterns in which people are interested in quantities of raw data.It combines several of computer techniques.Using DM to evaluate suppliers is introduced.At first,the weight of each criterion is determined.Then data collected in production procedure are transformed into evaluation factors.They can also be used in finding latent useful patterns and sup-plier and forecasting to make supplier selection more reasonable and efficient.
Preliminary Research in Using the Technology of Data Mining to Analyze Remote Sensing Data

XF Zhang,XingLi,X Zhang,QX Tong,W Liu,LF Zheng

DOI: https://doi.org/10.1117/12.539951

2003-01-01

Abstract:Remote sensing data, especially the hyperspectral remote sensing data, characterize their great quantities. So how to deal wtih these data is a focus. Database has solved the problem of storing, searching, updating and maintaining of the data, but it is not satisfactory in disposing them. In recent years, the technology of data warehouse has great development. It can re-integrate, synthesize and separate the data of database, and use the searching pattern of multiple dimensions to realize data mining (DM). This technolgoy has been widely used in commerce to analyze the inner relationship of the numerous data and makes some remarkable achievements in decision supporting. Data warehouse and Data mining technology have been used in GIS. This article would give a set of complete steps and some general methods in using the DM to analyze the remote sensing data, especially in hyperspectral data. And it tries to do some preliminary exploration in using it to deeply analyze the potential relations among the acquired spectra, images and biology parameters of the experiments and get some anticipated possible results.
Data Mining: Algorithms and Problems

Xindong Wu

DOI: https://doi.org/10.1007/978-3-540-87656-4_1

2008-01-01

Abstract:Data mining, or knowledge discovery in databases (KDD), is an interdisciplinary field that integrates techniques from several research areas including machine learning, statistics, database systems, and pattern recognition, for the analysis of large volumes of possibly complex, highly-distributed and poorly-organized data. The prosperity of the data mining field may attribute to two essential reasons. Firstly, a huge amount of data is collected and stored everyday. On the one hand, along with the continuing development of advanced technologies in many domains, data is generated at enormous speeds. For examples, purchases data at department/grocery stores, bank/credit card transaction data, e-commerce data, Internet traffic data that describes the browsing history of Web users, remote sensor data from agricultural satellites, and gene expression data from microarray technology. On the other hand, the progress made in hardware technology allows today’s computer systems to store very large amounts of data. Secondly, with these large volumes of data at hand, the data owners have an imminent intent to turn them into useful knowledge. From a commercial viewpoint, the ultimate goal of the data owners is to gain more and pay less for their business activities. Under the competition pressure, they want to enhance their services, develop cost-effective strategies, and target the right group of potential customers. From a scientific viewpoint, when traditional techniques are infeasible in dealing with the raw data, data mining may help scientists in many ways, such as classifying and segmenting data. By applying the knowledge extracted from data mining, the business analyst may rate customers by their propensity to respond to an offer, the doctor may estimate the probability of an illness re-occurrence, the website publisher may display customized Web pages to individual Web users according to their browsing habit, and the geneticist may discover novel gene-gene interaction patterns. In this talk, we aim to provide a general picture for important data mining steps, topics, algorithms and challenges.
Designing and Implementing Algorithms of OLAP-based Data Mining Engine

田海东,李静,陆菊康

DOI: https://doi.org/10.3969/j.issn.1000-7024.2004.12.067

2004-01-01

Abstract:OLAP-based data mining is a new direction of DM. Considering unionizing OLAP technology with DM technology to do data mining at different levels of database or data warehouse, a framework of OLAP-based data mining system is designed. By studying the methods of data mining and OLAP operation, and the creation and materialization of data cube and by improving traditional DM algorithms, the algorithms of OLAP mining engine is put forward and implemented.
Big data management in the mining industry

Chong-chong Qi

DOI: https://doi.org/10.1007/s12613-019-1937-z

2020-02-01

Abstract:<p class="a-plus-plus">The mining industry faces a number of challenges that promote the adoption of new technologies. Big data, which is driven by the accelerating progress of information and communication technology, is one of the promising technologies that can reshape the entire mining landscape. Despite numerous attempts to apply big data in the mining industry, fundamental problems of big data, especially big data management (BDM), in the mining industry persist. This paper aims to fill the gap by presenting the basics of BDM. This work provides a brief introduction to big data and BDM, and it discusses the challenges encountered by the mining industry to indicate the necessity of implementing big data. It also summarizes data sources in the mining industry and presents the potential benefits of big data to the mining industry. This work also envisions a future in which a global database project is established and big data is used together with other technologies (i.e., automation), supported by government policies and following international standards. This paper also outlines the precautions for the utilization of BDM in the mining industry.</p>
The application of data mining on the process quality control

Shaoxiong Wu,Wei Xu,Biying Wu

2006-01-01

Abstract:With the development of computer and network technology, automation on production and inspection results in the accumulation of a large amount of data for an enterprise. The data as well as its information is an immense treasure. This paper introduces data mining process on quality control and discusses the application of data mining on the process quality control.
Innovation Path of Industrialization of Ethnic Minority Culture and Art Resources Based on DM Technology

Qingyi Meng,Hongbo Li

DOI: https://doi.org/10.1155/2022/4175339

IF: 1.43

2022-06-30

Mathematical Problems in Engineering

Abstract:In ethnic minority areas, the rich cultural color has strong attraction and market competitiveness. While making full use of it to promote the local economic development of ethnic minorities, it promotes the inheritance and protection of ethnic culture and the cultural exchange and integration among multiethnic groups. In this case, a new data mining (DM) technology came into being. DM is a new data processing technology for developing information resources. The object of DM is not only a database but also a file system, or any other data collection organized together. Based on DM technology, this paper studies the industrialization innovation of ethnic minority cultural and artistic resources, which carries out DM on the basis of rational utilization of ethnic minority cultural resources, boldly innovates, uses new scientific and technological achievements and new artistic expression means, establishes the people-oriented service concept of cultural and artistic resources, and takes the individual needs of the public and the scientific analysis results of big data as the basis to provide a satisfactory and ideal cultural and artistic feast for the public.

engineering, multidisciplinary,mathematics, interdisciplinary applications
Data Mining Support Systems

YL Zhao,JT Yao,YY Yao

DOI: https://doi.org/10.1117/12.543913

2004-01-01

Abstract:The main stream of research in data mining (or knowledge discovery in databases) focuses on algorithms and automatic or semi-automatic processes for discovering knowledge hidden in data. In this paper, we adopt a more general and goal oriented view of data mining. Data mining is regarded as a field of study covering the theories, methodologies, techniques, and activities with the goal of discovering new and useful knowledge. One of its objectives is to design and implement data mining systems. A miner solves problems of data mining manually, or semi-automatically by using such systems. However, there is a lack of studies on how to assist a miner in solving data mining problems. From the experiences and lessons of decision support systems, we introduce the concept of data mining support systems (DMSS). We draw an analogy between the field of decision-making and the field of data mining, and between the role of a manager and the role of a data miner. A DMSS is an active and highly interactive computer system that assists data mining activities. The needs and the basic features of DMSS are discussed.
A Data Mining Platform DBMiner and Its Applications

杨杰,叶晨洲,陈念贻

DOI: https://doi.org/10.3969/j.issn.1004-731x.2001.06.019

2001-01-01

Abstract:Data mining is an important tool for intelligent information processing. In this paper, a data mining platform DMBiner is introduced, its composition and principle are described. A layered data mining approach based on multiple knowledge models is presented. The algorithm for constructing decision trees based on the integrated heuristics improves the structure and classification accuracy of the decision trees induced. A GA-based algorithm for searching optimal parameters in n-dimension space can realize global optimization and improve the search efficiency. This data mining platform has satisfactorily applied in some areas. The applications in prediction of ternary intermetallic compound formation and in domestic medical remote ward are described.
Analysis on the Application of Data Mining in Science and Technology Information Management

Li Du,Yue Zhang,Qian Sun

DOI: https://doi.org/10.25236/iceeecs.2018.059

2018-01-01

Abstract:Science and technology information management has accumulated a great deal of data in its development process while improving the level of economic and social development and promoting the construction of a harmonious society. With data mining techniques, many useful data can be presented to provide reliable decision-making basis for management and decision. However, traditional information processing methods have been unable to cope with large data groups. Therefore, modern information technology must be used to conduct comprehensive research and discover the rules of association between data mining and science and technology information management, and carry on the correlation analysis between the science and technology project, personnel and result, in order to discover and speculate the potential law and relation between science and technology information, provide support in the science and technology information management decision-making, thus help the standardization of science and technology information management.
Application of Data Mining Technology in Enterprise Digital Human Resource Management

Da Zhou

DOI: https://doi.org/10.1155/2022/7611623

IF: 1.968

2022-06-23

Security and Communication Networks

Abstract:The purpose of this paper is to explore the practical application of big data comprehensive mining and analysis technology in the overall human resource management work of the entire enterprise under the gradual increase in the amount of enterprise data, so as to effectively improve the overall core strategic competitiveness of the entire enterprise and improve the overall human resource management level of the entire enterprise. This article adopts the risk management theory of quantifying the characteristics of business management data, analyzes various management models in modern human resource information system management, and analyzes the entire process of modern enterprise daily operation and various types of human resource system risk management and business data. Combined with quantitative management theory, it introduces the basic concepts of business data feature mining system theory and its most common six data analysis and calculation methods. The module design examples are organically combined, and the traditional data mining analysis theory and its application are extended to the enterprise human resource project management information system. Finally, the experimental results show that the use of big data mining and analysis technology can solve the problems of human resource quality management in small- and medium-sized enterprises. The independent quantitative data mining analysis model has achieved 25% improvement in the application effect of the analysis of the types of human resources in management enterprises, the prevention of internal talent loss in management enterprises, and the performance evaluation management system of enterprises.

computer science, information systems,telecommunications
Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

Chen Jian-hong,Ren Hao-ren,Sheng De-ren,Li Wei

DOI: https://doi.org/10.1631/jzus.2002.0538

2002-01-01

Journal of Zhejiang University SCIENCE A

Abstract:Nowadays, the scale of data normally stored in a database collected by Data Acquisition System (DAS) or Distributed Control System (DCS) in a power plant is becoming larger and larger. However there are abundant valuable knowledge hidden behind them. It will be beyond people's capacity to analyze and understand these data stored in such a scale database. Fortunately data-mining techniques are arising at the historic moment. In this paper, we explain the basic concept and general knowledge of data-mining; analyze the characteristics and research method of data-mining; give some typical applications of data-mining system based on power plant real-time database on intranct.
A Study Of Spatial Data Mining Architecture And Technology

he yueshun,xu wei

DOI: https://doi.org/10.1109/ICCSIT.2009.5234974

2009-01-01

Abstract:Spatial data mining is to extract implicit knowledge, spatial relations as well as other non-explicitly information which included in the spatial database but it exist with other model from the spatial database. Due to the complexity of spatial data and its application of the professional, and it gives challenges to spatial data mining. In the paper, the characteristics of spatial datum were analyzed, and the distinctions were presented between spatial data and the traditional relationship data, the traditional data mining processes and architecture were Analyzed and improved, A new process and architecture were presented for spatial datum data mining based on data warehouse, On the basis of the work, we design a prototype system for data mining of the spatial datum, We resolved and implemented the synergetic work in ingenious between the layers of the prototype system and between the components in the layer by the four-tier of J2EE architecture, Also, an implementation method was presented for the key technology.
Using Data Mining Techniques to Support Value Management Workshops in Construction

Qiping Shen,Jianfeng Guo,Jianping Zhang,Guiwen Liu

DOI: https://doi.org/10.1016/s1007-0214(08)70033-6

2008-01-01

Tsinghua Science & Technology

Abstract:Problem-solving processes in value management (VM) workshops in the construction industry are experience-based, and the quality of these workshops depends very much on the experience of the team members. The efficiency and effectiveness of VM workshops can be improved by better reusing the experience of previous VM cases and field knowledge. This paper describes a new approach to facilitate VM workshops in the construction industry using data mining (DM) techniques. The feasibility of integrating DM techniques with VM workshops in the construction industry is demonstrated in case studies. Examples are presented to illustrate different methods of applying DM tools in VM workshops. The results show that DM techniques can help team members in VM workshops to understand their problems more clearly and to generate more ideas for current problems.
Development and application of data mining system for chemical process

Zhang Quanling,Jin Xiaoming,Rong Gang,Su Hongye

DOI: https://doi.org/10.3969/j.issn.1001-4160.2008.07.001

2008-01-01

Abstract:The technical frame of data-mining system for chemical process is proposed.Based on algorithm of association rules with multiple minimum supports,the data-mining software ESP-Miner for chemical process is developed.The software can integrate process data from Distributed Control System(DCS),real-time database system,relational database system and other system by standard inter- face OPC Server,interface for mainstream real-time database,ODBC interface for relational database and standard text format inter face.Furthermore,process data can be input by man-machine conversion interface.The ESP-Miner software is successfully carried out in triazophos synthesis process.The production indicates that after data mining recipe and parameter are adopted,the product yield of triasophos is increased by 1.5% on average,and the average triazophos content increases from 80% to 83%.It brings about more eco- nomic benefits and social benefits for corporation.
The Technology and Methods of Spatial Data Mining and Their Application

田庆久,毛克彪

DOI: https://doi.org/10.3969/j.issn.1004-0323.2002.04.005

2002-01-01

Abstract:Remotely sensed data are so large that they can not be dealed with by human brains. Therefore, it becomes increasely important to find a method to get information automatically, quickly, efficiently from remotely sensed data. The technology of Data Mining was put up with in 1980's, and it has been used in many fields, such as finance fields, insurance fields, retail fields, medical and justice, etc. Data mining is the non-trivial process of identifying valid, novel, potentially useful, ultimately understandable patterns from huge volume of data. The spatial data mining is developed on the base of it. In a sense, spatial data mining resolves the problem of abundant data that human brain cannot be competent with. Furthermore, it can be used in artificial intelligence and pattern recognition fields. Spatial data mining differentiates from general data mining. Because Spatial data mining must consider the topology relation between the neighboring object, the direction and distance, etc. On the contrary, the general data mining consider every element in the database is independent. Nowadays, although the technology of the spatial data mining develops very quickly, it has not matured. There still are many things for us to do, especially, the extraction of the hedge and the feeble information from the remotely sensed images. This paper provides the background of spatial data mining, the general process of data mining, common algorithms, language and prospect.
Data Mining On A Kind Of Complexindustrial Process

Lh Gao,Sx Luo,Jq Qiu,Fc Li,Hc Ran

DOI: https://doi.org/10.1109/ICMLC.2003.1264451

2003-01-01

Abstract:In this paper, the accumulation of data and the feature of data on a kind of complex industrial process are considered through the production process of synthetic ammonia decarbonization in ammonia industry, and the basic idea and the structure of data mining model are given. All these discussions open up a new way for automatic control systems in industrial processes.
Data mining: an overview from a database perspective

Ming-Syan Chen,Jiawei Han,P.S. Yu

DOI: https://doi.org/10.1109/69.553155

IF: 9.235

1996-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Mining information and knowledge from large databases has been recognized by many researchers as a key research topic in database systems and machine learning, and by many industrial companies as an important area with an opportunity of major revenues. Researchers in many different fields have shown great interest in data mining. Several emerging applications in information-providing services, such as data warehousing and online services over the Internet, also call for various data mining techniques to better understand user behavior, to improve the service provided and to increase business opportunities. In response to such a demand, this article provides a survey, from a database researcher's point of view, on the data mining techniques developed recently. A classification of the available data mining techniques is provided and a comparative study of such techniques is presented.

computer science, information systems, artificial intelligence,engineering, electrical & electronic

DM technology and application in data processing

Design and Application of Data Mining System for WSA Process

Research on Web Mining Technique Facing Electronic Business and Application

Application of Data Mining in Supplier Evaluation System

Preliminary Research in Using the Technology of Data Mining to Analyze Remote Sensing Data

Data Mining: Algorithms and Problems

Designing and Implementing Algorithms of OLAP-based Data Mining Engine

Big data management in the mining industry

The application of data mining on the process quality control

Innovation Path of Industrialization of Ethnic Minority Culture and Art Resources Based on DM Technology

Data Mining Support Systems

A Data Mining Platform DBMiner and Its Applications

Analysis on the Application of Data Mining in Science and Technology Information Management

Application of Data Mining Technology in Enterprise Digital Human Resource Management

Data-mining Massive Real-Time Data in a Power Plant: Challenges, Problems and Solutions

A Study Of Spatial Data Mining Architecture And Technology

Using Data Mining Techniques to Support Value Management Workshops in Construction

Development and application of data mining system for chemical process

The Technology and Methods of Spatial Data Mining and Their Application

Data Mining On A Kind Of Complexindustrial Process

Data mining: an overview from a database perspective