Abstract:As one of the most popular topics currently, big data has played an important role in both academic research and practical applications. However, in the manufacturing industry, it is difficult to make full use of the research results for production optimization and/or management due to the low quality of real workshop data. Typical quality problems of real workshop data include the information match degree, missing recessive data, and false error identification. The conventional data analysis methods cannot handle most such issues because these methods fail to consider professional insights into and domain knowledge about the data. The main motivation of this paper is to explore methods for analyzing and evaluating big data with domain knowledge. For this purpose, real production data from a semiconductor manufacturing workshop are adopted as the data object. First, a series of data analysis techniques with domain knowledge are developed for diagnosing the imperfections. Then, corresponding data processing techniques with domain knowledge are proposed for solving those data quality problems according to specific flaws in the data. Furthermore, this paper proposes quantitative calculation methods of data value density to determine the extent to which data quality can be improved by the proposed data processing techniques. Case studies are conducted to demonstrate that data analysis and processing techniques with domain knowledge can effectively handle data quality problems of real workshop data in terms of the information match degree, missing recessive data, and false error identification. The work in this paper has the potential to be further extended and applied to other big data applications beyond the manufacturing industry.

Survey on Industrial Big Data Analysis: Models and Algorithms

Industrial Big Data Analytics: Challenges, Methodologies, and Applications

Industrial Big Data Analysis in Smart Factory: Current Status and Research Strategies

Content and Methods for Top-level Design of Big Data of Manufacturing Industry

Analyzing and Applying Big Data Technologies Based on Industrial Internet Data

A Survey of Big Data Research

Real-manufacturing-oriented Big Data Analysis and Data Value Evaluation with Domain Knowledge.

Big data analytics for intelligent manufacturing systems: A review

Deep research on big data index analysis method in intelligent manufacturing industry

Industrial large model: A survey

A Survey on Big Data Analytics Technologies.

A Survey of Dataflow Programming Models and Tools for Big Data Processing

Big data for cyber physical systems in industry 4.0: a survey

Data-Based Techniques Focused on Modern Industry: an Overview

Big Sensor Data: A Survey

A review of industrial big data for decision making in intelligent manufacturing

Privacy-Preserving and Secure Industrial Big Data Analytics: A Survey and the Research Framework

Complex industrial automation data stream mining algorithm based on random Internet of robotic things

Research on industrial economic information analysis based on decision tree algorithm in the era of big data

Application of Industrial Big Data for Smart Manufacturing in Product Service System Based on System Engineering Using Fuzzy DEMATEL

Analysis on the Endogenous Mechanism of Big Data and Tower Management Framework in Intelligent Manufacturing Enterprises