Real-time vision-based multiple object tracking of a production process: Industrial digital twin case study

Robert Ward,Payam Soulatiantork,Shaun Finneran,Ruby Hughes,Ashutosh Tiwari

DOI: https://doi.org/10.1177/09544054211002464

2021-03-12

Abstract:The adoption of Industry 4.0 technologies within the manufacturing and process industries is widely accepted to have benefits for production cycles, increase system flexibility and give production managers more options on the production line through reconfigurable systems. A key enabler in Industry 4.0 technology is the rise in Cyber-Physical Systems (CPS) and Digital Twins (DTs). Both technologies connect the physical to the cyber world in order to generate smart manufacturing capabilities. State of the art research accurately describes the frameworks, challenges and advantages surrounding these technologies but fails to deliver on testbeds and case studies that can be used for development and validation. This research demonstrates a novel proof of concept Industry 4.0 production system which lays the foundations for future research in DT technologies, process optimisation and manufacturing data analytics. Using a connected system of commercial off-the-shelf cameras to retrofit a standard programmable logic controlled production process, a digital simulation is updated in real time to create the DT. The system can identify and accurately track the product through the production cycle whilst updating the DT in real-time. The implemented system is a lightweight, low cost, customable and scalable design solution which provides a testbed for practical Industry 4.0 research both for academic and industrial research purposes.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to realize the practical application of Industry 4.0 technologies in the manufacturing industry, especially by constructing a real - time Digital Twin (DT) system to improve the transparency, flexibility and efficiency of the production process. Specifically, the research aims to demonstrate a vision - based multi - target tracking system that can realize real - time updating of the Digital Twin, thereby providing the ability of real - time monitoring and optimization for the production process. This system uses off - the - shelf cameras to transform the traditional production lines controlled by Programmable Logic Controllers (PLCs), creating a lightweight, low - cost, customizable and extensible design solution, providing a test platform for practical Industry 4.0 research in academia and industry.

This research fills the gap in existing research, that is, the lack of practical test platforms that can be used to develop and verify future practical Industry 4.0 technologies and research. These platforms can go beyond the theoretical structures and frameworks described in the literature and provide research - based practical results. Through this proof - of - concept implementation, the author hopes to provide a basic platform for future Digital Twin research, production process optimization and manufacturing data analysis.