Abstract:We develop a deep-learning-based multicrane visual sorting system with virtualized programmable logic controllers (PLCs) in intelligent manufacturing, which enables the accurate location and suction of the materials on the conveyor belt. First, virtualized PLCs are deployed in the field and the cloud to break data islands for efficient communication between low-level devices. Second, artificial intelligence algorithms are integrated into the physical industrial control system in which cooperation between virtualized PLCs and the visual recognition model is developed to complete the industrial control closed loop. Third, we establish a visual recognition model in which object detection algorithms are used to process the original image and then obtain the position and type of the object in the pixel coordinate system. In addition, a new linear interpolation-based backpropagation neural network is presented to provide the transform relation between the pixel coordinate system and the world coordinate system that the crane needs to precisely suck the material. The whole system is applied in a time-sensitive network environment in a highly reliable and stable manner. The experimental prototype system demonstrates that high recognition accuracy can be achieved for the visual sorting system within an acceptable time frame. The accuracy of the sorting task reaches 96.5% and the average consumption time of each object is approximately 2.317 s when the speed of the conveyor belt is 5.2 m/min.

Research on Machine Vision Technology of High Speed Robot Sorting System based on Deep Learning

Industrial Robot Sorting System For Municipal Solid Waste

Research and Design of Machine Vision-based Workpiece Defect Sorting Robot

Research on Intelligent Logistics Sorting Robot Control Based on Machine Vision

The research of material sorting system based on Machine Vision

Workpieces Sorting System Based on Industrial Robot of Machine Vision

A General Overview of Intelligent Sorting System Based on Machine Vision

Location Recognition Algorithm for Vision-Based Industrial Sorting Robot Via Deep Learning.

Design of workpiece recognition and sorting system based on deep learning

An Intelligent Robot Sorting System by Deep Learning on RGB-D Image

Fast Visual Identification and Location Algorithm for Industrial Sorting Robots Based on Deep Learning

Design of YUMI Collaborative Robot Sorting System Based on Machine Vision

Auto-Sorting System Toward Smart Factory Based on Deep Learning for Image Segmentation

Application Research of Vision Sensor in Material Sorting Automation Control System

Visual Sorting of Express Parcels Based on Multi-Task Deep Learning

Multicrane Visual Sorting System Based on Deep Learning with Virtualized Programmable Logic Controllers in Industrial Internet

Research on Fast Recognition Method of Complex Sorting Images Based on Deep Learning

A Robot Sorting Method Based on Deep Learning

Study of High Speed Auto Sorting System for Food Production

A CNN-Based Visual Sorting System with Cloud-Edge Computing for Flexible Manufacturing Systems

Research and Development of Target Recognition and Location Crawling Platform Based on Binocular Vision