Blast furnace raw material granularity recognition model based on deep learning and multimodal fusion of 3D point cloud
Fumin Li,Jucai Hou,Song Liu,Xiaojie Liu,Lianji Liu,Qing Lyu
DOI: https://doi.org/10.1007/s00371-024-03449-5
IF: 2.835
2024-05-26
The Visual Computer
Abstract:Accurate online recognition of raw material particle size is crucial for the green and efficient operation of blast furnaces. In this study, a high-resolution image acquisition system for blast furnace raw materials was established, and multiple batches of samples were collected for sintered ore and coke particle size analysis. To improve the robustness and generalization capability of the model, image enhancement techniques such as translation, scaling, cropping, random rotation, and brightness adjustment were applied to obtain the basic image datasets for sintered ore and coke. Among four mainstream instance segmentation algorithms, YOLACT++ was selected as the base network. To enhance the recognition accuracy of raw material similarities and subtle features, improvements were made to the YOLACT++ backbone network by replacing the original ResNet101 with DetNet59, and a composite loss function was constructed. Based on the enhanced YOLACT++ algorithm, a particle size recognition model was developed, achieving accuracy rates (PA), recall rates (Recall), F1 scores, and mean intersection over union (MIoU) all exceeding 90%. To address issues such as misidentification of sintered ore voids and over-segmentation in the particle size recognition model, an optimized 3D point cloud concavity and convexity segmentation algorithm was employed. By re-inputting the segmented 3D point cloud results into the particle size recognition model, problems such as void misidentification and over-segmentation were effectively resolved, achieving the multimodal fusion of deep learning and 3D point clouds and improving the accuracy and stability of sintered ore particle size recognition.
computer science, software engineering