Ore image segmentation method using U-Net and Res_Unet convolutional networks

Xiaobo Liu,Yuwei Zhang,Hongdi Jing,Liancheng Wang,Sheng Zhao

DOI: https://doi.org/10.1039/c9ra05877j

IF: 4.036

2020-01-01

RSC Advances

Abstract:Image segmentation has been increasingly used to identify the particle size of crushed ore. How to accurately identify the ore particles in complex a environment is particularly important.

chemistry, multidisciplinary

What problem does this paper attempt to address?

An Ore Image Segmentation Method Based on RDU-Net Model

Dong Xiao,Xiwen Liu,Ba Tuan Le,Zhiwen Ji,Xiaoyu Sun

DOI: https://doi.org/10.3390/s20174979

2020-09-02

Abstract:The ore fragment size on the conveyor belt of concentrators is not only the main index to verify the crushing process, but also affects the production efficiency, operation cost and even production safety of the mine. In order to get the size of ore fragments on the conveyor belt, the image segmentation method is a convenient and fast choice. However, due to the influence of dust, light and uneven color and texture, the traditional ore image segmentation methods are prone to oversegmentation and undersegmentation. In order to solve these problems, this paper proposes an ore image segmentation model called RDU-Net (R: residual connection; DU: DUNet), which combines the residual structure of convolutional neural network with DUNet model, greatly improving the accuracy of image segmentation. RDU-Net can adaptively adjust the receptive field according to the size and shape of different ore fragments, capture the ore edge of different shape and size, and realize the accurate segmentation of ore image. The experimental results show that compared with other U-Net and DUNet, the RDU-Net has significantly improved segmentation accuracy, and has better generalization ability, which can fully meet the requirements of ore fragment size detection in the concentrator.
An Improved Boundary-Aware U-Net for Ore Image Semantic Segmentation

Wei Wang,Qing Li,Chengyong Xiao,Dezheng Zhang,Lei Miao,Li Wang

DOI: https://doi.org/10.3390/s21082615

IF: 3.9

2021-04-08

Sensors

Abstract:Particle size is the most important index to reflect the crushing quality of ores, and the accuracy of particle size statistics directly affects the subsequent operation of mines. Accurate ore image segmentation is an important prerequisite to ensure the reliability of particle size statistics. However, given the diversity of the size and shape of ores, the influence of dust and light, the complex texture and shadows on the ore surface, and especially the adhesion between ores, it is difficult to segment ore images accurately, and under-segmentation can be a serious problem. The construction of a large, labeled dataset for complex and unclear conveyor belt ore images is also difficult. In response to these challenges, we propose a novel, multi-task learning network based on U-Net for ore image segmentation. To solve the problem of limited available training datasets and to improve the feature extraction ability of the model, an improved encoder based on Resnet18 is proposed. Different from the original U-Net, our model decoder includes a boundary subnetwork for boundary detection and a mask subnetwork for mask segmentation, and information of the two subnetworks is fused in a boundary mask fusion block (BMFB). The experimental results showed that the pixel accuracy, Intersection over Union (IOU) for the ore mask (IOU_M), IOU for the ore boundary (IOU_B), and error of the average statistical ore particle size (ASE) rate of our proposed model on the testing dataset were 92.07%, 86.95%, 52.32%, and 20.38%, respectively. Compared to the benchmark U-Net, the improvements were 0.65%, 1.01%, 5.78%, and 12.11% (down), respectively.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
DDR-Unet: A High-Accuracy and Efficient Ore Image Segmentation Method

Fei Li,Xiaoyan Liu,Yufeng Yin,Zongping Li

DOI: https://doi.org/10.1109/tim.2023.3317480

IF: 5.6

2023-10-07

IEEE Transactions on Instrumentation and Measurement

Abstract:This article presents deformable dense residual Unet (DDR-Unet), a high-accuracy and efficient method for ore image segmentation (OIS). OIS is a crucial step in measuring ore particle size distribution (PSD), but it faces challenges due to variations in particle sizes, shapes, overlaps, and powder interference. DDR-Unet improves U-Net in three aspects: encoder, decoder, and loss function. The encoder adopts deformable convolution to capture ore features of different sizes and shapes. The decoder employs multilevel dense residual connections to fuse low- and high-level features. The loss function uses weight-adaptive binary cross-entropy (BCE) to balance the number of ore and nonore samples. We evaluate DDR-Unet on an ore dataset and two public datasets, and compare it with ten state-of-the-art segmentation methods. DDR-Unet outperforms all methods in OIS performance and PSD error. The code is available at https://github.com/lifeiwen/DDR-Unet-for-ore-image-segmentat.

engineering, electrical & electronic,instruments & instrumentation
An Improved Encoder–Decoder Network for Ore Image Segmentation

Hao Yang,Chao Huang,Long Wang,Xiong Luo

DOI: https://doi.org/10.1109/jsen.2020.3016458

IF: 4.3

2021-05-15

IEEE Sensors Journal

Abstract:Accurate segmentation of ore images plays a significant role in automatic geometric parameter detecting and composition analyzing of ore dressing progress. Semantic segmentation based on deep learning is a promising method for accurate ore image segmentation. However, the similar appearance with low contrast and blurry boundary of ores in image hamper segmentation accuracy. Moreover, it is difficult to train a deep network due to limited available ore images. In this work, an improved encoder-decoder network based on U-Net is proposed to handle above challenges. A contour awareness loss (CAL) is proposed to improve model sensitivity to misclassified pixels, pixels of similar appearance, and pixels near the boundary. The proposed scheme is verified on ore images by benchmarking against state-of-the-art segmentation methods. Experiment results show that the proposed scheme achieves 88.6% pixel-wise accuracy (PA) and 66.0% mean intersection over union (mIoU).

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Image segmentation of adhesive ores based on MSBA-Unet and convex-hull defect detection

Wei Wang,Qing Li,Dezheng Zhang,Jiawei Fu

DOI: https://doi.org/10.1016/j.engappai.2023.106185

IF: 8

2023-03-30

Engineering Applications of Artificial Intelligence

Abstract:Ore particle size information is a crucial indicator to evaluate the crushing quality and judge whether there are oversized ores on the conveyor belt. Accurately separating each ore is a critical prerequisite for obtaining high-precision particle size measurement (PSM) results. However, the large size variance and natural adhesion between ores pose a huge challenge to this task, imposing under-segmentation. Hence, this study proposes an automatic method that combines semantic segmentation and morphological operations to measure the ore particle size. Specifically, a novel multi-scale connection and boundary-aware U-Net model (MSBA-Unet) that classifies boundary pixels between adhesive ores more accurately is developed to segment ore images. Second, the convex-hull defect detection (CDD) method that divides the adhesive ores with a deep concave shape into two pieces is adopted to process the predicted masks further. The experimental results demonstrate that the MSBA-Unet architecture design and the CDD method can significantly improve the performance of separating adhesive ores of different sizes. Therefore, the under-segmentation problem is tremendously alleviated, and the ore PSM results agree well with the ground truth.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Efficient Segmentation with Texture in Ore Images Based on Box-supervised Approach

Guodong Sun,Delong Huang,Yuting Peng,Le Cheng,Bo Wu,Yang Zhang

2023-11-10

Abstract:Image segmentation methods have been utilized to determine the particle size distribution of crushed ores. Due to the complex working environment, high-powered computing equipment is difficult to deploy. At the same time, the ore distribution is stacked, and it is difficult to identify the complete features. To address this issue, an effective box-supervised technique with texture features is provided for ore image segmentation that can identify complete and independent ores. Firstly, a ghost feature pyramid network (Ghost-FPN) is proposed to process the features obtained from the backbone to reduce redundant semantic information and computation generated by complex networks. Then, an optimized detection head is proposed to obtain the feature to maintain accuracy. Finally, Lab color space (Lab) and local binary patterns (LBP) texture features are combined to form a fusion feature similarity-based loss function to improve accuracy while incurring no loss. Experiments on MS COCO have shown that the proposed fusion features are also worth studying on other types of datasets. Extensive experimental results demonstrate the effectiveness of the proposed method, which achieves over 50 frames per second with a small model size of 21.6 MB. Meanwhile, the method maintains a high level of accuracy compared with the state-of-the-art approaches on ore image dataset. The source code is available at \url{<a class="link-external link-https" href="https://github.com/MVME-HBUT/OREINST" rel="external noopener nofollow">this https URL</a>}.

Computer Vision and Pattern Recognition,Image and Video Processing
SV-UNet:A Lightweight Fracture Segmentation Model for Logging Images

Xian Bai,Huafeng Wang,Yuehai Wang

DOI: https://doi.org/10.1109/mlccim55934.2022.00049

2022-01-01

Abstract:The picking up of fractures in logging images is the focus of logging interpretation work. Most methods are based on mathematical statistics and traditional image segmentation, and the segmented area is not accurate enough to meet the practical needs of logging interpretation. with the development of semantic segmentation techniques proposed in other fields, it brings greater inspiration for specific target picking in logging images. In this study, when using the U-Net semantic segmentation model for fracture identification in electrical imaging logging images, poor feature utilisation and limited feature extraction capabilities of the model make it difficult to segment a single fracture in a sinusoidal shape and there is a problem of incoherent regional pixels. In order to segment the fracture region completely, this paper proposes a lightweight fracture segmentation algorithm SV-UNet, which makes full use of the advantages of U-Net and ShuffleNet V2 to enhance the network's feature transfer and utilisation and improve the feature learning capability. Experimental results on the fracture dataset of electrical imaging logging images show that the method achieves PA and mIoU of 97.18% and 78.68% respectively, which are 0.49% and 3.13% higher than those of U-Net, and has good segmentation performance.
Efficient image segmentation based on deep learning for mineral image classification

Yang Liu,Zelin Zhang,Xiang Liu,Lei Wang,Xuhui Xia

DOI: https://doi.org/10.1016/j.apt.2021.08.038

IF: 4.969

2021-10-01

Advanced Powder Technology

Abstract:Mineral image segmentation plays a vital role in the realization of machine vision based intelligent ore sorting equipment. However, the existing image segmentation methods still cannot effectively solve the problem of adhesion and overlap between mineral particles, and the segmentation performance of small and irregular particles still needs to be improved. To overcome these bottlenecks, we propose a deep learning based image segmentation method to segment the key areas in mineral images using morphological transformation to process mineral image masks. This investigation explores four aspects of the deep learning-based mineral image segmentation model, including backbone selection, module configuration, loss function construction, and its application in mineral image classification. Specifically, referring to the designs of U-Net, FCN, Seg Net, PSP Net, and DeepLab Net, this experiment uses different backbones as Encoder to building ten mineral image segmentation models with different layers, structures, and sampling methods. Simultaneously, we propose a new loss function suitable for mineral image segmentation and compare CNNs-based segmentation models' training performance under different loss functions. The experiment results show that the proposed mineral image segmentation has excellent segmentation performance, effectively solves adhesion and overlap between adjacent particles without affecting the classification accuracy. By using the Mobile Net as backbone, the PSP Net and DeepLab can achieve a high segmentation performance in mineral image segmentation tasks, and the 15 × 15 is the most suitable size for erosion element structure to process the mask images of the segmentation models.

engineering, chemical
Enhanced U-Net model for rock pile segmentation and particle size analysis

Zhen Yang,Hao Wu,Haojie Ding,Junming Liang,Li Guo

DOI: https://doi.org/10.1016/j.mineng.2023.108352

IF: 5.479

2023-09-02

Minerals Engineering

Abstract:Segmenting blasted stockpile particles in open-pit mines is essential for improving mining operations. However, complex rock textures often challenge traditional segmentation models. This paper presents an enhanced U-Net model that leverages depth-separable convolution and feature depth concatenation to enhance segmentation performance while reducing model complexity and training time. We evaluate our model on a homemade open pit burst pile ore segmentation dataset and report an average accuracy improvement of 1.53 % over the U-Net model. Our work contributes to the field of mining engineering and shows the potential of deep learning methods to improve mining operations.

engineering, chemical,mining & mineral processing,mineralogy
An Efficient MLP-based Point-guided Segmentation Network for Ore Images with Ambiguous Boundary

Guodong Sun,Yuting Peng,Le Cheng,Mengya Xu,An Wang,Bo Wu,Hongliang Ren,Yang Zhang

2024-02-27

Abstract:The precise segmentation of ore images is critical to the successful execution of the beneficiation process. Due to the homogeneous appearance of the ores, which leads to low contrast and unclear boundaries, accurate segmentation becomes challenging, and recognition becomes problematic. This paper proposes a lightweight framework based on Multi-Layer Perceptron (MLP), which focuses on solving the problem of edge burring. Specifically, we introduce a lightweight backbone better suited for efficiently extracting low-level features. Besides, we design a feature pyramid network consisting of two MLP structures that balance local and global information thus enhancing detection accuracy. Furthermore, we propose a novel loss function that guides the prediction points to match the instance edge points to achieve clear object boundaries. We have conducted extensive experiments to validate the efficacy of our proposed method. Our approach achieves a remarkable processing speed of over 27 frames per second (FPS) with a model size of only 73 MB. Moreover, our method delivers a consistently high level of accuracy, with impressive performance scores of 60.4 and 48.9 in~$AP_{50}^{box}$ and~$AP_{50}^{mask}$ respectively, as compared to the currently available state-of-the-art techniques, when tested on the ore image dataset. The source code will be released at \url{

Computer Vision and Pattern Recognition
Detection and segmentation of iron ore green pellets in images using lightweight U-net deep learning network

Jiaxu Duan,Xiaoyan Liu,Xin Wu,Chuangang Mao

DOI: https://doi.org/10.1007/s00521-019-04045-8

2019-01-24

Neural Computing and Applications

Abstract:In steel manufacturing industry, powdered iron ore is agglomerated in a pelletizing disk to form iron ore green pellets. The agglomeration process is usually monitored using a camera. As pellet size distribution is one of the major measures of product quality monitoring, pellets detection and segmentation from the image are the key steps to determine the pellet size. Traditional image processing algorithms are not only challenged by the complicated constitution of pellets, sediment and residuals in the image, but also by the harsh and unbalanced light reflection on the pellet centrum area and the background which results in tedious parameter adjustment work and pool performance. To solve these problems, we design a lightweight U-net deep learning network to automatically detect pellets from images and to obtain the probability maps of pellet contours. Compared to classic U-net, the proposed network has fewer parameters and introduces batch normalization layers, which greatly reduces the computing time and improves generalization ability of the network. A concentric circle model is then used to separate clumped contours of the pellets, and the pellets shapes are detected via ellipse fitting. The proposed method is verified using images captured from an industrial pelletizing disk, and its performance is compared with traditional methods and the classic U-net. Results show that the proposed method achieves better segmentation performance in DICE and ROC indexes and shows good robustness to uneven illumination. Tests on temporal image sequences demonstrate that the proposed method is effective in monitoring the pellet size distribution and the pellet shape as well. Results of this work have potential usage in online detection of iron ore green pellets and other types of particles.

computer science, artificial intelligence
Study on segmentation of blasting fragment images from open-pit mine based on U-CARFnet

Changyu Jin,Junyu Liang,Chunhui Fan,Lijun Chen,Qiang Wang,Yu Lu,Kai Wang

DOI: https://doi.org/10.1371/journal.pone.0291115

IF: 3.7

2023-09-14

PLoS ONE

Abstract:Bench blasting is the primary means of production in open-pit metal mines. The size of the resulting rock mass after blasting has a significant impact on production cost. Currently, the ore fragment size is obtained mainly through manual measurement or estimation with the naked eye, which is inefficient and inaccurate. This study proposes the U-CARFnet and U-Net models for segmenting blasting fragment images from open-pit mines based on an attention mechanism, residual learning module, and focal loss function. It compares this technique with traditional image segmentation ones and a variety of deep learning models to verify the efficacy of the proposed model. Experimental results show that the accuracy of the U-CARFnet model proposed in this paper reaches 97.11% in the performance evaluation, which shows better performance than the traditional image segmentation method. In this study, the U-CARFnet model is used in the application, and a superior performance is obtained, with an average segmentation error of 5.46%. The proposed approach provides an effective technique for statistically analyzing images of mine rock.

multidisciplinary sciences
Density-Aware U-Net for Unstructured Environment Dust Segmentation

Yao Fu,Ming Gao,Guotao Xie,Manjiang Hu,Chenfeng Wei,Rongjun Ding

DOI: https://doi.org/10.1109/jsen.2024.3355388

IF: 4.3

2024-03-15

IEEE Sensors Journal

Abstract:Vision-based segmentation methods rely heavily on image quality, and mining environments are full of dust, which greatly reduces visibility. Efficient and accurate segmentation of dusty regions in mining environments can improve the performance of unmanned vehicle environment perception. In this article, a dust segmentation method based on a novel density-aware nested U-structure convolutional neural network (DAUnet) is proposed. Compared with existing dust segmentation methods, our method has three advantages. First, we introduce the residual channel–spatial attention (RCSA) block. The block contains two attention layers and a residual structure, which can extract features more efficiently. Second, we introduce the difference expansion layer. This structure filters the predicted dust probabilities, eliminates pixels with lower probabilities, and then maps similar probability values to larger probability intervals, thus improving the network performance. Finally, for dust visualization, we use the predicted probabilities to reflect the dust density, which results in a smoother transition between the dust edges and the background. In addition, most of the current dust datasets are generated by simulation tools, and there is a lack of open-source real-world datasets. Therefore, we constructed the MineDust (MD) dataset based on a real open-pit mining environment. This dataset consists of dust-state images under different weather conditions and complex scenes. Experiments demonstrate that our algorithm can achieve 79.64% mIoU, which outperforms many existing segmentation methods.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Stone Segmentation Based on Improved U-Net Network

Ning Chen,Xinkai Ma,Haixia Luo,Jun Peng,Shangzhu Jin,Xiao Wu,Yongsheng Zhou

DOI: https://doi.org/10.1007/s11760-024-03201-5

2024-01-01

Abstract:In the contemporary stone aggregate industry and regulatory environment, there is a pressing need for a method that can quickly and efficiently calculate the average particle size of a batch of stones. The traditional manual sampling and measurement approach faces numerous challenges, such as the inability to accurately reflect the true average particle size of the stones, the risk of rough stones damaging measuring equipment, high labor costs, and potential inaccuracies in measurement data due to environmental factors like quarries. This study introduces computer vision technology, using image segmentation techniques to calculate stone particle sizes. The article innovates on the U-Net network, demonstrating through comparative experiments that these improvements significantly enhance the effectiveness of image segmentation. Accurate image segmentation is crucial for subsequent particle size calculations, not only advancing the development of the stone aggregate field but also promoting the intelligent evolution of the financial and tax supervision industry.
Diamond-Unet: A Novel Semantic Segmentation Network Based on U-Net Network and Transformer for Deep Space Rock Images

Guocheng Li,Bobo Xi,Yufei He,Tie Zheng,Yunsong Li,Changbin Xue,Jocelyn Chanussot

DOI: https://doi.org/10.1109/lgrs.2024.3397870

IF: 5.343

2024-05-22

IEEE Geoscience and Remote Sensing Letters

Abstract:Extracting rock objects from the surface of celestial bodies in deep space exploration environments is crucial for self-service path planning, navigation of detectors, and regional information evaluation. Most existing image semantic segmentation frameworks decrease the spatial resolution of the feature maps as networks deepen, resulting in limitations in detecting small targets and the inability to accurately segment boundary regions. In this letter, we propose a novel semantic segmentation network based on U-Net network and Transformer for deep space rock images, referred to as Diamond-Unet. This model integrates overcomplete and undercomplete branches and incorporates a global–local feature extraction (GLFE) module based on Transformer and convolutional neural network (CNN) technologies to effectively capture discriminative information. Furthermore, an innovative feature cross-fusion path (FCFP) is introduced to enhance information exchange between the dual-branch networks, enabling the capture of both fine-grained details and coarse-grained semantics in the full-scale image segmentation architecture. Experimental results demonstrate that the Diamond-Unet achieves the mean intersection over union (MIoU) scores of 79.32% and 93.43% on two public datasets, which are superior to the compared methods.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Real-Time Ferrogram Segmentation of Wear Debris Using Multi-Level Feature Reused Unet

Jie You,Shibo Fan,Qinghai Yu,Lianfu Wang,Zhou Zhang,Zheying Zong

DOI: https://doi.org/10.3390/s24082444

2024-04-11

Abstract:The real-time monitoring and fault diagnosis of modern machinery and equipment impose higher demands on equipment maintenance, with the extraction of morphological characteristics of wear debris in lubricating oil emerging as a critical approach for real-time monitoring of wear, holding significant importance in the field. The online visual ferrograph (OLVF) technique serves as a representative method in this study. Various semantic segmentation approaches, such as DeepLabV3+, PSPNet, Segformer, Unet, and other models, are employed to process the oil wear particle image for conducting comparative experiments. In order to accurately segment the minute wear debris in oil abrasive images and mitigate the influence of reflection and bubbles, we propose a multi-level feature reused Unet (MFR Unet) that enhances the residual link strategy of Unet for improved identification of tiny wear debris in ferrograms, leading to superior segmentation results.
Pore Extraction Method of Rock Thin Section Based on Attention U-Net

Mingjiang Li,Pan Zhang,Tao Hai

DOI: https://doi.org/10.1088/1742-6596/2467/1/012016

2023-01-01

Journal of Physics Conference Series

Abstract:This paper proposes a solution to the shortcomings of traditional segmentation methods. The labeling method uses the incomplete labeling method in weakly supervised labeling to simplify labeling and combines transfer learning to initialize the weight of the network in advance. According to the above ideas, an end-to-end deep learning model is trained. The fine rock particles have a greater segmentation impact, and in addition to that, when compared with the popular deep learning semantic segmentation approaches, they also have a significant improvement. The next phase is to continue improving the network by optimizing the parameters, with the number of network layers and the total number of parameters remaining unaltered. This requirement must be satisfied before moving on to the next stage. The capability of generalization enhances the impact of segmentation on particles as well as their accuracy. Experiments show that this method is significantly better than the traditional method for segmenting rock flakes with manual operation and has better results in the segmentation and extraction of fine particles compared with the mainstream convolutional neural network.
Research on anti-clogging of ore conveyor belt with static image based on improved Fast-SCNN and U-Net

Jingyi Liu,Hanquan Zhang,Dong Xiao

DOI: https://doi.org/10.1038/s41598-023-45186-0

IF: 4.6

2023-10-20

Scientific Reports

Abstract:This paper presents an improved Fast-Segmentation Convolutional Neural Network (Fast-SCNN) and U-Net networks based on the channel attention mechanism. While ensuring the speed of network detection, the accuracy of image segmentation is also considered. The experimental results show that the accuracy rate of improved Fast-SCNN based on the channel attention mechanism is greatly improved compared with the original Fast-SCNN, reaching 88.056%, and the mean intersection over union is also improved to a certain extent, reaching 81.087%, and the detection speed is better than the original Fast-SCNN network. The accuracy of improved U-Net network based on the channel attention mechanism is 0.91805, which is better than the original U-Net network. In terms of detection speed, the improved U-Net network based on channel attention mechanism has greatly improved compared with the original U-Net network, reaching 24.02 frames per second. In addition, a method of preventing clogging of ore conveyor belts based on static image detection is proposed in this paper. By judging and predicting the blockage of the ore conveyor belt. When the conveyor belt is about to be blocked or has been blocked, the fuzzy algorithm is used to control the ore conveyor belt to slow down and stop, to improve the safety and efficiency of the conveyor belt.

multidisciplinary sciences
Research on U-Net Medical Image Segmentation

Fangfang Song,Yimin Tian,Xue Gao,Shuai Yang,Meijun Zheng

DOI: https://doi.org/10.1117/12.2631325

2022-01-01

Abstract:With the rapid development of deep learning technology and medical technology, neural networks are widely used in the field of medical image segmentation. Among them, U-Net neural network has gradually become a research hotspot in the field of image segmentation because of its good segmentation performance. It provides doctors with a consistent method of quantifying lesions and is widely used in the field of medical image semantic segmentation. This article studies the U-Net network, learns theoretically from the U-Net network model and its basic principles, and then conducts experiments on three typical medical images of liver medical images, fundus blood vessel images, and lung nodule images to explain various types of medical images. The characteristics of the image and the difficulty of segmentation, and the performance of the U-Net network in the relevant image segmentation is verified. Finally, the problems existing in U-Net network are discussed, and the future development is prospected.
A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortification

Jian Wu,Wanli Liu,Chen Li,Tao Jiang,Islam Mohammad Shariful,Hongzan Sun,Xiaoqi Li,Xintong Li,Xinyu Huang,Marcin Grzegorzek

DOI: https://doi.org/10.48550/arXiv.2202.06465

2022-04-23

Abstract:Image analysis technology is used to solve the inadvertences of artificial traditional methods in disease, wastewater treatment, environmental change monitoring analysis and convolutional neural networks (CNN) play an important role in microscopic image analysis. An important step in detection, tracking, monitoring, feature extraction, modeling and analysis is image segmentation, in which U-Net has increasingly applied in microscopic image segmentation. This paper comprehensively reviews the development history of U-Net, and analyzes various research results of various segmentation methods since the emergence of U-Net and conducts a comprehensive review of related papers. First, this paper has summarized the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements that has introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can clearly see the dynamics of transmission of technological development and keep up with future trends in this interdisciplinary field.

Image and Video Processing,Computer Vision and Pattern Recognition

Ore image segmentation method using U-Net and Res_Unet convolutional networks

An Ore Image Segmentation Method Based on RDU-Net Model

An Improved Boundary-Aware U-Net for Ore Image Semantic Segmentation

DDR-Unet: A High-Accuracy and Efficient Ore Image Segmentation Method

An Improved Encoder–Decoder Network for Ore Image Segmentation

Image segmentation of adhesive ores based on MSBA-Unet and convex-hull defect detection

Efficient Segmentation with Texture in Ore Images Based on Box-supervised Approach

SV-UNet:A Lightweight Fracture Segmentation Model for Logging Images

Efficient image segmentation based on deep learning for mineral image classification

Enhanced U-Net model for rock pile segmentation and particle size analysis

An Efficient MLP-based Point-guided Segmentation Network for Ore Images with Ambiguous Boundary

Detection and segmentation of iron ore green pellets in images using lightweight U-net deep learning network

Study on segmentation of blasting fragment images from open-pit mine based on U-CARFnet

Density-Aware U-Net for Unstructured Environment Dust Segmentation

Stone Segmentation Based on Improved U-Net Network

Diamond-Unet: A Novel Semantic Segmentation Network Based on U-Net Network and Transformer for Deep Space Rock Images

Real-Time Ferrogram Segmentation of Wear Debris Using Multi-Level Feature Reused Unet

Pore Extraction Method of Rock Thin Section Based on Attention U-Net

Research on anti-clogging of ore conveyor belt with static image based on improved Fast-SCNN and U-Net

Research on U-Net Medical Image Segmentation

A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortification