Respiratory muscle involvement in infantile myotonic dystrophy.

E. Bossen,J. Shelburne,B. S. Verkauf

1974-04-01

Abstract:

What problem does this paper attempt to address?

A lightweight convolutional neural network based on dense connection for open-pit coal mine service identification using the edge-cloud architecture

DOI: https://doi.org/10.1186/s13677-023-00407-9

2023-03-08

Journal of Cloud Computing

Abstract:Remote sensing is an important technical tool for rapid detection of illegal mining behavior. Due to the complex features of open-pit coal mines, there are few studies about automatic extraction of open-pit coal mines. Based on Convolutional Neural Network and Dense Block, we propose a lightweight densely connected network-AD-Net for the extraction of open-pit coal mining areas from Sentinel-2 remote sensing images, and construct three sample libraries of open-pit coal mining areas in north-central Xinzhou City, Shanxi Province. The AD-Net model consists of two convolutional layers, two pooling layers, a channel attention module, and a Dense Block. The two convolutional layers greatly reduce the complexity of the model, and the Dense Block enhances the feature propagation while reducing the parameter computation. The application is designed in different modules that runs independently on different machines and communicate with each other. Furthermore, we create and build a unique remote sensing image service system that connects a remote datacentre and its associated edge networks, employing the edge-cloud architecture. While the datacentre acts as the cloud platform and is in charge of storing and processing the original remote sensing images, the edge network is largely utilised for caching, predicting, and disseminating the processed images. First, we find out the optimal optimizer and the optimal size of the input image by extensive experiments, and then we compare the extraction effect of AD-Net with AlexNet, VGG-16, GoogLeNet, Xception, ResNet50, and DenseNet121 models in the study area. The experimental results show that the combination of NIR, red, green, and blue band synthesis is more suitable for the extraction of the open-pit coal mine, and the OA and Kappa of AD-Net reach 0.959 and 0.918 respectively, which is better than other models and well balances the classification accuracy and running speed. With this design of edge-cloud, the proposed system not only evenly distributes the strain of processing activities across the edges but also achieves data efficiency among them, reducing the cost of data transmission and improving the latency.
Coal-Rock Image Recognition Method for Complex and Harsh Environment in Coal Mine Using Deep Learning Models

Sun Chuanmeng,Li Xinyu,Chen Jiaxin,Wu Zhibo,Li Yong

DOI: https://doi.org/10.1109/access.2023.3300243

IF: 3.9

2023-08-09

IEEE Access

Abstract:The unfavorable factors of underground coal such as dark light, uneven illumination, band shadowing greatly make it difficult to recognize the coal rock at the mining workface accurately. To solve this problem, this paper proposes the fuse attention mechanism's coal rock full-scale network (FAM-CRFSN) model. The deep extraction of coal rock semantic features is achieved by a multi-channel residual attention mechanism and a full-scale connection structure. Meanwhile, the balance between "deep" stacking and error back propagation is achieved by structures such as dilated convolution and Res2Block. Besides, a multi-dimensional loss function consisting of the cross-entropy loss, intersection over union, and multiscale structure similarity loss with pixel-level, area-level, and image-level expressions is established. Finally, the performance of the FAM-CRFSN network is tested with RGB coal rock images collected from an underground coal mining workface and superimposed with different proportions of gaussian noise and salt & pepper noise. The experimental results show that the FAM-CRFSN model can segment the coal rock regions accurately; at a noise intensity of 0.09, it achieves an MIOU of 85.77% and an MPA of 92.12%. Also, it achieves better accuracy and generalization performance than the mainstream semantic segmentation models. This study provides an important theoretical basis for promotes the unmanned and intelligent mining workface.

computer science, information systems,telecommunications,engineering, electrical & electronic
Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

Dongyang Zhao,Guoyong Su,Pengyu Wang

DOI: https://doi.org/10.1049/ipr2.13206

IF: 2.3

2024-08-14

IET Image Processing

Abstract:In the complex operation scene of coal mine, due to adverse environmental factors such as uneven illumination, high dust and mixed man‐machine multi‐target, the speed and measurement accuracy of traditional visual perception model decrease sharply. In order to solve the above problems, this study proposes to build a visual information perception system for coal mine comprehensive excavation working face for edge computing terminal and combines channel pruning algorithm, knowledge extraction algorithm and TensorRT acceleration engine to realize the lightweight deployment of visual perception model on edge intelligent devices. Aiming at the problems of low detection accuracy, high computational complexity and long‐time consumption of visual perception model in a complex mining environment, this research designs a visual information perception system of coal mine comprehensive excavation working face for an edge computing terminal. Firstly, the C3‐Fast feature extraction module, spatial pyramid pooling with cross‐stage partial connection (SPPCSPC) pooling module, bi‐directional feature pyramid network and lightweight decoupled detection head are used to optimize the YOLOv5s model, so as to construct the FSBD‐YOLOv5s multi‐object detection model. Secondly, the pruning and distillation algorithm is used to lighten the FSBD‐YOLOv5s model, and the model complexity is greatly reduced while maintaining the model detection accuracy. Further, the lightweight FSBD‐YOLOv5s model is migrated and deployed to the edge computing terminal platform and the TensorRT engine is used to accelerate model inference. Finally, experiments are carried out based on the data set of the coal mine comprehensive excavation working face. The experimental results show that on the edge computing terminal platform, the parameters and computational volume of the lightweight FSBD‐YOLOv5s model are reduced by 50.8% and 34.0%, while its detection accuracy and speed reach 94.0% and 43.7 fps, which can fully satisfy the requirements of the accuracy and real‐time for the coal mine engineering applications.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
Deep Feature Fusion for High-Resolution Aerial Scene Classification

Heng Wang,Yunlong Yu

DOI: https://doi.org/10.1007/s11063-019-10119-4

IF: 2.565

2019-01-01

Neural Processing Letters

Abstract:The rapid development of remote sensing technology let us acquire a large collection of remote sensing scene images with high resolution. Aerial scene classification has become a crucial problem for understanding high-resolution remote sensing imagery. In this letter, we propose a novel framework for aerial scene classification. Unlike some traditional methods in which the features are produced by using handcrafted feature descriptors, our proposed method uses the raw RGB network stream and the saliency coded network stream to extract two different types of informative features. Then, we further propose a deep feature fusion model to fuse these two sets of features for final classification. The comprehensive performance evaluation of our proposed method is tested on two publicly available remote sensing scene classification benchmarks, i.e., the UC-Merced dataset and the AID dataset. Experimental results show that our proposed method achieves satisfactory results and outperforms the state-of-the-art approaches.
A classification framework with multi-level fusion of object-based analysis and convolutional neural network: a case study for land use classification in mining areas

Jianghe Xing,Zhenwei Li,Jun Li,Shouhang Du,Wei Li,Chengye Zhang

DOI: https://doi.org/10.1080/10095020.2024.2336594

IF: 4.278

2024-04-27

Geo-spatial Information Science

Abstract:To enhance the accuracy of land use classification in mining areas, the Object-based Convolutional Neural Network (OCNN) method has been widely used. However, existing researches tend to neglect the importance of decision-level fusion, focusing only on feature-level fusion. This study proposes a new classification framework with Multi-level Fusion of Object-based analysis and CNN (MFOCNN) to achieves high-accuracy land use classification in mining areas. First, Simple Linear Iterative Cluster (SLIC) is employed to generate image objects, which serve as the basic unit for classification. Second, an improved DenseNet is proposed to extract deep features from image patches, which represent image objects, and provide the classification result. Third, handcrafted features including spectral, textural and geometric of the image objects are extracted and fused with the deep features to obtain the classification result with random forest classifier. Finally, the Dempster-Shafer (DS) evidence theory is applied to fuse the two previously described classification results at the decision-level to obtain the final result. Experiments conducted in the mining areas of Erdos using Gaofen-6 images demonstrate that the proposed MFOCNN achieves the best visual performance and accuracy among all tested methods. The MFOCNN, with its feature-level fusion and decision-level fusion, significantly improves the accuracy of land use classification in mining areas. The results suggest that the proposed MFOCNN is a promising method for achieving high-accuracy land use classification in mining areas.

remote sensing
Open-Pit Mine Extraction from Very High-Resolution Remote Sensing Images Using OM-DeepLab

Shouhang Du,Jianghe Xing,Jun Li,Shihong Du,Chengye Zhang,Yaqin Sun

DOI: https://doi.org/10.1007/s11053-022-10114-y

IF: 5.609

2022-01-01

Natural Resources Research

Abstract:utomatic extraction of open-pit mine (OM) areas from very high-resolution (VHR) remote sensing images is important for mineral resource management and monitoring. However, few good results have been achieved on this topic due to the highly heterogeneous OM environment. Based on DeepLabv3+, this study proposes a semantic segmentation network, named OM-DeepLab, for extracting OM from VHR images. First, Xception is employed as the backbone network to extract deep features from the input image patch. Second, Atrous Spatial Pyramid Pooling (ASPP) is attached to capture semantic features at multi-scales. In order to strengthen the learning of important information, attention mechanism is embedded following the ASPP. The foregoing operations constitute an encoder. Third, in order to retain detail information in the process of feature sampling, a low-level feature multi-scale fusion (LFMF) module is proposed to form the decoder by connecting shallow features and high-level features derived from encoder. For OM extraction from large-scale VHR images, a novel model prediction method is presented. The proposed network is utilized to achieve the initial OM extraction. Finally, post-processing containing an object-based Conditional Random Fields (CRF) is performed to refine the OM extraction results. To validate the proposed method, an OM dataset containing 136 OM areas from government department of mine supervision was applied in the experiments, and pixel-level F1-score of 0.912 was achieved. In addition, to evaluate the effectiveness of the algorithm in practical applications, a large-scale VHR image covering 736 km 2 was utilized in the experiments, and the pixel-level F1-score , object-level FalseAlarm , object-level MissingAlarm were 0.854, 0.132, 0.042, respectively. This study has practical significance in terms of automatically extracting OM from VHR images, which is beneficial to OM management and monitoring.
MFPA-Net: An efficient deep learning network for automatic ground fissures extraction in UAV images of the coal mining area

Xiao Jiang,Shanjun Mao,Mei Li,Hui Liu,Haoyuan Zhang,Shuwei Fang,Mingze Yuan,Chi Zhang

DOI: https://doi.org/10.1016/j.jag.2022.103039

IF: 7.5

2022-11-01

International Journal of Applied Earth Observation and Geoinformation

Abstract:Ground fissures caused by high-intensity underground coal mining activities will damage the ecological environment and endanger mine safety. The complicated surface conditions in coal mining areas make fissure detection labor-intensive work, and manual fissure extraction is inefficient, restricting the surface monitoring work. In this study, an efficient Deep Learning (DL) network named MFPA-Net (Multi-scale Feature Pyramids and Attention Network) is proposed to extract ground fissures in Unmanned Aerial Vehicle (UAV) images from the coal mining area automatically and accurately. In MFPA-Net, the Dilated Residual Networks (DRN) are used to extract diverse context information, the Dual Attention Mechanism (DAM) is introduced to integrate the dependence of pixels' spatial location and feature channels to generate high-level features, the Atrous Spatial Pyramid Pooling (ASPP) is utilized for mining multi-scale context information from high-level features, and the Multi-scale Feature Pyramid Network (MFPN) is designed to combine high-level and low-level features. Moreover, the Focal Tversky Loss Function is adopted to handle the unbalanced samples. To promote DL technologies application in the fissure monitoring of mining areas, the GFCMA (Ground Fissures of the Coal Mining Area) dataset is constructed. Experiments on GFCMA show that MFPA-Net can achieve high Precision (69.4%), Recall (70.7%), F1-Score (70.0%), and Mean Intersection over Union (MIoU) (75.1%) simultaneously, which significantly outperform traditional image processing methods and recently DL networks. Experiments on public pavement datasets Crack500 and DeepCrack prove MFPA-Net's high reliability and widespread applicability. The performance of the trained MFPA-Net on real large-scale scenarios demonstrates its practical value, strong robustness, and high efficiency. This study provides a solution for rapid monitoring of ground fissures under complicated surface conditions, which can serve the safe production and ecological restoration high-efficiently in mining areas.

remote sensing
Corticotropin releasing factor in the brain of the gymnotiform fish, Apteronotus leptorhynchus: immunohistochemical studies combined with neuronal tract tracing.

G. Zupanc,G. Zupanc,I. Horschke,D. Lovejoy

DOI: https://doi.org/10.1006/GCEN.1999.7273

IF: 3.255

1999-06-01

General and Comparative Endocrinology

Abstract:The expression of corticotropin-releasing factor (CRF) has been studied by immunohistochemistry in the brain of the gymnotiform fish, Apteronotus leptorhynchus. Labeled somata were found exclusively in the posterior subdivision of the nucleus preopticus periventricularis and in the hypothalamus anterioris, where these cells form a continuous cluster of neurons. Combination of anti-peptide immunohistochemistry with an in vitro tract-tracing technique confirmed that at least some of these neurons project to the pituitary. Additional terminal fields were present in the following areas of the telencephalon and the diencephalon: ventral subdivision of the ventral telencephalon, supracommissural subdivision of the ventral telencephalon, anterior subdivision of the nucleus preopticus periventricularis, inferior subdivision of the nucleus recessus lateralis, central posterior/prepacemaker nucleus, hypothalamus dorsalis and lateralis, medial subdivision 2 of the nucleus recessus lateralis, and in the region between the dorsal edge of the nucleus tuberis anterior on the one side and both the glomerular nucleus and the central nucleus of the inferior lobe on the other side. It is likely that the projection of CRF-expressing neurons of the posterior subdivision of the nucleus preopticus periventricularis/hypothalamus anterioris to the pituitary provides, similarly as in other fishes, the neural substrate for the activation of the hypothalamo-pituitary adrenal axis through CRF. In addition to this function, CRF may be involved in the regulation of several other processes, including neural control of communicatory behavior exerted by neurons of the central posterior/prepacemaker nucleus.
An Image Enhancement Method in Coal Mine Underground Based on Deep Retinex Network and Fusion Strategy

Zhuo Nan,Yun Gong

DOI: https://doi.org/10.1109/icivc52351.2021.9526933

2021-07-23

Abstract:Due to the high dust concentration and low illuminance in coal mines, the collected images have shortcomings such as low contrast and overall darkness, which brings severe challenges to subsequent image registration and target detection. This paper proposes a mine image enhancement method based on deep learning and fusion strategies. First, CNN is used to decompose the image into illumination components and reflection components, and then based on the reflectivity consistency constraint and the illumination mapping smoothness constraint, the enhancement network is used to enhance the image And adjust to obtain the initial enhanced image, and then introduce the camera response model to simulate the multiple exposure process, find the best exposure rate, generate a virtual over-exposure image, and finally combine the original low-illuminance image, use image block decomposition for reconstruction and fusion to obtain underground low-illuminance Enhance the image. The experimental results show that compared with mainstream enhancement algorithms, the enhancement strategy in this article is better than other algorithms in subjective and objective evaluation. It can improve the contrast and brightness of the image while avoiding color distortion and over-enhancement, making it a follow-up image The processing work laid the foundation.
A Semi-Supervised Deep Learning Framework for Change Detection in Open-Pit Mines Using SAR Imagery

Gianluca Murdaca,Federico Ricciuti,Alessio Rucci,Bertrand Le Saux,Alfio Fumagalli,Claudio Prati

DOI: https://doi.org/10.3390/rs15245664

IF: 5

2023-12-08

Remote Sensing

Abstract:Detecting and monitoring changes in open-pit mines is crucial for efficient mining operations. Indeed, these changes comprise a broad spectrum of activities that can often lead to significant environmental impacts such as surface damage, air pollution, soil erosion, and ecosystem degradation. Conventional optical sensors face limitations due to cloud cover, hindering accurate observation of the mining area. To overcome this challenge, synthetic aperture radar (SAR) images have emerged as a powerful solution, due to their unique ability to penetrate clouds and provide a clear view of the ground. The open-pit mine change detection task presents significant challenges, justifying the need for a model trained for this specific task. First, different mining areas frequently include various features, resulting in a diverse range of land cover types within a single scene. This heterogeneity complicates the detection and distinction of changes within open-pit mines. Second, pseudo changes, e.g., equipment movements or humidity fluctuations, which show statistically reliable reflectivity changes, lead to false positives, as they do not directly correspond to the actual changes of interest, i.e., blasting, collapsing, or waste pile operations. In this paper, to the best of our knowledge, we present the first deep learning model in the literature that can accurately detect changes within open-pit mines using SAR images (TerraSAR-X). We showcase the fundamental role of data augmentations and a coherence layer as a critical component in enhancing the model's performance, which initially relied solely on amplitude information. In addition, we demonstrate how, in the presence of a few labels, a pseudo-labeling pipeline can improve the model robustness, without degrading the performance by introducing misclassification points related to pseudo changes. The F1-Score results show that our deep learning approach is a reliable and effective method for SAR change detection in the open-pit mining sector.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Mingyang Yu,Haiqing Xu,Fangliang Zhou,Shuai Xu,Hongling Yin

DOI: https://doi.org/10.3390/ijgi12120468

IF: 3.4

2023-11-21

ISPRS International Journal of Geo-Information

Abstract:Accurate and efficient classification maps of urban functional zones (UFZs) are crucial to urban planning, management, and decision making. Due to the complex socioeconomic UFZ properties, it is increasingly challenging to identify urban functional zones by using remote-sensing images (RSIs) alone. Point-of-interest (POI) data and remote-sensing image data play important roles in UFZ extraction. However, many existing methods only use a single type of data or simply combine the two, failing to take full advantage of the complementary advantages between them. Therefore, we designed a deep-learning framework that integrates the above two types of data to identify urban functional areas. In the first part of the complementary feature-learning and fusion module, we use a convolutional neural network (CNN) to extract visual features and social features. Specifically, we extract visual features from RSI data, while POI data are converted into a distance heatmap tensor that is input into the CNN with gated attention mechanisms to extract social features. Then, we use a feature fusion module (FFM) with adaptive weights to fuse the two types of features. The second part is the spatial-relationship-modeling module. We designed a new spatial-relationship-learning network based on a vision transformer model with long- and short-distance attention, which can simultaneously learn the global and local spatial relationships of the urban functional zones. Finally, a feature aggregation module (FGM) utilizes the two spatial relationships efficiently. The experimental results show that the proposed model can fully extract visual features, social features, and spatial relationship features from RSIs and POIs for more accurate UFZ recognition.

geography, physical,remote sensing,computer science, information systems
Geological Remote Sensing Interpretation Using Deep Learning Feature and an Adaptive Multisource Data Fusion Network

Wei Han,Jun Li,Sheng Wang,Xinyu Zhang,Yusen Dong,Runyu Fan,Xiaohan Zhang,Lizhe Wang

DOI: https://doi.org/10.1109/tgrs.2022.3183080

IF: 8.2

2022-06-25

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Geological remote sensing interpretation can extract elements of interest from multiple types of images, which is vital in geological survey and mapping, especially in inaccessible regions. However, due to numerous classes, high interclass similarities, complex distributions, and sample imbalances of geological elements, the interpretation results of machine learning (ML)-based methods are understandably worse than manual visual interpretation. In addition, scholars in remote sensing have mainly carried out their works to interpret a single geological element category, such as mineral, lithological, soil, and structure. The interpretation of multiple geological elements is missing, which is more in line with the open world. To improve the interpretation results of ML-based methods and reduce the labor cost in geological survey and mapping, we propose a deep learning (DL)-feature-based adaptive multisource data fusion network (AMSDFNet) for the efficient interpretation of multiple geological remote sensing elements. The AMSDFNet has two branches for learning valuable spatial and spectral information from two kinds of data sources, in which the atrous spatial pyramid pooling (ASPP) operation and an attention block are applied to adaptively extract and fuse multiscale informative features. A hard example mining algorithm was also added to select important training examples to address sample imbalance. A large-scale region in western China with sufficient geological elements was set as the research area. The proposed model improved the two critical metrics by about 2% in the experiment section. As far as we know, this research work is the first time DL features and multisource remote sensing images have been utilized to simultaneously interpret geological elements of lithology, soil, surface water, and glaciers. The extensive experimental results demonstrated the superiority of DL features and our model in geological remote sensing interpretation.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
MFE-ResNet: A new extraction framework for land cover characterization in mining areas

Chen Wang,Tao Chen,Antonio Plaza

DOI: https://doi.org/10.1016/j.future.2023.04.001

IF: 7.307

2023-04-05

Future Generation Computer Systems

Abstract:Obtaining accurate information about land cover is a critical aspect of environmental monitoring in mining areas. However, the land cover in these areas is often complex and poses a challenge for analysis compared to other landscapes. This results in the difficulty of acquiring effective features and an unbalanced proportion of available training samples. We introduce a new approach to obtaining effective image features and enhancing the extraction of open-pit (OP) and waste-dump area (WDA) by using a mining feature-enhanced ResNet (MFE-ResNet). Our framework utilizes image objects as the basic units of high spatial resolution images (HSRIs) to better incorporate spatial and geometric information. The MFE-ResNet is an improvement of the ResNet18 architecture, forming a 26-layer network, and reducing the computational complexity by changing the convolutional kernel size. A squeeze-and-excitation (SE) module is also introduced to form an SE-residual structure to improve the network's ability to perceive the detailed mining area features. To alleviate the sample imbalance problem, a switchable normalization (SN) layer is applied to optimize the internal network structure. In addition, focal loss is introduced in the training process. We build an evaluation system that considers both the number of objects and their area. Compared with other six deep learning methods, our MFE-ResNet achieves the best overall accuracy in both large and small study areas. Specifically, MFE-ResNet obtained F values (F) of 87.73% and 97.28%, and quality values (Q) of 81.37% and 95.18% in OP extraction. The F of WDA extraction improved by 0.99% and 2.13%, and the quality (Q) improved by 0.98% and 9.56% compared to the second-ranked model. We show that our framework exhibits promising performance in monitoring mining areas.

computer science, theory & methods
Coal-gangue sound recognition using hybrid multi-branch CNN based on attention mechanism fusion in noisy environments

Qingjun Song,Wenchao Hao,Qinghui Song,Haiyan Jiang,Kai Li,Shirong Sun

DOI: https://doi.org/10.1038/s41598-024-74308-5

IF: 4.6

2024-10-11

Scientific Reports

Abstract:The coal-gangue recognition technology plays an important role in the intelligent realization of fully mechanized caving face and the improvement of coal quality. Although great progress has been made for the coal-gangue recognition in recent years, most of them have not taken into account the impact of the complex environment of top coal caving on recognition performance. Herein, a hybrid multi-branch convolutional neural network (HMBCNN) is proposed for coal-gangue recognition, which based on improved Mel Frequency Cepstral Coefficient (MFCC) as well as Mel spectrogram, and attention mechanism. Firstly, the MFCC and its smooth feature matrix are input into each branch of one-dimensional multi-branch convolutional neural network, and the spliced features are extracted adaptively through multi-head attention mechanism. Secondly, the Mel spectrogram and its first-order derivative are input into each branch of the two-dimensional multi-branch convolutional neural network respectively, and the effective time-frequency information is paid attention to through the soft attention mechanism. Finally, at the decision-making level, the two networks are fused to establish a model for feature fusion and classification, obtaining optimal fusion strategies for different features and networks. A database of sound pressure signals under different signal-to-noise ratios and equipment operations is constructed based on a large amount of data collected in the laboratory and on-site. Comparative experiments and discussions are conducted on this database with advanced algorithms and different neural network structures. The results show that the proposed method achieves higher recognition accuracy and better robustness in noisy environments.

multidisciplinary sciences
Object detection model of coal mine rescue robot based on multi-scale feature fusion

Guodong ZHAI,Cong REN,Shuai WANG,Zhongwen YUE,Tao PAN,Rujia JI

DOI: https://doi.org/10.13272/j.issn.1671-251x.2020050033

2020-01-01

Abstract:Traditional object detection model uses artificial object features, resulting in poor detection accuracy. Object detection model based on deep learning has high detection accuracy. However, for application of coal mine rescue robot with high real -time and accuracy requirements, the obtained image information is less and object features are not obvious, resulting in poor object detection effect. In order to improve accuracy and speed of object detection, on the basis of YOLO V3 model, an object detection model of coal mine rescue robot based on multi -scale feature fusion is proposed. The model mainly includes feature extraction module and feature fusion module. The feature extraction module uses hole bottleneck and multi -scale convolution to obtain more abundant image feature information, so as to enhance expression ability of object feature and improve object classification accuracy and detection speed. The feature fusion module introduces spatial attention mechanism into feature pyramid to effectively fuse high -level feature map with rich semantic information and low -level feature map with rich location information, which makes up for lack of position information expression ability of high -level feature map, and improves object positioning accuracy. The model is deployed on embedded NVIDIA Jetson TX2 platform in coal mine rescue robot for post -disaster environment object detection experiment. The detection accuracy is 88.73% and detection speed is 28 frames per second, which meet real -time and precision requirements of object detection of coal mine rescue robot.
Coal and gangue classification in actual environment of mines based on deep learning

Hengxuan Luan,Hengxuan Luan,Hao Xu,Wei Tang,Ying Tian,Qiang Zhang,Hengxuan Luan,Hao Xu,Wei Tang,Ying Tian,Qiang Zhang

DOI: https://doi.org/10.1016/j.measurement.2023.112651

IF: 5.6

2023-04-01

Measurement

Abstract:Existing deep learning technologies used to classify coal and gangue are mostly carried out in laboratory environment, which cannot meet the needs of actual coal mining process. To apply in actual environment, we propose an image window pixel information interaction method that synergizes the strengths of Convolutional Neural Networks (CNN) and Swin Transformer. Specifically, we propose a coal and gangue classification framework which combines traditional convolutional neural networks for feature extraction of coal and gangue, while optimizing the model using Batch Normalization (BN) layers and freezing fully connected layer (FFCL) weights. We evaluate our method using real data gathered from coal mines and compare results to some existing methods, demonstrating that our method can classify coal and gangue with high accuracy in actual environment, achieving approximately 95% in precision, recall, accuracy, and F1 Score. Our method paves the way for accurately classifying coal and gangue in actual environment of mines.

engineering, multidisciplinary,instruments & instrumentation
Analysis and construction of the coal and rock cutting state identification system in coal mine intelligent mining

Meichen Zhang,Lijuan Zhao,Baisheng Shi

DOI: https://doi.org/10.1038/s41598-023-30617-9

2023-03-01

Abstract:The recognition of cutting state of coal-rock is the key technology to realize "unmanned" mining in coal face. In order to realized real-time perception and accurate judgment of coal-rock cutting state information, this paper combined the field test sampling, construction technology of complex coal seam, virtual prototype technology, bidirectional coupling technology, data processing theory, image fusion method, and deep learning theory to carry out multi domain deep fusion experimental research on multi-source heterogeneous data of coal and rock cutting state. The typical complex coal seam containing gangue, inclusion, and minor fault in Yangcun mine of Yanzhou mining area was taken as the engineering object. The high-precision three-dimensional simulation model of the complex coal seam that can update and replace particles was constructed. Based on the simulation results of Discrete Element Method-Multi Flexible Body Dynamics (DEM-MFBD), the one-dimensional original vibration acceleration signals of the key components of the shearer cutting part were determined, including spiral drum, rocker arm shell, and square head. After transforming one-dimensional original signal data into two-dimensional time-frequency images by Short-time Fourier Transform, morphological wavelet image fusion technology was used to realize the effective fusion of characteristic information of spiral drum, rocker arm shell, and square head under different working conditions. Based on the deep learning theory, the DCGAN-RFCNN (Deep Convolutional Generative Adversarial Networks-Random Forest Convolutional Neural Networks) coal and rock cutting state recognition network model was constructed. Combining convolution neural network with random forest recognition classifier, RFCNN coal and rock cutting state recognition classification model was constructed, and the recognition network model was trained to obtain the model recognition results. Through the comparative experimental analysis of the RFCNN network model with different recognition network models and different synthetic sample numbers in the recognition network, the effectiveness of the recognition network model was verified. The results show that: When synthetic samples are not included in each working condition in the RFCNN model, the average recognition rate is 90.641%. With the increase of the number of synthetic samples, the recognition rate of coal and rock cutting state increases. When the number of synthetic samples added to each working condition reaches 5000, the recognition effect is the best, and the average recognition rate reaches 98.344%, which verifies the superiority of enriching the data set by using the improved DCGAN network. Also, the RFCNN outperformed the other variants: it obtained higher recognition accuracy by 25.085, 21.925 and 19.337%, respectively, over SVW, CNN, and AlexNet. Also, the experimental platform of shearer cutting coal and rock was built, where the coal and rock cutting state recognition network was trained and tested based on the migration learning theory. Through the statistical test results, the accuracy of coal and rock cutting state recognition is 98.64%, which realizes the accurate recognition of coal and rock cutting state.
Large-scale Foundation Model enhanced Few-shot Learning for Open-pit Minefield Extraction

Mengmeng Shao,Kaiyuan Li,Yi Wen,Xiao Xie

DOI: https://doi.org/10.1109/lgrs.2023.3342215

IF: 5.343

2024-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:High-resolution remote sensing data enables the extraction of fine-detailed boundaries of open-pit minefields, which is crucial for various applications such as ecological restoration, environment impact assessment, mining field disaster minoring, etc. In the last decade, a variety of convolutional neural networks (CNNs) and vision transformers (ViT) approaches have been developed for extracting the boundary and coverage of open-pit minefields. However, these deep learning approaches are always computationally expensive in pretraining and fine-tuning the network parameters. In addition, the diverse land cover/land use of different open-pit minefields poses a big challenge in building a large-scale benchmark dataset. To conduct efficient open-pit minefield extraction with limited labelled data, this paper employs a large-scale foundation model called Segment Anything (SAM) to develop the few-shot learning strategy for extracting open-pit minefield with slightly fine-tuning SAM and without fine-tuning SAM, respectively. The experiment demonstrates that the proposed SAM-enhanced few-shot learning outperforms pretraining the-state-of-the-art semantic segmentation approaches in terms of extraction precision and time cost. We hope our work can provide a solution for complex open-pit minefield extraction with a small number of labelled datasets.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Research on visual features and identification of coal and gangue in simulated underground mine environments

Luyao Wang,Jihong Gao,Xuewen Wang,Juanli Li,Rui Xia,Bo Li

DOI: https://doi.org/10.1080/19392699.2024.2418295

2024-10-24

International Journal of Coal Preparation and Utilization

Abstract:In underground mine environments, factors such as low light intensity, diffusion of dust particles, and coal slurry coverage interfere with coal gangue identification. To further realize coal-gangue sorting underground, we analyzed the coal-gangue visual characteristics coupled with the above factors. The analysis reveals that both smoke environments and coal slurry coverage tend to make the coal-gangue visual features more consistent. There are still differences in coal-gangue visual features under smoke environments, while coal slurry coverage leads to gangue exhibiting coal-related feature information. To improve the detection capability of coal gangue in underground environments, this study adopts a coal gangue recognition method based on the DG module and YOLOX-PSB network: Utilize the DG module to achieve dehazing and then use the YOLOX-PSB model for object detection. The proposed method was validated through ablation experiments, and the results showed that the detection accuracy reached 99.6%, with an FPS of 98. The proposed method enables real-time detection and exhibits the best robustness in complex environments, realizing reliable and efficient performance.

energy & fuels,mining & mineral processing
Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Baohua Yuan,Sukhjit Singh Sehra,Bernard Chiu

DOI: https://doi.org/10.3390/rs16213961

IF: 5

2024-10-25

Remote Sensing

Abstract:The advancement in satellite image sensors has enabled the acquisition of high-resolution remote sensing (HRRS) images. However, interpreting these images accurately and obtaining the computational power needed to do so is challenging due to the complexity involved. This manuscript proposed a multi-stream convolutional neural network (CNN) fusion framework that involves multi-scale and multi-CNN integration for HRRS image recognition. The pre-trained CNNs were used to learn and extract semantic features from multi-scale HRRS images. Feature extraction using pre-trained CNNs is more efficient than training a CNN from scratch or fine-tuning a CNN. Discriminative canonical correlation analysis (DCCA) was used to fuse deep features extracted across CNNs and image scales. DCCA reduced the dimension of the features extracted from CNNs while providing a discriminative representation by maximizing the within-class correlation and minimizing the between-class correlation. The proposed model has been evaluated on NWPU-RESISC45 and UC Merced datasets. The accuracy associated with DCCA was 10% and 6% higher than discriminant correlation analysis (DCA) in the NWPU-RESISC45 and UC Merced datasets. The advantage of DCCA was better demonstrated in the NWPU-RESISC45 dataset due to the incorporation of richer within-class variability in this dataset. While both DCA and DCCA minimize between-class correlation, only DCCA maximizes the within-class correlation and, therefore, attains better accuracy. The proposed framework achieved higher accuracy than all state-of-the-art frameworks involving unsupervised learning and pre-trained CNNs and 2–3% higher than the majority of fine-tuned CNNs. The proposed framework offers computational time advantages, requiring only 13 s for training in NWPU-RESISC45, compared to a day for fine-tuning the existing CNNs. Thus, the proposed framework achieves a favourable balance between efficiency and accuracy in HRRS image recognition.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

Respiratory muscle involvement in infantile myotonic dystrophy.

A lightweight convolutional neural network based on dense connection for open-pit coal mine service identification using the edge-cloud architecture

Coal-Rock Image Recognition Method for Complex and Harsh Environment in Coal Mine Using Deep Learning Models

Visual information perception system of coal mine comprehensive excavation working face for edge computing terminal

Deep Feature Fusion for High-Resolution Aerial Scene Classification

A classification framework with multi-level fusion of object-based analysis and convolutional neural network: a case study for land use classification in mining areas

Open-Pit Mine Extraction from Very High-Resolution Remote Sensing Images Using OM-DeepLab

MFPA-Net: An efficient deep learning network for automatic ground fissures extraction in UAV images of the coal mining area

Corticotropin releasing factor in the brain of the gymnotiform fish, Apteronotus leptorhynchus: immunohistochemical studies combined with neuronal tract tracing.

An Image Enhancement Method in Coal Mine Underground Based on Deep Retinex Network and Fusion Strategy

A Semi-Supervised Deep Learning Framework for Change Detection in Open-Pit Mines Using SAR Imagery

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Geological Remote Sensing Interpretation Using Deep Learning Feature and an Adaptive Multisource Data Fusion Network

MFE-ResNet: A new extraction framework for land cover characterization in mining areas

Coal-gangue sound recognition using hybrid multi-branch CNN based on attention mechanism fusion in noisy environments

Object detection model of coal mine rescue robot based on multi-scale feature fusion

Coal and gangue classification in actual environment of mines based on deep learning

Analysis and construction of the coal and rock cutting state identification system in coal mine intelligent mining

Large-scale Foundation Model enhanced Few-shot Learning for Open-pit Minefield Extraction

Research on visual features and identification of coal and gangue in simulated underground mine environments

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images