[Senile cataract, a permeability cataract].

H. Pau

Abstract:

What problem does this paper attempt to address?

A Multiscale Nonlocal Feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images.

Guoqi Liu,Jiajia Wang,Dong Liu,Baofang Chang

DOI: https://doi.org/10.1109/tim.2023.3265107

IF: 5.6

2023-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Breast lesion segmentation in ultrasound images is of great importance since it can help us to characterize and localize lesion regions. However, low-quality imaging, blurred boundary, and variable lesion shapes bring challenges to accurate segmentation. In recent years, many U-Net variants have been proposed and successfully applied to breast lesion segmentation. However, these methods suffer from two limitations: 1) ignoring the ability to capture rich global context information and 2) introducing extra complex operations. To alleviate these challenges, we propose a multiscale nonlocal feature extraction network (MNFE-Net) for accurately segmenting breast lesions. The core idea includes three points: 1) parallel encoder (PE) models long-range dependencies; 2) multiscale feature module (MFM) refines local features without introducing extra complex operations; and 3) global feature guidance module (GFGM) extracts global semantic information. MNFE-Net mainly has the following advantages: 1) the method has excellent performance for segmentation of malignant breast lesions; 2) the PE increases network parameters without significantly decreasing inference speed; and 3) the method is easy to understand and execute. Extensive experiment results with six state-of-the-art (SOTA) methods on three public breast ultrasound datasets demonstrate the superior segmentation performance of our proposed MNFE-Net.
MEF-UNet: An end-to-end ultrasound image segmentation algorithm based on multi-scale feature extraction and fusion

Mengqi Xu,Qianting Ma,Huajie Zhang,Dexing Kong,Tieyong Zeng

DOI: https://doi.org/10.1016/j.compmedimag.2024.102370

IF: 7.422

2024-03-18

Computerized Medical Imaging and Graphics

Abstract:Ultrasound image segmentation is a challenging task due to the complexity of lesion types, fuzzy boundaries, and low-contrast images along with the presence of noises and artifacts. To address these issues, we propose an end-to-end multi-scale feature extraction and fusion network (MEF-UNet) for the automatic segmentation of ultrasound images. Specifically, we first design a selective feature extraction encoder, including detail extraction stage and structure extraction stage, to precisely capture the edge details and overall shape features of the lesions. In order to enhance the representation capacity of contextual information, we develop a context information storage module in the skip-connection section, responsible for integrating information from adjacent two-layer feature maps. In addition, we design a multi-scale feature fusion module in the decoder section to merge feature maps with different scales. Experimental results indicate that our MEF-UNet can significantly improve the segmentation results in both quantitative analysis and visual effects.

engineering, biomedical,radiology, nuclear medicine & medical imaging
MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation

Ruichao Wu,Xiangyu Lu,Zihuan Yao,Yide Ma

DOI: https://doi.org/10.1016/j.compbiomed.2024.108616

Abstract:Breast tumor segmentation in ultrasound images is fundamental for quantitative analysis and plays a crucial role in the diagnosis and treatment of breast cancer. Recently, existing methods have mainly focused on spatial domain implementations, with less attention to the frequency domain. In this paper, we propose a Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network (MFMSNet). Specifically, we utilize Octave convolutions instead of conventional convolutions to effectively separate high-frequency and low-frequency components while reducing computational complexity. Introducing the Multi-frequency Transformer block (MF-Trans) enables efficient interaction between high-frequency and low-frequency information, thereby capturing long-range dependencies. Additionally, we incorporate Multi-scale interactive fusion module (MSIF) to merge high-frequency feature maps of different sizes, enhancing the emphasis on tumor edges by integrating local contextual information. Experimental results demonstrate the superiority of our MFMSNet over seven state-of-the-art methods on two publicly available breast ultrasound datasets and one thyroid ultrasound dataset. In the evaluation of MFMSNet, tests were conducted on the BUSI, BUI, and DDTI datasets, comprising 130 images (BUSI), 47 images (BUI), and 128 images (DDTI) in the respective test sets. Employing a five-fold cross-validation approach, the obtained dice coefficients are as follows: 83.42 % (BUSI), 90.79 % (BUI), and 79.96 % (DDTI). The code is available at https://github.com/wrc990616/MFMSNet.
Giardiasis in adults. Studies on jejunum and immunoglobulins.

J. Gupta,K. S. Nampoothiry,P. C. Sen,P. Shukla,S. Rao,G. Pant,H. Bajpai

Abstract:
MDFN: A Multi-level Dynamic Fusion Network with self-calibrated edge enhancement for lung nodule segmentation

Yu Cai,Zhao Liu,Yu Zhang,Zhuo Yang

DOI: https://doi.org/10.1016/j.bspc.2023.105507

IF: 5.1

2023-10-08

Biomedical Signal Processing and Control

Abstract:Precise segmentation of lung nodules from the surrounding tissues provides radiologists with distinct boundary details, instrumental to the meticulous diagnosis and subsequent treatment of lung cancer. Although extensively applied in practice, the existing deep learning approaches are generally confronted with under-segmentation for intractable nodules with heterogeneous textures, blurred boundaries, adhesive structures and the loss of crucial spatial and edge details during the deep convolutional encoding. Aiming at these issues, we take full advantage of the complementarity between edge and region to enhance the restoration of complex edges and propose a 2D Multi-level Dynamic Fusion Network (MDFN) for precise lung nodule segmentation and fine-grained edge details. Firstly, we innovatively construct a multi-scale spatial and channel feature selection module (MSCFS) to enrich the receptive fields and capture highly correlated multi-scale contexts. Secondly, a self-calibrated encoder with MSCFS is adopted to establish the spatial dependency between long distance and channel to avert the loss of both global and local features. Thirdly, a novel deep feature fusion decoder is designed to separately generate the edge and region features of the same and different levels and dynamically integrate them to restore fine-grained nodule edge morphology. Various experiments on LUNA16 public dataset confirm that MDFN outperforms other advanced methods on the quantitative index appraisal and qualitative visualization analysis, with an average DSC of 89.19% and Hausdorff distance of 2.353 mm. By contrast, with the powerful blend of multi-level edge and region features, MDFN achieves more smooth and consistent boundary details, especially for nodules adhesive to surrounding issues.

engineering, biomedical
MFD-Net: Modality Fusion Diffractive Network for Segmentation of Multimodal Brain Tumor Image

Qingfan Hou,Yanjun Peng,Zhuofei Wang,Jiao Wang,Jian Jiang

DOI: https://doi.org/10.1109/JBHI.2023.3318640

Abstract:Automatic brain tumor segmentation using multi-parametric magnetic resonance imaging (mpMRI) holds substantial importance for brain diagnosis, monitoring, and therapeutic strategy planning. Given the constraints inherent to manual segmentation, adopting deep learning networks for accomplishing accurate and automated segmentation emerges as an essential advancement. In this article, we propose a modality fusion diffractive network (MFD-Net) composed of diffractive blocks and modality feature extractors for the automatic and accurate segmentation of brain tumors. The diffractive block, designed based on Fraunhofer's single-slit diffraction principle, emphasizes neighboring high-confidence feature points and suppresses low-quality or isolated feature points, enhancing the interrelation of features. Adopting a global passive reception mode overcomes the issue of fixed receptive fields. Through a self-supervised approach, the modality feature extractor effectively utilizes the inherent generalization information of each modality, enabling the main segmentation branch to focus more on multimodal fusion feature information. We apply the diffractive block on nn-UNet in the MICCAI BraTS 2022 challenge, ranked first in the pediatric population data and third in the BraTS continuous evaluation data, proving the superior generalizability of our network. We also train separately on the BraTS 2018, 2019, and 2021 datasets. Experiments demonstrate that the proposed network outperforms state-of-the-art methods.
MLFEU-NET: A Multi-scale Low-level Feature Enhancement Unet for breast lesions segmentation in ultrasound images

Runqi Tang,Chongyang Ning

DOI: https://doi.org/10.1016/j.bspc.2024.106931

IF: 5.1

2024-09-28

Biomedical Signal Processing and Control

Abstract:Breast lesions constantly threaten the health of females. Segmentation methods of breast lesions are important for clinical diagnosis, and neural networks have been widely used and played a significant role in this field. However, false detections and miss detections still exist due to the variability in the shape and location of breast lesions, artifacts and noise in breast ultrasound (BUS) images, and structural defects in conventional segmentation networks. In this paper, a multi-scale low-level feature enhancement Unet (MLFEU-net) structure is presented, consisting of the U-net structure, low-level feature enhancement block (LFEB), and a parallel multiscale feature fusion (PMFF) module. Specifically, LFEB enhances the detail information during shallow downsampling and further feature selection. Meanwhile, in the neck of Unet, PMFF module uses different scales of dilation convolution to provide different sizes of sensory fields, and to efficiently merge shallow and deep features filtered, leads to more accurate segmentation results. To evaluate the MLFEU-net's segmentation ability, five quantitative metrics were used on two breast ultrasound datasets, and it was compared with several advanced segmentation techniques. The results illustrate that our approach surpasses other methods in performance. Moreover, robustness experiments validate the effectiveness of our approach in achieving robust segmentation of breast lesions.

engineering, biomedical
MFU-Net: a deep multimodal fusion network for breast cancer segmentation with dual-layer spectral detector CT

Aisen Yang,Lulu Xu,Na Qin,Deqing Huang,Ziyi Liu,Jian Shu

DOI: https://doi.org/10.1007/s10489-023-05090-6

IF: 5.3

2024-03-10

Applied Intelligence

Abstract:With the development of medical imaging technologies, breast cancer segmentation remains challenging, especially when considering multimodal imaging. Compared to a single-modality image, multimodal data provide additional information, contributing to better representation learning capabilities. This paper applies these advantages by presenting a deep learning network architecture for segmenting breast cancer with multimodal computed tomography (CT) images based on fusing U-Net architectures that can learn richer representations from multimodal data. The multipath fusion architecture introduces an additional fusion module across different paths, enabling the model to extract features from different modalities at each level of the encoding path. This approach enhances segmentation performance and produces more robust results compared to using a single modality. The study reports experiments conducted on multimodal CT images from 36 patients for training, validation, and testing purposes. The results demonstrate that the proposed model ouperforms the U-Net architecture when considering different combinations of input image modalities. Specifically, when combining two distinct CT modalities, the ZE and IoNW input combination yields the highest Dice score of 0.8546.

computer science, artificial intelligence
MDCC-Net: Multiscale double-channel convolution U-Net framework for colorectal tumor segmentation

Suichang Zheng,Xue Lin,Weifeng Zhang,Baochun He,Shuangfu Jia,Ping Wang,Huijie Jiang,Jingjing Shi,Fucang Jia

DOI: https://doi.org/10.1016/j.compbiomed.2020.104183

IF: 7.7

2021-03-01

Computers in Biology and Medicine

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Purpose</h3><p>Multiscale feature fusion is a feasible method to improve tumor segmentation accuracy; however, current multiscale networks have two common problems: 1. Some networks only allow feature fusion between encoders and decoders of the same scale. It is obvious that such feature fusion is not sufficient. 2. Some networks have too many dense skip connections and too much nesting between the coding layer and the decoding layer, which causes some features to be lost and means that not enough information will be learned from multiple scales. To overcome these two problems, we propose a multiscale double-channel convolution U-Net (MDCC-Net) framework for colorectal tumor segmentation.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>In the coding layer, we designed a dual-channel separation and convolution module and then added residual connections to perform multiscale feature fusion on the input image and the feature map after dual-channel separation and convolution. By fusing features at different scales in the same coding layer, the network can fully extract the detailed information of the original image and learn more tumor boundary information.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>The segmentation results show that our proposed method has a high accuracy, with a Dice similarity coefficient (DSC) of 83.57%, which is an improvement of 9.59%, 6.42%, and 1.57% compared with nnU-Net, U-Net, and U-Net++, respectively.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>The experimental results show that our proposed method has good performance in the segmentation of colorectal tumors and is close to the expert level. The proposed method has potential clinical applicability.</p>

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Expansive Receptive Field and Local Feature Extraction Network: Advancing Multiscale Feature Fusion for Breast Fibroadenoma Segmentation in Sonography

Yongxin Guo,Yufeng Zhou

DOI: https://doi.org/10.1007/s10278-024-01142-6

2024-05-31

Abstract:Fibroadenoma is a common benign breast disease that affects women of all ages. Early diagnosis can greatly improve the treatment outcomes and reduce the associated pain. Computer-aided diagnosis (CAD) has great potential to improve diagnosis accuracy and efficiency. However, its application in sonography is limited. A network that utilizes expansive receptive fields and local information learning was proposed for the accurate segmentation of breast fibroadenomas in sonography. The architecture comprises the Hierarchical Attentive Fusion module, which conducts local information learning through channel-wise and pixel-wise perspectives, and the Residual Large-Kernel module, which utilizes multiscale large kernel convolution for global information learning. Additionally, multiscale feature fusion in both modules was included to enhance the stability of our network. Finally, an energy function and a data augmentation method were incorporated to fine-tune low-level features of medical images and improve data enhancement. The performance of our model is evaluated using both our local clinical dataset and a public dataset. Mean pixel accuracy (MPA) of 93.93% and 86.06% and mean intersection over union (MIOU) of 88.16% and 73.19% were achieved on the clinical and public datasets, respectively. They are significantly improved over state-of-the-art methods such as SegFormer (89.75% and 78.45% in MPA and 83.26% and 71.85% in MIOU, respectively). The proposed feature extraction strategy, combining local pixel-wise learning with an expansive receptive field for global information perception, demonstrates excellent feature learning capabilities. Due to this powerful and unique local-global feature extraction capability, our deep network achieves superior segmentation of breast fibroadenoma in sonography, which may be valuable in early diagnosis.
Multi-scale Cascaded Large-Model for Whole-body ROI Segmentation

Rui Hao,Dayu Tan,Yansen Su,Chunhou Zheng

2024-11-23

Abstract:Organs-at-risk segmentation is critical for ensuring the safety and precision of radiotherapy and surgical procedures. However, existing methods for organs-at-risk image segmentation often suffer from uncertainties and biases in target selection, as well as insufficient model validation experiments, limiting their generality and reliability in practical applications. To address these issues, we propose an innovative cascaded network architecture called the Multi-scale Cascaded Fusing Network (MCFNet), which effectively captures complex multi-scale and multi-resolution features. MCFNet includes a Sharp Extraction Backbone and a Flexible Connection Backbone, which respectively enhance feature extraction in the downsampling and skip-connection stages. This design not only improves segmentation accuracy but also ensures computational efficiency, enabling precise detail capture even in low-resolution images. We conduct experiments using the A6000 GPU on diverse datasets from 671 patients, including 36,131 image-mask pairs across 10 different datasets. MCFNet demonstrates strong robustness, performing consistently well across 10 datasets. Additionally, MCFNet exhibits excellent generalizability, maintaining high accuracy in different clinical scenarios. We also introduce an adaptive loss aggregation strategy to further optimize the model training process, improving both segmentation accuracy and efficiency. Through extensive validation, MCFNet demonstrates superior performance compared to existing methods, providing more reliable image-guided support. Our solution aims to significantly improve the precision and safety of radiotherapy and surgical procedures, advancing personalized treatment. The code has been made available on GitHub:<a class="link-external link-https" href="https://github.com/Henry991115/MCFNet" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Deep learning‐based multimodal fusion network for segmentation and classification of breast cancers using B‐mode and elastography ultrasound images

Sampa Misra,Chiho Yoon,Kwang‐Ju Kim,Ravi Managuli,Richard G. Barr,Jongduk Baek,Chulhong Kim

DOI: https://doi.org/10.1002/btm2.10480

2022-12-30

Abstract:Ultrasonography is one of the key medical imaging modalities for evaluating breast lesions. For differentiating benign from malignant lesions, computer‐aided diagnosis (CAD) systems have greatly assisted radiologists by automatically segmenting and identifying features of lesions. Here, we present deep learning (DL)‐based methods to segment the lesions and then classify benign from malignant, utilizing both B‐mode and strain elastography (SE‐mode) images. We propose a weighted multimodal U‐Net (W‐MM‐U‐Net) model for segmenting lesions where optimum weight is assigned on different imaging modalities using a weighted‐skip connection method to emphasize its importance. We design a multimodal fusion framework (MFF) on cropped B‐mode and SE‐mode ultrasound (US) lesion images to classify benign and malignant lesions. The MFF consists of an integrated feature network (IFN) and a decision network (DN). Unlike other recent fusion methods, the proposed MFF method can simultaneously learn complementary information from convolutional neural networks (CNNs) trained using B‐mode and SE‐mode US images. The features from the CNNs are ensembled using the multimodal EmbraceNet model and DN classifies the images using those features. The experimental results (sensitivity of 100 ± 0.00% and specificity of 94.28 ± 7.00%) on the real‐world clinical data showed that the proposed method outperforms the existing single‐ and multimodal methods. The proposed method predicts seven benign patients as benign three times out of five trials and six malignant patients as malignant five out of five trials. The proposed method would potentially enhance the classification accuracy of radiologists for breast cancer detection in US images.

engineering, biomedical
VMC‐UNet: A Vision Mamba‐CNN U‐Net for Tumor Segmentation in Breast Ultrasound Image

Dongyue Wang,Weiyu Zhao,Kaixuan Cui,Yi Zhu

DOI: https://doi.org/10.1002/ima.23222

IF: 2.177

2024-11-20

International Journal of Imaging Systems and Technology

Abstract:ABSTRACT Breast cancer remains one of the most significant health threats to women, making precise segmentation of target tumors critical for early clinical intervention and postoperative monitoring. While numerous convolutional neural networks (CNNs) and vision transformers have been developed to segment breast tumors from ultrasound images, both architectures encounter difficulties in effectively modeling long‐range dependencies, which are essential for accurate segmentation. Drawing inspiration from the Mamba architecture, we introduce the Vision Mamba‐CNN U‐Net (VMC‐UNet) for breast tumor segmentation. This innovative hybrid framework merges the long‐range dependency modeling capabilities of Mamba with the detailed local representation power of CNNs. A key feature of our approach is the implementation of a residual connection method within the U‐Net architecture, utilizing the visual state space (VSS) module to extract long‐range dependency features from convolutional feature maps effectively. Additionally, to better integrate texture and structural features, we have designed a bilinear multi‐scale attention module (BMSA), which significantly enhances the network's ability to capture and utilize intricate feature details across multiple scales. Extensive experiments conducted on three public datasets demonstrate that the proposed VMC‐UNet surpasses other state‐of‐the‐art methods in breast tumor segmentation, achieving Dice coefficients of 81.52% for BUSI, 88.00% for BUS, and 88.96% for STU. The source code is accessible at https://github.com/windywindyw/VMC‐UNet .

engineering, electrical & electronic,optics,imaging science & photographic technology
Ultrasound image segmentation of renal tumors based on UNet++ with fusion of multiscale residuals and dual attention

Hui Qi,Zhen Wang,Xiaobo Qi,Ying Shi,Tianwu Xie

DOI: https://doi.org/10.1088/1361-6560/ad2d7f

IF: 3.5

2024-02-29

Physics in Medicine and Biology

Abstract:Objective. Laparoscopic renal unit-preserving resection is a routine and effective means of treating renal tumors. Image segmentation is an essential part before tumor resection. The current segmentation method mainly relies on doctors' manual delineation, which is time-consuming, labor-intensive, and influenced by their personal experience and ability. And the image quality of segmentation is low, with problems such as blurred edges, unclear size and shape, which are not conducive to clinical diagnosis. Approach. To address these problems, we propose an automated segmentation method, i.e., the UNet++ algorithm fusing multiscale residuals and dual attention (MRDA_UNet++). It replaces two consecutive convolutions in UNet++ with the "MultiRes block" module, which incorporates coordinate attention(CA) to fuse features from different scales and suppress the impact of background noise. Furthermore, an attention gate(AG) is also added at the short connections to enhance the ability of the network to extract features from the target area. Main results. The experimental results show that MRDA_UNet++ achieves 93.18%, 92.87%, 93.66%, and 92.09% on the real-world dataset for MIoU, Dice, Precision, and Recall, respectively. Compared to the baseline model UNet++ on three public datasets, the MIoU, Dice, and Recall metrics improved by 6.00%, 7.90% and 18.09% respectively for BUSI, 0.39%, 0.27% and 1.03% for Dataset C, and 1.37%, 1.75% and 1.30% for DDTI. Significance. The proposed MRDA_UNet++ exhibits obvious advantages in feature extraction, which can not only significantly reduce the workload of doctors, but also further decrease the risk of misdiagnosis. It is of great value to assist doctors' diagnosis in the clinic.

engineering, biomedical,radiology, nuclear medicine & medical imaging
FMRNet: A fused network of multiple tumoral regions for breast tumor classification with ultrasound images

Wenju Cui,Yunsong Peng,Gang Yuan,Weiwei Cao,Yuzhu Cao,Zhengda Lu,Xinye Ni,Zhuangzhi Yan,Jian Zheng

DOI: https://doi.org/10.1002/mp.15341

IF: 4.506

2021-11-29

Medical Physics

Abstract:PURPOSE: Recent studies have illustrated that the peritumoral regions of medical images have value for clinical diagnosis. However, the existing approaches using peritumoral regions mainly focus on the diagnostic capability of the single region and ignore the advantages of effectively fusing the intratumoral and peritumoral regions. In addition, these methods need accurate segmentation masks in the testing stage, which are tedious and inconvenient in clinical applications. To address these issues, we construct a deep convolutional neural network that can adaptively fuse the information of multiple tumoral-regions (FMRNet) for breast tumor classification using ultrasound (US) images without segmentation masks in the testing stage.METHODS: To sufficiently excavate the potential relationship, we design a fused network and two independent modules to extract and fuse features of multiple regions simultaneously. First, we introduce two enhanced combined-tumoral (EC) region modules, aiming to enhance the combined-tumoral features gradually. Then, we further design a three-branch module for extracting and fusing the features of intratumoral, peritumoral, and combined-tumoral regions, denoted as the intratumoral, peritumoral, and combined-tumoral module. Especially, we design a novel fusion module by introducing a channel attention module to adaptively fuse the features of three regions. The model is evaluated on two public datasets including UDIAT and BUSI with breast tumor ultrasound images. Two independent groups of experiments are performed on two respective datasets using the fivefold stratified cross-validation strategy. Finally, we conduct ablation experiments on two datasets, in which BUSI is used as the training set and UDIAT is used as the testing set.RESULTS: We conduct detailed ablation experiments about the proposed two modules and comparative experiments with other existing representative methods. The experimental results show that the proposed method yields state-of-the-art performance on both two datasets. Especially, in the UDIAT dataset, the proposed FMRNet achieves a high accuracy of 0.945 and a specificity of 0.945, respectively. Moreover, the precision (PRE = 0.909) even dramatically improves by 21.6% on the BUSI dataset compared with the existing method of the best result.CONCLUSION: The proposed FMRNet shows good performance in breast tumor classification with US images, and proves its capability of exploiting and fusing the information of multiple tumoral-regions. Furthermore, the FMRNet has potential value in classifying other types of cancers using multiple tumoral-regions of other kinds of medical images.

radiology, nuclear medicine & medical imaging
MRS‐Net: Brain tumour segmentation network based on feature fusion and attention mechanism

Xiaoyan Shen,Ju Wang,Yuhua Zhao,Rui Zhou,Han Gao,Jiakai Zhang,Hongming Shen

DOI: https://doi.org/10.1049/ipr2.13266

IF: 2.3

2024-10-31

IET Image Processing

Abstract:This study introduces MRS‐Net, a multi‐scale residual network enhanced with an attention mechanism, specifically designed for improved segmentation of complex brain tumour structures in MRI images. Key modifications include the integration of a double residual feature fusion module and an atrous spatial pyramid pooling, alongside an inverted residual coordinate attention module, replacing traditional operations in U‐Net. These enhancements enable MRS‐Net to significantly outperform U‐Net in segmentation accuracy, achieving higher Dice coefficients, PPVs, sensitivities, and reduced Hausdorff distance. Accurate segmentation of brain tumor magnetic resonance imaging (MRI) is crucial for treatment planning. Addressing the challenges of complex tumor structures and inadequate cross‐channel information utilization in Unet‐based segmentation, this paper proposes the multi‐scale residual brain tumor MRI segmentation network (MRS‐Net) incorporating an attention mechanism to enhance segmentation accuracy. First, the double residual feature fusion module is utilized to enhance the fusion of feature information between different levels. Second, the Atrous Spatial Pyramid Pooling is introduced as a bridging module of the network to capture the features at different scales of the image, so as to enhance the extraction capability of the network for detailed features. Finally, the inverted residual coordinate attention module replaces the direct splicing in Unet to fuse the large feature information at each level and scale, thus enhancing the model's ability to recognize the spatial location information of brain tumors. The Dice coefficients, positive predictive values (PPVs), sensitivities (Sensitivity) and Hausdorff distance (HD), which are the four evaluation indexes, reach 84.54%, 87.43%, 88.37% and 2.248, respectively, which are improved by 1.85%, 2.11%, 2.88% and 6.0%, respectively, compared with Unet. The experimental results show that MRS‐Net achieves better brain tumor image segmentation.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
DBL-Net: A dual-branch learning network with information from spatial and frequency domains for tumor segmentation and classification in breast ultrasound image

Chengzhang Zhu,Xian Chai,Zhiyuan Wang,Yalong Xiao,RenMao Zhang,Zhangzheng Yang,Jie Feng

DOI: https://doi.org/10.1016/j.bspc.2024.106221

IF: 5.1

2024-07-01

Biomedical Signal Processing and Control

Abstract:Breast cancer is a common malignancy, ranking as one of the most prevalent cancers among women globally. Improving treatment success rates for breast cancer are crucially dependent on early detection and accurate diagnosis. Ultrasound imaging, as a non-invasive and low-radiation imaging technique, plays a significant role in early breast cancer detection. However, due to the characteristics of fuzzy tumor boundaries and irregular shapes of the tumor, accurate breast tumor classification and segmentation remain challenging tasks. This paper introduces a novel approach for breast ultrasound image segmentation and classification tasks. Firstly, we study the potential value of frequency domain information in breast image analysis and propose the DBL-Net, a multi-task learning network for simultaneous tumor segmentation and tumor classification. Secondly, we customize a Spatial-Frequency Domain Feature Encoding module (S-FEM) to better encode and fuse spatial and frequency domain features of breast ultrasound images. Furthermore, we design a Representational Perception Enhancer (RPE) to improve the feature representation capabilities and prediction accuracy of the model. Finally, We have carried out a comprehensive series of tests on the BUS dataset, and the findings clearly indicate that our method outperforms the current state-of-the-art methods.

engineering, biomedical
MF-Net: Multiple-feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images

Jiajia Wang,Guoqi Liu,Dong Liu,Baofang Chang

DOI: https://doi.org/10.1016/j.eswa.2024.123798

IF: 8.5

2024-01-01

Expert Systems with Applications

Abstract:Objective:Breast lesion segmentation in ultrasound images is of great significance for qualitative breast lesions. However, blurred lesion boundaries, irregular lesion shapes, and similar intensity distributions between lesion and background bring challenges to accurately segmenting breast lesions. Recently, several U-Net-based variants and transformer-based networks have been applied in breast lesion segmentation. Nevertheless, these methods have three limitations: (1) Introducing mass attention mechanisms and complex operations, (2) Ignoring the capability of extracting local detail features, and (3) Ignoring fusing different global semantic information.Approach:To alleviate these challenges, we propose a novel multiple-feature extraction network named MF-Net. The core designs are as follows: (1) A transformer-based auxiliary bi-encoder models long-range dependencies, (2) A multiple-feature extraction module excavates the robust local features, and (3) A global feature enhancement module integrates different global context information.Main results:We conducted extensive experiments on three public breast lesion datasets and compared our method with twelve state-of-the-art methods. The results of comparison experiments indicate that our model achieves a 3.16% improvement in boundary accuracy with a slight lead in segmentation accuracy. Similarly, when the boundary accuracy is close, our model also gets a 3.92% improvement in segmentation accuracy. In the generalization experiments, our network also demonstrates varying degrees of superiority in segmentation accuracy and boundary precision.Significance:Our network mainly has three advantages: (1) It achieves outstanding performance in the precise segmentation of the breast lesions, (2) It focuses on exploring details such as irregular morphology and blurred boundaries of breast lesions, providing valuable insights for further clinical research, and (3) It improves performance without decreasing inference speed through the introduction of critical components.
A novel MCF-Net: Multi-level context fusion network for 2D medical image segmentation

Lizhu Liu,Yexin Liu,Jian Zhou,Cheng Guo,Huigao Duan

DOI: https://doi.org/10.1016/j.cmpb.2022.107160

IF: 6.1

2022-11-01

Computer Methods and Programs in Biomedicine

Abstract:Medical image segmentation is a crucial step in the clinical applications for diagnosis and analysis of some diseases. U-Net-based convolution neural networks have achieved impressive performance in medical image segmentation tasks. However, the multi-level contextual information integration capability and the feature extraction ability are often insufficient. In this paper, we present a novel multi-level context fusion network (MCF-Net) to improve the performance of U-Net on various segmentation tasks by designing three modules, hybrid attention-based residual atrous convolution (HARA) module, multi-scale feature memory (MSFM) module, and multi-receptive field fusion (MRFF) module, to fuse multi-scale contextual information. HARA module was proposed to effectively extract multi-receptive field features by combing atrous spatial pyramid pooling and attention mechanism. We further design the MSFM and MRFF modules to fuse features of different levels and effectively extract contextual information. The proposed MCF-Net was evaluated on the ISIC 2018, DRIVE, BUSI, and Kvasir-SEG datasets, which have challenging images of many sizes and widely varying anatomy. The experimental results show that MCF-Net is very competitive with other U-Net models, and it offers tremendous potential as a general-purpose deep learning model for 2D medical image segmentation.

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods
MBDRes-U-Net: Multi-Scale Lightweight Brain Tumor Segmentation Network

Longfeng Shen,Yanqi Hou,Jiacong Chen,Liangjin Diao,Yaxi Duan

2024-11-04

Abstract:Accurate segmentation of brain tumors plays a key role in the diagnosis and treatment of brain tumor diseases. It serves as a critical technology for quantifying tumors and extracting their features. With the increasing application of deep learning methods, the computational burden has become progressively heavier. To achieve a lightweight model with good segmentation performance, this study proposes the MBDRes-U-Net model using the three-dimensional (3D) U-Net codec framework, which integrates multibranch residual blocks and fused attention into the model. The computational burden of the model is reduced by the branch strategy, which effectively uses the rich local features in multimodal images and enhances the segmentation performance of subtumor regions. Additionally, during encoding, an adaptive weighted expansion convolution layer is introduced into the multi-branch residual block, which enriches the feature expression and improves the segmentation accuracy of the model. Experiments on the Brain Tumor Segmentation (BraTS) Challenge 2018 and 2019 datasets show that the architecture could maintain a high precision of brain tumor segmentation while considerably reducing the calculation <a class="link-external link-http" href="http://overhead.Our" rel="external noopener nofollow">this http URL</a> code is released at <a class="link-external link-https" href="https://github.com/Huaibei-normal-university-cv-laboratory/mbdresunet" rel="external noopener nofollow">this https URL</a>

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition

[Senile cataract, a permeability cataract].

A Multiscale Nonlocal Feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images.

MEF-UNet: An end-to-end ultrasound image segmentation algorithm based on multi-scale feature extraction and fusion

MFMSNet: A Multi-frequency and Multi-scale Interactive CNN-Transformer Hybrid Network for breast ultrasound image segmentation

Giardiasis in adults. Studies on jejunum and immunoglobulins.

MDFN: A Multi-level Dynamic Fusion Network with self-calibrated edge enhancement for lung nodule segmentation

MFD-Net: Modality Fusion Diffractive Network for Segmentation of Multimodal Brain Tumor Image

MLFEU-NET: A Multi-scale Low-level Feature Enhancement Unet for breast lesions segmentation in ultrasound images

MFU-Net: a deep multimodal fusion network for breast cancer segmentation with dual-layer spectral detector CT

MDCC-Net: Multiscale double-channel convolution U-Net framework for colorectal tumor segmentation

Expansive Receptive Field and Local Feature Extraction Network: Advancing Multiscale Feature Fusion for Breast Fibroadenoma Segmentation in Sonography

Multi-scale Cascaded Large-Model for Whole-body ROI Segmentation

Deep learning‐based multimodal fusion network for segmentation and classification of breast cancers using B‐mode and elastography ultrasound images

VMC‐UNet: A Vision Mamba‐CNN U‐Net for Tumor Segmentation in Breast Ultrasound Image

Ultrasound image segmentation of renal tumors based on UNet++ with fusion of multiscale residuals and dual attention

FMRNet: A fused network of multiple tumoral regions for breast tumor classification with ultrasound images

MRS‐Net: Brain tumour segmentation network based on feature fusion and attention mechanism

DBL-Net: A dual-branch learning network with information from spatial and frequency domains for tumor segmentation and classification in breast ultrasound image

MF-Net: Multiple-feature Extraction Network for Breast Lesion Segmentation in Ultrasound Images

A novel MCF-Net: Multi-level context fusion network for 2D medical image segmentation

MBDRes-U-Net: Multi-Scale Lightweight Brain Tumor Segmentation Network