The role of mast cells, interleukin-13 and transient receptor potential channels in a mouse model of chemical-induced airway hyperresponsiveness

F. Devos,V. De Vooght,B. Nemery,P. Hoet,J. Vanoirbeek

DOI: https://doi.org/10.1186/2045-7022-3-S2-P31

2013-07-16

Clinical and Translational Allergy

Abstract:

What problem does this paper attempt to address?

Spinal MRI image segmentation based on improved U-Net

Xiajin Mei,Wenxin Zhang,Mingxu Sun,Yuliang Ma

DOI: https://doi.org/10.1007/s11760-024-03548-9

IF: 1.583

2024-09-12

Signal Image and Video Processing

Abstract:Segmenting vertebrae and intervertebral discs from spinal MRI images is essential for the diagnosis and treatment of spinal diseases. However, the similarity among different vertebrae and discs, coupled with pathological variations, complicates the segmentation process of MRI images. To tackle this challenge, this study introduces an improved U-Net architecture for spinal MRI image segmentation. The encoder employs a Multi-scale Feature Fusion Module that integrates shallow and deep features through feature downsampling. Additionally, a Dual Attention Mechanism Module is embedded within both the encoder and decoder to enhance feature extraction capabilities. Furthermore, a Graph Convolutional Module is integrated to capture contextual relationships between vertebrae and intervertebral discs. To mitigate background interference, a Spinal Region Guidance Module is also proposed. Experiments conducted on the public dataset from the MRSpineSeg Challenge yielded an average Dice Similarity Coefficient of 85.11%. The results indicate that our proposed method not only improves the segmentation performance of spinal MRI images but also surpasses other models, which holds significant implications for the clinical diagnosis and treatment of spinal diseases.

engineering, electrical & electronic,imaging science & photographic technology
A Spinal MRI Image Segmentation Method Based on Improved Swin-UNet

Jie Cao,Jiacheng Fan,Chin-Ling Chen,Zhenyu Wu,Qingxuan Jiang,Shikai Li,Jie CaoJiacheng FanChin-Ling ChenZhenyu WuQingxuan JiangShikai Lia School of Computer Science,Northeast Electric Power University,Jilin,Chinab School of Information Engineering,Changchun Sci-Tech University,Changchun,Chinac Department of Computer Science and Information Engineering,Chaoyang University of Technology,Taichung,Taiwand Department one of Orthopedics,Affiliated Hospital of Beihua University,Jilin,Jilin,Chinae Information Center,West China Hospital of Sichuan University,Chengdu,Sichuan,China

DOI: https://doi.org/10.1080/0954898x.2024.2323530

2024-03-05

Network Computation in Neural Systems

Abstract:As the number of patients increases, physicians are dealing with more and more cases of degenerative spine pathologies on a daily basis. To reduce the workload of healthcare professionals, we propose a modified Swin-UNet network model. Firstly, the Swin Transformer Blocks are improved using a residual post-normalization and scaling cosine attention mechanism, which makes the training process of the model more stable and improves the accuracy. Secondly, we use the log-space continuous position biasing method instead of the bicubic interpolation position biasing method. This method solves the problem of performance loss caused by the large difference between the resolution of the pretraining image and the resolution of the spine image. Finally, we introduce a segmentation smooth module (SSM) at the decoder stage. The SSM effectively reduces redundancy, and enhances the segmentation edge processing to improve the model's segmentation accuracy. To validate the proposed method, we conducted experiments on a real dataset provided by hospitals. The average segmentation accuracy is no less than 95%. The experimental results demonstrate the superiority of the proposed method over the original model and other models of the same type in segmenting the spinous processes of the vertebrae and the posterior arch of the spine.

computer science, artificial intelligence,engineering, electrical & electronic,neurosciences
RAU-Net: U-Net network based on residual multi-scale fusion and attention skip layer for overall spine segmentation

Zhaomin Yang,Qi Wang,Jianchao Zeng,Pinle Qin,Rui Chai,Dong Sun

DOI: https://doi.org/10.1007/s00138-022-01360-4

IF: 2.983

2022-12-18

Machine Vision and Applications

Abstract:Spine segmentation is necessary for the clinical quantitative analysis of computed tomography (CT) images and plays an important role in the early diagnosis and treatment of spine diseases. However, because of the different fields of view of sagittal CT, these images show different shapes and sizes of vertebrae, unclear vertebral boundaries, and different image scales which greatly complicate the segmentation of the spine. To solve this problem, we propose a new deep learning method for segmenting the spine. For this algorithm, we first proposed a residual feature pyramids block for capturing and fusing multi-scale information. For fusing shallow and deep features, we then propose an attention skip layer structure for suppressing the reuse of redundant information. Finally, we use a joint loss function to optimize the segmentation results and achieve the effect of clear segmentation edges. Through the combination of these three techniques, our method achieves efficient and accurate spinal segmentation. The experimental results show that our model has a good performance in spine segmentation. In particular, our achieve the Dice of 0.8973, the Hausdorff distance of 77.6277 on the VerSe 2019 dataset and the Dice of 0.8626, the Hausdorff distance of 82.6170 on the VerSe 2020 dataset.

computer science, cybernetics, artificial intelligence,engineering, electrical & electronic
Segmentation of brain tumor MRI image based on improved attention module Unet network

Lei Zhang,Chaofeng Lan,Lirong Fu,Xiuhuan Mao,Meng Zhang

DOI: https://doi.org/10.1007/s11760-022-02443-5

2023-01-06

Abstract:In recent years, the fully convolutional network represented by Unet has been widely used in the field of medical image segmentation. However, due to the diversity of the shapes of lesions and the differences in the structures of different organs, the segmentation of lesions using only Unet structure cannot meet the requirements of accuracy and speed. Therefore, an improved Unet network for brain tumor segmentation is proposed. To reduce the number of parameters while extracting richer features and improving the accuracy of segmentation, this article introduces the inverted residuals block to replace the convolution module in the encoding and decoding stages of Unet to improve the calculation speed and accuracy; to better combine high-order semantic information with low-order semantic information, improve for the quality of detailed features in the training process, an improved Residuals Convolutional Block Attention Module is added between the encoder and the decoder. Combining the above two points of improvement, this article proposes an improved model based on Unet. Based on the Brats2019 dataset, an ablation experiment was performed on the proposed improved Unet model and compared with the TrUE-Net, ConResNet and OM-Net methods, and the Dice coefficient and Hausdorff distance were used as evaluation indicators to analyze the segmentation effect of the model. The experimental results show that the Dice coefficient of the improved Unet network model proposed in this article is 0.020–0.027 higher than other comparative models on average, and the Haushofer distance is reduced by 2.67–10.06.
SK-Unet: An Improved U-Net Model With Selective Kernel for the Segmentation of LGE Cardiac MR Images

Xiyue Wang,Sen Yang,Yuqi Fang,Yunpeng Wei,Minghui Wang,Jing Zhang,Xiao Han

DOI: https://doi.org/10.1109/jsen.2021.3056131

IF: 4.3

2021-05-15

IEEE Sensors Journal

Abstract:In the clinical environment, myocardial infarction (MI) as one common cardiovascular disease is mainly evaluated using late gadolinium enhancement (LGE) cardiac magnetic resonance images (CMRIs). Accurate segmentation of the ventricles and the myocardium is a prerequisite for quantitative assessment of cardiac functions and disease progression. Performing the task using LGE images is, however, rather challenging due to heterogeneous image intensity distribution and lack of clear boundaries between adjacent organs and tissues. In this paper we propose a deep neural network method for automatic segmentation of the left ventricle (LV), right ventricle (RV), and left ventricular myocardium (LVM) from LGE CMRIs, which also leverages complementary information from cine and T2-weighted CMRIs if available. In the proposed method, termed SK-Unet, we augment the original U-Net model by adding a squeeze-and-excitation residual (SE-Res) module in the encoder and a selective kernel (SK) module in the decoder. The SE-Res module applies an attention mechanism to enhance informative feature extraction and suppress redundant ones. The SK module offers the ability to adaptively learn task-relevant multi-scale spatial features. We tested our method by participating in the MICCAI 2019 MS-CMRSeg challenge and achieved a mean dice score of 0.922 for LV segmentation, 0.827 for LVM, and 0.874 for RV. The results placed our method at the 1st place in the competition, and our accuracy of 0.827 also greatly surpasses the measured inter-observer agreement of 0.757 for manual segmentation of LVM in LGE CMRIs. The code accompanying our method is made available online at https://github.com/Xiyue-Wang/1st-in-MS-CMRSeg-2019.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
A Medical Image Segmentation Method Based on Improved UNet 3+ Network

Yang Xu,Shike Hou,Xiangyu Wang,Duo Li,Lu Lu

DOI: https://doi.org/10.3390/diagnostics13030576

IF: 3.6

2023-02-04

Diagnostics

Abstract:In recent years, segmentation details and computing efficiency have become more important in medical image segmentation for clinical applications. In deep learning, UNet based on a convolutional neural network is one of the most commonly used models. UNet 3+ was designed as a modified UNet by adopting the architecture of full-scale skip connections. However, full-scale feature fusion can result in excessively redundant computations. This study aimed to reduce the network parameters of UNet 3+ while further improving the feature extraction capability. First, to eliminate redundancy and improve computational efficiency, we prune the full-scale skip connections of UNet 3+. In addition, we use the attention module called Convolutional Block Attention Module (CBAM) to capture more essential features and thus improve the feature expression capabilities. The performance of the proposed model was validated by three different types of datasets: skin cancer segmentation, breast cancer segmentation, and lung segmentation. The parameters are reduced by about 36% and 18% compared to UNet and UNet 3+, respectively. The results show that the proposed method not only outperformed the comparison models in a variety of evaluation metrics but also achieved more accurate segmentation results. The proposed models have lower network parameters that enhance feature extraction and improve segmentation performance efficiently. Furthermore, the models have great potential for application in medical imaging computer-aided diagnosis.

medicine, general & internal
Multi-Scale Hybrid Attention Convolutional Neural Network for Automatic Segmentation of Lumbar Vertebrae From MRI

Jing Liu,Yuee Zhou,Xinxin Cui,Fengqing Jin,Guodong Suo,Hao Xu,Jianlan Yang

DOI: https://doi.org/10.1109/access.2024.3407833

IF: 3.9

2024-06-08

IEEE Access

Abstract:Due to the high incidence of lumbar vertebral lesions causing spondylolisthesis and intervertebral disc protrusion, lumbar spine (vertebrae and intervertebral discs) MRI image segmentation can provide effective clinical information for the initial diagnosis and early treatment of current lumbar spine-related diseases. However, in MRI images, there is a significant overlap and similarity in features between the vertebral bones and intervertebral discs within the lumbar spine. Therefore, the effective identification and segmentation of each vertebra and intervertebral disc in the lumbar spine pose a significant challenge. We propose a lumbar spine MRI segmentation model based on the 3D Residual U-Net, incorporating boundary segmentation structures and a hybrid attention mechanism. The model achieves boundary-constrained segmentation of individual vertebrae and intervertebral discs by integrating the boundary segmentation module. Additionally, it utilizes a hybrid attention module based on convolutional attention and self-attention mechanisms for multiscale feature extraction in the lumbar spine. The proposed model is trained and validated using the publicly available datasets MRSpineSeg2021 and SpineSagT2Wdataset3. Experimental results demonstrate a significant improvement in segmentation performance, as measured by metrics such as the Dice similarity coefficient (DSC) and Hausdorff distance (HD). This validates the superiority and generalization performance of our proposed lumbar spine MRI.

computer science, information systems,telecommunications,engineering, electrical & electronic
RUnT: A Network Combining Residual U-Net and Transformer for Vertebral Edge Feature Fusion Constrained Spine CT Image Segmentation

Hao Xu,Xinxin Cui,Chaofan Li,Zhenyu Tian,Jing Liu,Jianlan Yang

DOI: https://doi.org/10.1109/access.2023.3281468

IF: 3.9

2023-06-09

IEEE Access

Abstract:Scoliosis, spinal deformity and vertebral spondylolisthesis are spinal disorders with high incidence, which seriously affect people's lives and health. CT is an important medical tool for the detection and diagnosis of spinal disorders and provides a large amount of pathologically valid information in various clinical practices such as spine pathology assessment and computer-assisted surgical interventions. As the spine presents long span, complex shape of biological curve and high multi-stage similarity in the sagittal plane of CT images. Therefore, fast and accurate spine segmentation technology has become an important research direction for computer-aided diagnosis. We proposed an RUnT network based on the combination of residual U-Net feature extraction network and Vision Transformer structure for fast and efficient automatic segmentation of multiple vertebrae of the spine. The deep vertebral features are first extracted using the residual U-Net network to prevent gradient diffusion while improving the accuracy of vertebral contour segmentation. Then the multi-scale feature maps extracted by the residual structure containing rich vertebral superficial information are input to the edge segmentation module. We designed the vertebral contour feature extraction structure to refine the segmentation boundaries and ensure the segmentation consistency of each vertebra by combining the operations of deconvolution and convolution for three different scales of deep features.Finally, the global information extraction module based on Transformer structure is combined with the local feature extraction module to achieve the blending of global location information of vertebrae with local features through the self-attentive feature map of multi-scale volume. By mixing edge features with semantic features, the semantic confusion arising from the high similarity between vertebrae when the decoder extracts vertebral features is reduced. The model proposed in thi- paper is experimented on the CTSpine1K and VerSe 20 public datasets. The results show that the model proposed in this paper obtains the state-of-the-art segmentation performance with the average DSC scores of 88.4% and 81.5% on CTSpine1K and VerSe 20, respectively, while reducing the average distance of HD95 from 4.86 to 3.88.

computer science, information systems,telecommunications,engineering, electrical & electronic
UNet based on dynamic convolution decomposition and triplet attention

Yang Li,Bobo Yan,Jianxin Hou,Bingyang Bai,Xiaoyu Huang,Canfei Xu,Limei Fang

DOI: https://doi.org/10.1038/s41598-023-50989-2

IF: 4.6

2024-01-02

Scientific Reports

Abstract:Abstract The robustness and generalization of medical image segmentation models are being challenged by the differences between different disease types, different image types, and different cases.Deep learning based semantic segmentation methods have been providing state-of-the-art performance in the last few years. One deep learning technique, U-Net, has become the most popular architecture in the medical imaging segmentation. Despite outstanding overall performance in segmenting medical images, it still has the problems of limited feature expression ability and inaccurate segmentation. To this end, we propose a DTA-UNet based on Dynamic Convolution Decomposition (DCD) and Triple Attention (TA). Firstly, the model with Attention U-Net as the baseline network uses DCD to replace all the conventional convolution in the encoding-decoding process to enhance its feature extraction capability. Secondly, we combine TA with Attention Gate (AG) to be used for skip connection in order to highlight lesion regions by removing redundant information in both spatial and channel dimensions. The proposed model are tested on the two public datasets and actual clinical dataset such as the public COVID-SemiSeg dataset, the ISIC 2018 dataset, and the cooperative hospital stroke segmentation dataset. Ablation experiments on the clinical stroke segmentation dataset show the effectiveness of DCD and TA with only a 0.7628 M increase in the number of parameters compared to the baseline model. The proposed DTA-UNet is further evaluated on the three datasets of different types of images to verify its universality. Extensive experimental results show superior performance on different segmentation metrics compared to eight state-of-art methods.The GitHub URL of our code is https://github.com/shuaihou1234/DTA-UNet .

multidisciplinary sciences
MS-UNet: Multi-Scale Nested UNet for Medical Image Segmentation with Few Training Data Based on an ELoss and Adaptive Denoising Method

Haoyuan Chen,Yufei Han,Linwei Yao,Xin Wu,Kuan Li,Jianping Yin

DOI: https://doi.org/10.3390/math12192996

IF: 2.4

2024-09-27

Mathematics

Abstract:Traditional U-shape segmentation models can achieve excellent performance with an elegant structure. However, the single-layer decoder structure of U-Net or SwinUnet is too "thin" to exploit enough information, resulting in large semantic differences between the encoder and decoder parts. Things get worse in the field of medical image processing, where annotated data are more difficult to obtain than other tasks. Based on this observation, we propose a U-like model named MS-UNet with a plug-and-play adaptive denoising module and ELoss for the medical image segmentation task in this study. Instead of the single-layer U-Net decoder structure used in Swin-UNet and TransUNet, we specifically designed a multi-scale nested decoder based on the Swin Transformer for U-Net. The proposed multi-scale nested decoder structure allows for the feature mapping between the decoder and encoder to be semantically closer, thus enabling the network to learn more detailed features. In addition, ELoss could improve the attention of the model to the segmentation edges, and the plug-and-play adaptive denoising module could prevent the model from learning the wrong features without losing detailed information. The experimental results show that MS-UNet could effectively improve network performance with more efficient feature learning capability and exhibit more advanced performance, especially in the extreme case with a small amount of training data. Furthermore, the proposed ELoss and denoising module not only significantly enhance the segmentation performance of MS-UNet but can also be applied individually to other models.

mathematics
Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation

Hao Tang,Lianglun Cheng,Guoheng Huang,Zhengguang Tan,Junhao Lu,Kaihong Wu

2024-04-01

Abstract:Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they still encounter challenges because of limited receptive field or high computing complexity. Recently, State Space Models (SSMs), particularly Mamba and its variants, have demonstrated notable performance in the field of vision. However, their feature extraction methods may not be sufficiently effective and retain some redundant structures, leaving room for parameter reduction. Motivated by previous spatial and channel attention methods, we propose Triplet Mamba-UNet. The method leverages residual VSS Blocks to extract intensive contextual features, while Triplet SSM is employed to fuse features across spatial and channel dimensions. We conducted experiments on ISIC17, ISIC18, CVC-300, CVC-ClinicDB, Kvasir-SEG, CVC-ColonDB, and Kvasir-Instrument datasets, demonstrating the superior segmentation performance of our proposed TM-UNet. Additionally, compared to the previous VM-UNet, our model achieves a one-third reduction in parameters.

Computer Vision and Pattern Recognition,Machine Learning
A Novel Deep Learning Pipeline for Vertebra Labeling and Segmentation of Spinal Computed Tomography Images

Ishan Devdatt Kawathekar,Anu Shaju Areeckal,Aparna Ⅴ

DOI: https://doi.org/10.1109/access.2024.3358874

IF: 3.9

2024-02-03

IEEE Access

Abstract:Automatic segmentation of vertebrae from computed tomography (CT) scans play an important role in the clinical interpretation and treatment of spinal co-morbidities. Labelling and segmentation of vertebrae is labour intensive and challenging, due to various fields of view and fuzzy boundaries in CT scans. Therefore, successful labelling and segmentation is highly dependent on the level of expertise of the radiologist. In this paper, we propose a three-step fully-automated end-to-end pipeline for vertebra labelling and segmentation of spinal CT images. A novel deep learning architecture, Unbalanced-UNet, is proposed for extracting the region proposals for spine detection. A modified SpatialConfiguration-Net, 3D SCN, is used for labelling of vertebra and centroid extraction. Finally, a 3D U-Net is employed for the segmentation of each vertebra. The models were validated on VERSE'19 public dataset. An identification rate of 90.20% and 91.47% was obtained for the first and second test sets of the VERSE'19 dataset, respectively. Mean localization distance of 4.97 mm and 5.32 mm was obtained for the first and second test sets, respectively. The final segmentation stage shows a dice score and Hausdorff surface distance of 93.07% and 5.36 mm, respectively, for the first test set, and 92.01% and 5.63 mm, respectively, for the second test set. The results show that the proposed approach outperforms the state-of-art models for segmentation of vertebrae. The proposed Unbalanced-UNet architecture increased the accuracy of accruing the region proposals for spine detection. The proposed fully automated pipeline has potential clinical applications in treatment and surgical planning of spinal deformities.

computer science, information systems,telecommunications,engineering, electrical & electronic
SK-Unet: an Improved U-net Model with Selective Kernel for the Segmentation of Multi-sequence Cardiac MR

Xiyue Wang,Sen Yang,Mingxuan Tang,Yunpeng Wei,Ling He,Jing Zhang,Xiao Han

DOI: https://doi.org/10.48550/arXiv.2001.00736

2020-01-03

Abstract:In the clinical environment, myocardial infarction (MI) as one com-mon cardiovascular disease is mainly evaluated based on the late gadolinium enhancement (LGE) cardiac magnetic resonance images (CMRIs). The auto-matic segmentations of left ventricle (LV), right ventricle (RV), and left ven-tricular myocardium (LVM) in the LGE CMRIs are desired for the aided diag-nosis in clinic. To accomplish this segmentation task, this paper proposes a modified U-net architecture by combining multi-sequence CMRIs, including the cine, LGE, and T2-weighted CMRIs. The cine and T2-weighted CMRIs are used to assist the segmentation in the LGE CMRIs. In this segmentation net-work, the squeeze-and-excitation residual (SE-Res) and selective kernel (SK) modules are inserted in the down-sampling and up-sampling stages, respective-ly. The SK module makes the obtained feature maps more informative in both spatial and channel-wise space, and attains more precise segmentation result. The utilized dataset is from the MICCAI challenge (MS-CMRSeg 2019), which is acquired from 45 patients including three CMR sequences. The cine and T2-weighted CMRIs acquired from 35 patients and the LGE CMRIs acquired from 5 patients are labeled. Our method achieves the mean dice score of 0.922 (LV), 0.827 (LVM), and 0.874 (RV) in the LGE CMRIs.

Image and Video Processing
Retinal Blood Vessels Segmentation With Improved SE‐UNet Model

Yibo Wan,Gaofeng Wei,Renxing Li,Yifan Xiang,Dechao Yin,Minglei Yang,Deren Gong,Jiangang Chen

DOI: https://doi.org/10.1002/ima.23145

IF: 2.177

2024-07-20

International Journal of Imaging Systems and Technology

Abstract:ABSTRACT Accurate segmentation of retinal vessels is crucial for the early diagnosis and treatment of eye diseases, for example, diabetic retinopathy, glaucoma, and macular degeneration. Due to the intricate structure of retinal vessels, it is essential to extract their features with precision for the semantic segmentation of medical images. In this study, an improved deep learning neural network was developed with a focus on feature extraction based on the U‐Net structure. The enhanced U‐Net combines the architecture of convolutional neural networks (CNNs) with SE blocks (squeeze‐and‐excitation blocks) to adaptively extract image features after each U‐Net encoder's convolution. This approach aids in suppressing nonvascular regions and highlighting features for specific segmentation tasks. The proposed method was trained and tested on the DRIVECHASE_DB1 and STARE datasets. As a result, the proposed model had an algorithmic accuracy, sensitivity, specificity, Dice coefficient (Dc), and Matthews correlation coefficient (MCC) of 95.62/0.9853/0.9652, 0.7751/0.7976/0.7773, 0.9832/0.8567/0.9865, 82.53/87.23/83.42, and 0.7823/0.7987/0.8345, respectively, outperforming previous methods, including UNet++, attention U‐Net, and ResUNet. The experimental results demonstrated that the proposed method improved the retinal vessel segmentation performance.

engineering, electrical & electronic,optics,imaging science & photographic technology
An attention mechanism‐based lightweight UNet for musculoskeletal ultrasound image segmentation

Yan Zhang,Xilong Yu,Qing Hu,Xianlei Zhang,Yixin Yang,Han Xiao

DOI: https://doi.org/10.1002/mp.17503

IF: 4.506

2024-12-03

Medical Physics

Abstract:Background Accurate musculoseletal ultrasound (MSKUS) image segmentation is crucial for diagnosis and treatment planning. Compared with traditional segmentation methods, deploying deep learning segmentation methods that balance segmentation efficiency, accuracy, and model size on edge devices has greater advantages. Purpose This paper aims to design a MSKUS image segmentation method that has fewer parameters, lower computation complexity and higher segmentation accuracy. Methods In this study, an attention mechanism‐based lightweight UNet (AML‐UNet) is designed to segment target muscle regions in MSKUS images. To suppress the transmission of redundant feature, Channel Reconstruction and Spatial Attention Module is designed in the encoding path. In addition, considering the inherent characteristic of MSKUS image, Multiscale Aggregation Module is developed to replace the skip connection architecture of U‐Net. Deep supervision is also introduced to the decoding path to refine predicted masks gradually. Our method is evaluated on two MSKUS 2D‐image segmentation datasets, including 3917 MSKUS and 1534 images respectively. In the experiments, a five‐fold cross‐validation method is adopted in ablation experiments and comparison experiments. In addition, Wilcoxon Signed‐Rank Test and Bonferroni correction are employed to validate the significance level. 0.01 was used as the statistical significance level in our paper. Results AML‐UNet yielded a mIoU of 84.17% and 90.14% on two datasets, representing a 3.38% (p<0.001 ) and 3.48% (p<0.001 ) over the Unext model. The number of parameters and FLOPs are only 0.21M and 0.96G, which are 1/34 and 1/29 of those in comparison with UNet. Conclusions Our proposed model achieved superior results with fewer parameters while maintaining segmentation efficiency and accuracy compared to other methods.

radiology, nuclear medicine & medical imaging
Swin-TransUper: Swin Transformer-based UperNet for medical image segmentation

Li, Chengyu,Zheng, Zhichao

DOI: https://doi.org/10.1007/s11042-024-19009-x

IF: 2.577

2024-04-03

Multimedia Tools and Applications

Abstract:Convolutional Neural Network-based UNet and its variants have shown remarkable performance in medical image segmentation. However, these methods can only capture local features without spatial correlations and are incapable of global modeling. Previous studies prove that local and global features are critical in computer vision. Therefore, based on the abovementioned considerations, this paper proposes a pure Transformer model named Swin-TransUper. Firstly, we explore extending UperNet by incorporating the hierarchical Swin Transformer with shifted windows, thereby enhancing the global modeling capability of the model. Secondly, we introduce an SPPM (Swin Pyramid Pooling Module) to conduct multi-scale feature mining on the deepest features generated by the encoder, fully considering the semantic information of the deepest features. Finally, the multi-scale attention module aggregates the multi-scale feature information to obtain a more refined feature map. Our method achieves the state-of-the-art performance of 80.08%, 90.25%, and 90.62% on the Synapse multi-organ segmentation, ISIC2017, and ACDC datasets based on the DSC (Dice Similarity Coefficient) metric. At the same time, experimental results on the ISIC2017 dataset show that Swin-TransUper achieves the best performance on Sensitivity and Accuracy metrics of 91.20% and 96.44%, respectively. Our code is available at https://github.com/JianJianYin/Swin-TransUper.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Sfe-Transunet: A Transformer-Based U-Net With Skipped Features Enhancer For Medical Image Segmentation

Jianuo Huang,Lan Quan,Wen Deng,Chenxi Huang,Suzhen Zhang

DOI: https://doi.org/10.1142/s0219519424400505

2024-08-21

Journal of Mechanics in Medicine and Biology

Abstract:Journal of Mechanics in Medicine and Biology, Ahead of Print. In the field of medical image segmentation, deep convolutional neural networks have achieved satisfying performance in the past decade or so. However, there are some shortcomings. First, the convolutional neural network model cannot provide good insight into the remote dependencies in the image. Second, medical imaging datasets are typically small, which leads to a much higher risk of overfitting in model training. To address these limitations, we innovatively designed the skipped features enhancer (SFE) to enhance the impact of preserved details. To gain insight into remote dependencies in images, this model (SFE-TransUNet) is based on transformer. Additionally, a different scale convolutional layer (additional information capturer) before and after the Transformer Encoder to fuse the features to retain more information of the original data. In addition, a gate mechanism was introduced in the multi-head self-attention (MHSA), and. Finally, an attention block with residuals. SFE-TransUNet was evaluated on two public medical image segmentation datasets. Experimental results show that it achieves better performance than other related Transformer-based architectures. Code available at https://github.com/xackz/SFE-TransUNet.

engineering, biomedical,biophysics
MwUnet - A Semantic Segmentation Deep Learning Method for the Ultrasonic Image of Hydronephrosis in Children.

Haoran Peng,Yu Guan,Jianqiang Li,Xi Xu,Pengceng Wen,Jijiang Yang,Yanhe Jia,Xianghui Xie,Minglei Li,Xiaoman Wang,Yue Xin,Yuzhu He

DOI: https://doi.org/10.1109/smc52423.2021.9658930

2021-01-01

Abstract:Hydronephrosis may lead to many potential diseases, and the diagnosis of hydronephrosis is time-consuming and laborious. To assist physicians in hydronephrosis diagnosis and treatment planning, an accurate and automatic kidney segmentation method is highly required in clinical practice. In recent years, deep convolutional neural networks such as Unet plays a key role in the field of image segmentation, but Unet itself cannot adjust the receptive field actively, which may result in poor attention to the characteristics of the segmented target. We propose an encoder-decoder network with weighted skip connections and the idea of hierarchical equal resolution that can manually control the receptive field. We evaluated our method by comparing it with various classical networks using a dataset of 1850 annotated images. The MPA of the model is 94.12 and the MIoU is 89.49, which outperformed other classical networks we compared to.
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation

Huimin Huang,Lanfen Lin,Ruofeng Tong,Hongjie Hu,Qiaowei Zhang,Yutaro Iwamoto,Xianhua Han,Yen-Wei Chen,Jian Wu

DOI: https://doi.org/10.48550/arXiv.2004.08790

2020-04-19

Image and Video Processing

Abstract:Recently, a growing interest has been seen in deep learning-based semantic segmentation. UNet, which is one of deep learning networks with an encoder-decoder architecture, is widely used in medical image segmentation. Combining multi-scale features is one of important factors for accurate segmentation. UNet++ was developed as a modified Unet by designing an architecture with nested and dense skip connections. However, it does not explore sufficient information from full scales and there is still a large room for improvement. In this paper, we propose a novel UNet 3+, which takes advantage of full-scale skip connections and deep supervisions. The full-scale skip connections incorporate low-level details with high-level semantics from feature maps in different scales; while the deep supervision learns hierarchical representations from the full-scale aggregated feature maps. The proposed method is especially benefiting for organs that appear at varying scales. In addition to accuracy improvements, the proposed UNet 3+ can reduce the network parameters to improve the computation efficiency. We further propose a hybrid loss function and devise a classification-guided module to enhance the organ boundary and reduce the over-segmentation in a non-organ image, yielding more accurate segmentation results. The effectiveness of the proposed method is demonstrated on two datasets. The code is available at: github.com/ZJUGiveLab/UNet-Version
MD-UNet: a medical image segmentation network based on mixed depthwise convolution

Yun Liu,Shuanglong Yao,Xing Wang,Ji Chen,Xiaole Li

DOI: https://doi.org/10.1007/s11517-023-03005-8

2023-12-31

Medical & Biological Engineering & Computing

Abstract:In the process of cancer diagnosis and treatment, accurate extraction of the lesion area helps the doctor to judge the condition. Currently, medical image segmentation algorithms based on UNet have been verified to be able to play an important role in clinical diagnosis. However, these methods still have the following drawbacks in extracting the region of interest (ROI): (1) ignoring the intra-class variability of medical images. (2) Failure to obtain effective feature redundancy. To address these problems, a U-shaped medical image segmentation network based on a Mixed depthwise convolution residual module (MDRM), called MD-UNet, is proposed in this paper. In MD-UNet, the MDRM built with a Mixed depthwise convolution attention block (MDAB) captures both local and global dependencies in the image to mitigate the effects of intra-class differences. MDAB captures valid redundant features and further captures global features of the input data. At the same time, the lightweight MDAB senses changes in the receptive field and generates multiple feature mappings. Compared with UNeXt on the ISIC2018 dataset, the MD-UNet segmentation accuracy Dice and IoU are improved by 1.33% and 1.91%, respectively. The code is available at https://github.com/Cloud-Liu/MD-UNet.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics

The role of mast cells, interleukin-13 and transient receptor potential channels in a mouse model of chemical-induced airway hyperresponsiveness

Spinal MRI image segmentation based on improved U-Net

A Spinal MRI Image Segmentation Method Based on Improved Swin-UNet

RAU-Net: U-Net network based on residual multi-scale fusion and attention skip layer for overall spine segmentation

Segmentation of brain tumor MRI image based on improved attention module Unet network

SK-Unet: An Improved U-Net Model With Selective Kernel for the Segmentation of LGE Cardiac MR Images

A Medical Image Segmentation Method Based on Improved UNet 3+ Network

Multi-Scale Hybrid Attention Convolutional Neural Network for Automatic Segmentation of Lumbar Vertebrae From MRI

RUnT: A Network Combining Residual U-Net and Transformer for Vertebral Edge Feature Fusion Constrained Spine CT Image Segmentation

UNet based on dynamic convolution decomposition and triplet attention

MS-UNet: Multi-Scale Nested UNet for Medical Image Segmentation with Few Training Data Based on an ELoss and Adaptive Denoising Method

Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation

A Novel Deep Learning Pipeline for Vertebra Labeling and Segmentation of Spinal Computed Tomography Images

SK-Unet: an Improved U-net Model with Selective Kernel for the Segmentation of Multi-sequence Cardiac MR

Retinal Blood Vessels Segmentation With Improved SE‐UNet Model

An attention mechanism‐based lightweight UNet for musculoskeletal ultrasound image segmentation

Swin-TransUper: Swin Transformer-based UperNet for medical image segmentation

Sfe-Transunet: A Transformer-Based U-Net With Skipped Features Enhancer For Medical Image Segmentation

MwUnet - A Semantic Segmentation Deep Learning Method for the Ultrasonic Image of Hydronephrosis in Children.

UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation

MD-UNet: a medical image segmentation network based on mixed depthwise convolution