Competitive neural networks for image segmentation

Huajin Tang,Kaychen Tan,Zhang Yi

DOI: https://doi.org/10.1007/978-3-540-69226-3_9

2007-01-01

Abstract:null

What problem does this paper attempt to address?

An improvement on competitive neural networks applied to image segmentation

Rui Yan,Meng Joo Er,Huajin Tang

DOI: https://doi.org/10.1007/11760023_73

2006-01-01

Abstract:Image segmentation is a long existing problem and still regarded as unsolved to a large extent in computer vision. This letter describes the modeling method of competitive neural networks and elucidates its connection with the Hopfield type optimization network. A new algorithm to map the image segmentation problem onto competitive networks is proposed and its convergence is shown by the stability analysis. Finally, the improvement on the competitive neural networks based method is validated by the simulation results.
A memristive RBF neural network and its application in unsupervised medical image segmentation

Sicong Liu,Chunbiao Li,Zhenyu Lu,Yongxin Li,Qiang Lai

DOI: https://doi.org/10.1140/epjs/s11734-022-00474-0

2022-03-07

The European Physical Journal Special Topics

Abstract:Recently, the image segmentation algorithm based on neural network has made great progress in the field of medical image segmentation, but it still faces many challenges such as the small set of training sample data, the lackness of background training data, weak network generalization ability, and poor network performance. To overcome the above difficulties, a new memristive Radial Basis Function (RBF) neural network is proposed for training effectively small sample set, which shows strong power of global searching and great generalization ability. Based on the memristive neural network and K-means clustering algorithm, a new algorithm for unsupervised image segmentation is designed. Through the analysis of experimental data, it is found that the algorithm proposed in this paper can segment medical images accurately without expert labeling data.
Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Yun Jiang,Wenhuan Liu,Chao Wu,Huixiao Yao

DOI: https://doi.org/10.3390/sym13030365

2021-01-01

Symmetry

Abstract:The accurate segmentation of retinal images is a basic step in screening for retinopathy and glaucoma. Most existing retinal image segmentation methods have insufficient feature information extraction. They are susceptible to the impact of the lesion area and poor image quality, resulting in the poor recovery of contextual information. This also causes the segmentation results of the model to be noisy and low in accuracy. Therefore, this paper proposes a multi-scale and multi-branch convolutional neural network model (multi-scale and multi-branch network (MSMB-Net)) for retinal image segmentation. The model uses atrous convolution with different expansion rates and skip connections to reduce the loss of feature information. Receiving domains of different sizes captures global context information. The model fully integrates shallow and deep semantic information and retains rich spatial information. The network embeds an improved attention mechanism to obtain more detailed information, which can improve the accuracy of segmentation. Finally, the method of this paper was validated on the fundus vascular datasets, DRIVE, STARE and CHASE datasets, with accuracies/F1 of 0.9708/0.8320, 0.9753/0.8469 and 0.9767/0.8190, respectively. The effectiveness of the method in this paper was further validated on the optic disc visual cup DRISHTI-GS1 dataset with an accuracy/F1 of 0.9985/0.9770. Experimental results show that, compared with existing retinal image segmentation methods, our proposed method has good segmentation performance in all four benchmark tests.
ALA-Net: Adaptive Lesion-Aware Attention Network for 3D Colorectal Tumor Segmentation

Yankai Jiang,Shufeng Xu,Hongjie Fan,Jiahong Qian,Weizhi Luo,Shihui Zhen,Jihong Sun,Yubo Tao,Hai Lin

DOI: https://doi.org/10.1109/TMI.2021.3093982

IF: 10.6

2021-01-01

IEEE Transactions on Medical Imaging

Abstract:Accurate and reliable segmentation of colorectal tumors and surrounding colorectal tissues on 3D magnetic resonance images has critical importance in preoperative prediction, staging, and radiotherapy. Previous works simply combine multilevel features without aggregating representative semantic information and without compensating for the loss of spatial information caused by down-sampling. Theref...
Edge and neighborhood guidance network for 2D medical image segmentation

Weiwei Cao,Jian Zheng,Dehui Xiang,Saisai Ding,Haotian Sun,Xiaodong Yang,Zhaobang Liu,Yakang Dai

DOI: https://doi.org/10.1016/j.bspc.2021.102856

IF: 5.1

2021-01-01

Biomedical Signal Processing and Control

Abstract:Accurate automatic image segmentation is important in medical image analysis. A perfect segmentation using fully convolutional network (FCN) means an accurate classification of each pixel. However, it is still a great challenge to accurately differentiate edge pixels from neighborhood pixels in weak edge regions. Many previous segmentation methods have focused on edge information to mitigate weak edge problems, but the more important neighborhood information is undervalued. To tackle this problem, in this paper, we propose a novel yet effective Edge and Neighborhood Guidance Network (ENGNet). Specifically, instead of just utilizing the edge information as the shape constraints, the edge and neighborhood guidance (ENG) module is designed to exploit the edge information and fine-grained neighborhood spatial information simultaneously, so as to improve the ability of network to classify edge pixels and neighborhood pixels in weak edge regions. Moreover, the ENG modules are adopted in different scales to learn sufficient feature representations of edge and neighborhood. To extract complementary features more effectively in channel dimension, we also design a multi-scale adaptive selection (MAS) module at channel-wise to extract multi-scale context information and adaptively fuse differentscale features. Two 2D public segmentation datasets including skin lesion dataset and endoscopic polyp dataset are used to evaluate the performance of the proposed ENGNet. Experimental results demonstrated that by exploiting edge information and neighborhood spatial information in different scales simultaneously, the proposed ENGNet can effectively alleviate the misclassification in weak edge regions and achieve better performance than other state-of-the-art methods.
Deep Learning of Unified Region, Edge, and Contour Models for Automated Image Segmentation

Ali Hatamizadeh

DOI: https://doi.org/10.48550/arXiv.2006.12706

2020-06-23

Computer Vision and Pattern Recognition

Abstract:Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have gained traction in the design of automated segmentation pipelines. Although CNN-based models are adept at learning abstract features from raw image data, their performance is dependent on the availability and size of suitable training datasets. Additionally, these models are often unable to capture the details of object boundaries and generalize poorly to unseen classes. In this thesis, we devise novel methodologies that address these issues and establish robust representation learning frameworks for fully-automatic semantic segmentation in medical imaging and mainstream computer vision. In particular, our contributions include (1) state-of-the-art 2D and 3D image segmentation networks for computer vision and medical image analysis, (2) an end-to-end trainable image segmentation framework that unifies CNNs and active contour models with learnable parameters for fast and robust object delineation, (3) a novel approach for disentangling edge and texture processing in segmentation networks, and (4) a novel few-shot learning model in both supervised settings and semi-supervised settings where synergies between latent and image spaces are leveraged to learn to segment images given limited training data.
MH-Net: Model-data-driven hybrid-fusion network for medical image segmentation

Yunyun Yang,Tingyu Yan,Xin Jiang,Ruicheng Xie,Chun Li,Tao Zhou

DOI: https://doi.org/10.1016/j.knosys.2022.108795

2022-04-01

Abstract:Image segmentation is an essential step in medical image analysis, as its results directly affect the quality of the follow-up analysis. Because of the high calculation speed and the good performance of the segmentation algorithms based on neural networks (NNs), image segmentation has been extensively researched and developed in clinical analysis and applications. However, the existing NN-based image segmentation methods only consider the pixel information of the image that needs to be segmented, and they cannot guarantee the continuity and smoothness of the segmented edge. Consequently, we propose the model and data-driven hybrid approach, namely, the model-data-driven hybrid-fusion network for medical image segmentation. We consider the attention mechanism and the high-low features, and embed the traditional curvature regularisation segmentation model into the NN in the form of a loss function. Moreover, our model considers not only the semantic information of the segmented image but also the boundary length information of the ROI and the target region information. These can ensure the smoothness of the edge of the medical image segmentation results. We conduct intensive experiments on several benchmark datasets to evaluate the effectiveness of our method in dealing with complex backgrounds and noise. Experimental results demonstrate that the proposed model outperforms other state-of-the-art segmentation methods.

computer science, artificial intelligence
CMUNeXt: An Efficient Medical Image Segmentation Network based on Large Kernel and Skip Fusion

Fenghe Tang,Jianrui Ding,Lingtao Wang,Chunping Ning,S. Kevin Zhou

2023-08-03

Abstract:The U-shaped architecture has emerged as a crucial paradigm in the design of medical image segmentation networks. However, due to the inherent local limitations of convolution, a fully convolutional segmentation network with U-shaped architecture struggles to effectively extract global context information, which is vital for the precise localization of lesions. While hybrid architectures combining CNNs and Transformers can address these issues, their application in real medical scenarios is limited due to the computational resource constraints imposed by the environment and edge devices. In addition, the convolutional inductive bias in lightweight networks adeptly fits the scarce medical data, which is lacking in the Transformer based network. In order to extract global context information while taking advantage of the inductive bias, we propose CMUNeXt, an efficient fully convolutional lightweight medical image segmentation network, which enables fast and accurate auxiliary diagnosis in real scene scenarios. CMUNeXt leverages large kernel and inverted bottleneck design to thoroughly mix distant spatial and location information, efficiently extracting global context information. We also introduce the Skip-Fusion block, designed to enable smooth skip-connections and ensure ample feature fusion. Experimental results on multiple medical image datasets demonstrate that CMUNeXt outperforms existing heavyweight and lightweight medical image segmentation networks in terms of segmentation performance, while offering a faster inference speed, lighter weights, and a reduced computational cost. The code is available at <a class="link-external link-https" href="https://github.com/FengheTan9/CMUNeXt" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
New Theories and Methods of Image Segmentation

Xin-zheng XU,Shi-fei DING,Zhong-zhi SHI,Wei-kuan JIA

2010-01-01

Abstract:Image segmentation is a classic problem in computer vision,and become a hot topic in the field of image understanding.The research actuality and new progress in image segmentation in recent years are summarized in this paper.Firstly,the traditional methods of image segmentation are introduced summarily.Then,the specific theory for image segmentation,including morphology,fuzzy sets and neural network,support vector machine,immune algorithm,graph theory and granular computing,are presented emphatically.Furthermore,several new representative papers with the application of each theory are analyzed and discussed.Finally,the development trend of image segmentation method is discussed.
ET-Net: A Generic Edge-aTtention Guidance Network for Medical Image Segmentation

Zhijie Zhang,Huazhu Fu,Hang Dai,Jianbing Shen,Yanwei Pang,Ling Shao

DOI: https://doi.org/10.48550/arXiv.1907.10936

2019-07-25

Abstract:Segmentation is a fundamental task in medical image analysis. However, most existing methods focus on primary region extraction and ignore edge information, which is useful for obtaining accurate segmentation. In this paper, we propose a generic medical segmentation method, called Edge-aTtention guidance Network (ET-Net), which embeds edge-attention representations to guide the segmentation network. Specifically, an edge guidance module is utilized to learn the edge-attention representations in the early encoding layers, which are then transferred to the multi-scale decoding layers, fused using a weighted aggregation module. The experimental results on four segmentation tasks (i.e., optic disc/cup and vessel segmentation in retinal images, and lung segmentation in chest X-Ray and CT images) demonstrate that preserving edge-attention representations contributes to the final segmentation accuracy, and our proposed method outperforms current state-of-the-art segmentation methods. The source code of our method is available at <a class="link-external link-https" href="https://github.com/ZzzJzzZ/ETNet" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Research on U-Net Medical Image Segmentation

Fangfang Song,Yimin Tian,Xue Gao,Shuai Yang,Meijun Zheng

DOI: https://doi.org/10.1117/12.2631325

2022-01-01

Abstract:With the rapid development of deep learning technology and medical technology, neural networks are widely used in the field of medical image segmentation. Among them, U-Net neural network has gradually become a research hotspot in the field of image segmentation because of its good segmentation performance. It provides doctors with a consistent method of quantifying lesions and is widely used in the field of medical image semantic segmentation. This article studies the U-Net network, learns theoretically from the U-Net network model and its basic principles, and then conducts experiments on three typical medical images of liver medical images, fundus blood vessel images, and lung nodule images to explain various types of medical images. The characteristics of the image and the difficulty of segmentation, and the performance of the U-Net network in the relevant image segmentation is verified. Finally, the problems existing in U-Net network are discussed, and the future development is prospected.
UnSegGNet: Unsupervised Image Segmentation using Graph Neural Networks

Kovvuri Sai Gopal Reddy,Bodduluri Saran,A. Mudit Adityaja,Saurabh J. Shigwan,Nitin Kumar

2024-05-10

Abstract:Image segmentation, the process of partitioning an image into meaningful regions, plays a pivotal role in computer vision and medical imaging applications. Unsupervised segmentation, particularly in the absence of labeled data, remains a challenging task due to the inter-class similarity and variations in intensity and resolution. In this study, we extract high-level features of the input image using pretrained vision transformer. Subsequently, the proposed method leverages the underlying graph structures of the images, seeking to discover and delineate meaningful boundaries using graph neural networks and modularity based optimization criteria without relying on pre-labeled training data. Experimental results on benchmark datasets demonstrate the effectiveness and versatility of the proposed approach, showcasing competitive performance compared to the state-of-the-art unsupervised segmentation methods. This research contributes to the broader field of unsupervised medical imaging and computer vision by presenting an innovative methodology for image segmentation that aligns with real-world challenges. The proposed method holds promise for diverse applications, including medical imaging, remote sensing, and object recognition, where labeled data may be scarce or unavailable. The github repository of the code is available on [

Computer Vision and Pattern Recognition,Machine Learning
HTC-Net: A hybrid CNN-transformer framework for medical image segmentation

Hui Tang,Yuanbin Chen,Tao Wang,Yuanbo Zhou,Longxuan Zhao,Qinquan Gao,Min Du,Tao Tan,Xinlin Zhang,Tong Tong

DOI: https://doi.org/10.1016/j.bspc.2023.105605

IF: 5.1

2023-10-23

Biomedical Signal Processing and Control

Abstract:Automated medical image segmentation is a crucial step in clinical analysis and diagnosis, as it can improve diagnostic efficiency and accuracy. Deep convolutional neural networks (DCNNs) have been widely used in the medical field, achieving excellent results. The high complexity of medical images poses a significant challenge for many networks in balancing local and global information, resulting in unstable segmentation outcomes. To address the challenge, we designed a hybrid CNN-Transformer network to capture both the local and global information. More specifically, deep convolutional neural networks are introduced to exploit the local information. At the same time, we designed a trident multi-layer fusion (TMF) block for the Transformer to fuse contextual information from higher-level (global) features dynamically. Moreover, considering the inherent characteristic of medical image segmentation (e.g., irregular shapes and discontinuous boundaries), we developed united attention (UA) blocks to focus on important feature learning. To evaluate the effectiveness of our proposed approach, we performed experiments on two publicly available datasets, ISIC-2017, and Kvasir-SEG, and compared our results with state-of-the-art approaches. The experimental results demonstrate the superior performance of our approach. The codes are available at https://github.com/Tanghui2000/HTC-Net .

engineering, biomedical
Make U-Net Greater: An Easy-to-Embed Approach to Improve Segmentation Performance Using Hypergraph

Jing Peng,Jingfu Yang,Chaoyang Xia,Xiaojie Li,Yanfen Guo,Ying Fu,Xinlai Chen,Zhe Cui

DOI: https://doi.org/10.32604/csse.2022.022314

IF: 4.397

2022-01-01

Computer Systems Science and Engineering

Abstract:Cardiac anatomy segmentation is essential for cardiomyopathy clinical diagnosis and treatment planning. Thus, accurate delineation of target volumes at risk in cardiac anatomy is important. However, manual delineation is a time-consuming and labor-intensive process for cardiologists and has been shown to lead to significant inter-and intra-practitioner variability. Thus, computer-aided or fully automatic segmentation methods are required. They can significantly economize on manpower and improve treatment efficiency. Recently, deep convolutional neural network (CNN) based methods have achieved remarkable successes in various kinds of vision tasks, such as classification, segmentation and object detection. Semantic segmentation can be considered as a pixel-wise task, it requires high-level abstract semantics information while maintaining spatial detail contexts. Long-range context information plays a crucial role in this scenario. However, the traditional convolution kernel only provides the local and small size of the receptive field. To address the problem, we propose a plug-and-play module aggregating both local and global information (aka LGIA module) to capture the high-order relationship between nodes that are far apart. We incorporate both local and global correlations into hypergraph which is able to capture high-order relationships between nodes via the concept of a hyperedge connecting a subset of nodes. The local correlation considers neighborhood nodes that are spatially adjacent and similar in the same CNN feature maps of magnetic resonance (MR) image; and the global correlation is searched from a batch of CNN feature maps of MR images in feature space. The influence of these two correlations on semantic segmentation is complementary. We validated our LGIA module on various results demonstrate that our approach outperformed several baseline models.
CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

Wenyu Xing,Zhibin Zhu,Dongni Hou,Yaoting Yue,Fei Dai,Yifang Li,Lin Tong,Yuanlin Song,Dean Ta

DOI: https://doi.org/10.1016/j.compbiomed.2022.105797

IF: 7.7

2022-01-01

Computers in Biology and Medicine

Abstract:Accurate segmentation of lesions in medical images is of great significance for clinical diagnosis and evaluation. The low contrast between lesions and surrounding tissues increases the difficulty of automatic segmentation, while the efficiency of manual segmentation is low. In order to increase the generalization performance of segmentation model, we proposed a deep learning-based automatic segmentation model called CM-SegNet for segmenting medical images of different modalities. It was designed according to the multiscale input and encoding-decoding thoughts, and composed of multilayer perceptron and convolution modules. This model achieved communication of different channels and different spatial locations of each patch, and considers the edge related feature information between adjacent patches. Thus, it could fully extract global and local image information for the segmentation task. Meanwhile, this model met the effective segmentation of different structural lesion regions in different slices of three-dimensional medical images. In this experiment, the proposed CM-SegNet was trained, validated, and tested using six medical image datasets of different modalities and 5-fold cross validation method. The results showed that the CM-SegNet model had better segmentation performance and shorter training time for different medical images than the previous methods, suggesting it is faster and more accurate in automatic segmentation and has great potential application in clinic.
Learning Deep Conditional Neural Network for Image Segmentation

Qiurui Wang,Chun Yuan,Yan Liu

DOI: https://doi.org/10.1109/tmm.2018.2890360

IF: 7.3

2019-01-01

IEEE Transactions on Multimedia

Abstract:Combining Convolutional Neural Networks (CNNs) with Conditional Random Fields (CRFs) achieves great success among recent object segmentation methods. There are two advantages by such usage. First, CNNs can extract low-level features, which are very similar to the extracted features in primates’ primary visual cortex (V1). Second, CRFs can set up the relationship between input features and output labels in a direct way. In this paper, we extend the first advantage by using CNNs for low-level feature extraction and a Structured Random Forest (SRF)-based border ownership detector for high-level feature extraction, which are similar to the outputs of primates secondary visual cortex (V2). Compared to the CRF model, an improved Conditional Boltzmann Machine (CBM), which has a multi-channel visible layer, is proposed to model the relationship between predicted labels, local and global contexts of objects with multi-scale and multilevel features. Besides, our proposed CBM model is extended for object parsing by using multivisible branches instead of a single visible layer of CBM, which cannot only segment the whole body but also the parts of the body under. These visible branches use each branch for the segmentation of the whole body or one of the body parts. All branches share the same hidden layers of CBM and train the branches under an iterative way. By exploiting object parsing, the whole body segmentation performance of object is improved. To refine the segmentation output, two kinds of optimization algorithms are proposed. The superpixel-based algorithm can re-label the overlapped regions of multiple kinds of objects. The other curve correction algorithm corrects the edges of segmented object parts by using smooth edges under a curve similarity criterion. Experiments demonstrate that our models yield competitive results for object segmentation on the PASCAL VOC 2012 dataset and for object parsing on the PennFudan Pedestrian Parsing dataset, Pedestrian Parsing Surveillance Scenes dataset, Horse-Cow parsing dataset, and PASCAL Quadrupeds dataset.
GL-Segnet: Global-Local representation learning net for medical image segmentation

Di Gai,Jiqian Zhang,Yusong Xiao,Weidong Min,Hui Chen,Qi Wang,Pengxiang Su,Zheng Huang

DOI: https://doi.org/10.3389/fnins.2023.1153356

IF: 4.3

2023-04-04

Frontiers in Neuroscience

Abstract:Medical image segmentation has long been a compelling and fundamental problem in the realm of neuroscience. This is an extremely challenging task due to the intensely interfering irrelevant background information to segment the target. State-of-the-art methods fail to consider simultaneously addressing both long-range and short-range dependencies, and commonly emphasize the semantic information characterization capability while ignoring the geometric detail information implied in the shallow feature maps resulting in the dropping of crucial features. To tackle the above problem, we propose a Global-Local representation learning net for medical image segmentation, namely GL-Segnet. In the Feature encoder, we utilize the Multi-Scale Convolution (MSC) and Multi-Scale Pooling (MSP) modules to encode the global semantic representation information at the shallow level of the network, and multi-scale feature fusion operations are applied to enrich local geometric detail information in a cross-level manner. Beyond that, we adopt a global semantic feature extraction module to perform filtering of irrelevant background information. In Attention-enhancing Decoder, we use the Attention-based feature decoding module to refine the multi-scale fused feature information, which provides effective cues for attention decoding. We exploit the structural similarity between images and the edge gradient information to propose a hybrid loss to improve the segmentation accuracy of the model. Extensive experiments on medical image segmentation from Glas, ISIC, Brain Tumors and SIIM-ACR demonstrated that our GL-Segnet is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

neurosciences
Robust Medical Image Segmentation from Non-expert Annotations with Tri-network

Tianwei Zhang,Lequan Yu,Na Hu,Su Lv,Shi Gu

DOI: https://doi.org/10.1007/978-3-030-59719-1_25

2020-01-01

Abstract:Deep convolutional neural networks (CNNs) have achieved commendable results on a variety of medical image segmentation tasks. However, CNNs usually require a large amount of training samples with accurate annotations, which are extremely difficult and expensive to obtain in medical image analysis field. In practice, we notice that the junior trainees after training can label medical images in some medical image segmentation applications. These non-expert annotations are more easily accessible and can be regarded as a source of weak annotation to guide network learning. In this paper, we propose a novel Tri-network learning framework to alleviate the problem of insufficient accurate annotations in medical segmentation tasks by utilizing the non-expert annotations. To be specific, we maintain three networks in our framework, and each pair of networks alternatively select informative samples for the third network learning, according to the consensus and difference between their predictions. The three networks are jointly optimized in such a collaborative manner. We evaluated our method on real and simulated non-expert annotated datasets. The experiment results show that our method effectively mines informative information from the non-expert annotations for improved segmentation performance and outperforms other competing methods.
TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation

Rong Zhou,Zhengqing Yuan,Zhiling Yan,Weixiang Sun,Kai Zhang,Yiwei Li,Yanfang Ye,Xiang Li,Lifang He,Lichao Sun

2024-09-19

Abstract:Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, struggle to effectively capture long-range dependencies due to the inherent locality of CNNs and the computational complexity of Transformers. To address this limitation, we introduce TTT-Unet, a novel framework that integrates Test-Time Training (TTT) layers into the traditional U-Net architecture for biomedical image segmentation. TTT-Unet dynamically adjusts model parameters during the testing time, enhancing the model's ability to capture both local and long-range features. We evaluate TTT-Unet on multiple medical imaging datasets, including 3D abdominal organ segmentation in CT and MR images, instrument segmentation in endoscopy images, and cell segmentation in microscopy images. The results demonstrate that TTT-Unet consistently outperforms state-of-the-art CNN-based and Transformer-based segmentation models across all tasks. The code is available at <a class="link-external link-https" href="https://github.com/rongzhou7/TTT-Unet" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
CMU-Net: A Strong ConvMixer-based Medical Ultrasound Image Segmentation Network

Fenghe Tang,Lingtao Wang,Chunping Ning,Min Xian,Jianrui Ding

DOI: https://doi.org/10.1109/ISBI53787.2023.10230609

2022-11-10

Abstract:U-Net and its extensions have achieved great success in medical image segmentation. However, due to the inherent local characteristics of ordinary convolution operations, U-Net encoder cannot effectively extract global context information. In addition, simple skip connections cannot capture salient features. In this work, we propose a fully convolutional segmentation network (CMU-Net) which incorporates hybrid convolutions and multi-scale attention gate. The ConvMixer module extracts global context information by mixing features at distant spatial locations. Moreover, the multi-scale attention gate emphasizes valuable features and achieves efficient skip connections. We evaluate the proposed method using both breast ultrasound datasets and a thyroid ultrasound image dataset; and CMU-Net achieves average Intersection over Union (IoU) values of 73.27% and 84.75%, and F1 scores of 84.81% and 91.71%. The code is available at <a class="link-external link-https" href="https://github.com/FengheTan9/CMU-Net" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

Competitive neural networks for image segmentation

An improvement on competitive neural networks applied to image segmentation

A memristive RBF neural network and its application in unsupervised medical image segmentation

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

ALA-Net: Adaptive Lesion-Aware Attention Network for 3D Colorectal Tumor Segmentation

Edge and neighborhood guidance network for 2D medical image segmentation

Deep Learning of Unified Region, Edge, and Contour Models for Automated Image Segmentation

MH-Net: Model-data-driven hybrid-fusion network for medical image segmentation

CMUNeXt: An Efficient Medical Image Segmentation Network based on Large Kernel and Skip Fusion

New Theories and Methods of Image Segmentation

ET-Net: A Generic Edge-aTtention Guidance Network for Medical Image Segmentation

Research on U-Net Medical Image Segmentation

UnSegGNet: Unsupervised Image Segmentation using Graph Neural Networks

HTC-Net: A hybrid CNN-transformer framework for medical image segmentation

Make U-Net Greater: An Easy-to-Embed Approach to Improve Segmentation Performance Using Hypergraph

CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

Learning Deep Conditional Neural Network for Image Segmentation

GL-Segnet: Global-Local representation learning net for medical image segmentation

Robust Medical Image Segmentation from Non-expert Annotations with Tri-network

TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation

CMU-Net: A Strong ConvMixer-based Medical Ultrasound Image Segmentation Network