Effect of Metabolites of γ-Aminobutyric Shunt on Activities of NAD- and NADP-Isocitrate Dehydrogenases and Aconitate Hydratase from Higher Plants

M. P. D. Pinheiro de Carvalho,T. N. Popova,T. M. M. Dos Santos,N. A. Zherebtsov

DOI: https://doi.org/10.1023/A:1023899527163

2003-05-01

Biology Bulletin of the Russian Academy of Sciences

Abstract:

What problem does this paper attempt to address?

Medical Image Segmentation Using a U-Net type of Architecture

Eshal Zahra,Bostan Ali,Wajahat Siddique

DOI: https://doi.org/10.48550/arXiv.2005.05218

2020-05-12

Abstract:Deep convolutional neural networks have been proven to be very effective in image related analysis and tasks, such as image segmentation, image classification, image generation, etc. Recently many sophisticated CNN based architectures have been proposed for the purpose of image segmentation. Some of these newly designed networks are used for the specific purpose of medical image segmentation, models like V-Net, U-Net and their variants. It has been shown that U-Net produces very promising results in the domain of medical image <a class="link-external link-http" href="http://segmentation.However" rel="external noopener nofollow">this http URL</a>, in this paper, we argue that the architecture of U-Net, when combined with a supervised training strategy at the bottleneck layer, can produce comparable results with the original U-Net architecture. More specifically, we introduce a fully supervised FC layers based pixel-wise loss at the bottleneck of the encoder branch of U-Net. The two layer based FC sub-net will train the bottleneck representation to contain more semantic information, which will be used by the decoder layers to predict the final segmentation map. The FC layer based sub-net is trained by employing the pixel-wise cross entropy loss, while the U-Net architectures trained by using L1 loss.

Image and Video Processing,Computer Vision and Pattern Recognition
U-Net-Based Medical Image Segmentation

Xiao-Xia Yin,Le Sun,Yuhan Fu,Ruiliang Lu,Yanchun Zhang

DOI: https://doi.org/10.1155/2022/4189781

2022-04-15

Journal of Healthcare Engineering

Abstract:Deep learning has been extensively applied to segmentation in medical imaging. U-Net proposed in 2015 shows the advantages of accurate segmentation of small targets and its scalable network architecture. With the increasing requirements for the performance of segmentation in medical imaging in recent years, U-Net has been cited academically more than 2500 times. Many scholars have been constantly developing the U-Net architecture. This paper summarizes the medical image segmentation technologies based on the U-Net structure variants concerning their structure, innovation, efficiency, etc.; reviews and categorizes the related methodology; and introduces the loss functions, evaluation parameters, and modules commonly applied to segmentation in medical imaging, which will provide a good reference for the future research.

health care sciences & services
DC-UNet: Rethinking the U-Net Architecture with Dual Channel Efficient CNN for Medical Images Segmentation

Ange Lou,Shuyue Guan,Murray Loew

DOI: https://doi.org/10.48550/arXiv.2006.00414

2020-05-31

Abstract:Recently, deep learning has become much more popular in computer vision area. The Convolution Neural Network (CNN) has brought a breakthrough in images segmentation areas, especially, for medical images. In this regard, U-Net is the predominant approach to medical image segmentation task. The U-Net not only performs well in segmenting multimodal medical images generally, but also in some tough cases of them. However, we found that the classical U-Net architecture has limitation in several aspects. Therefore, we applied modifications: 1) designed efficient CNN architecture to replace encoder and decoder, 2) applied residual module to replace skip connection between encoder and decoder to improve based on the-state-of-the-art U-Net model. Following these modifications, we designed a novel architecture--DC-UNet, as a potential successor to the U-Net architecture. We created a new effective CNN architecture and build the DC-UNet based on this CNN. We have evaluated our model on three datasets with tough cases and have obtained a relative improvement in performance of 2.90%, 1.49% and 11.42% respectively compared with classical U-Net. In addition, we used the Tanimoto similarity to replace the Jaccard similarity for gray-to-gray image comparisons.

Image and Video Processing,Computer Vision and Pattern Recognition
U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation

Yaopeng Peng,Milan Sonka,Danny Z. Chen

2024-03-31

Abstract:In this paper, we introduce U-Net v2, a new robust and efficient U-Net variant for medical image segmentation. It aims to augment the infusion of semantic information into low-level features while simultaneously refining high-level features with finer details. For an input image, we begin by extracting multi-level features with a deep neural network encoder. Next, we enhance the feature map of each level by infusing semantic information from higher-level features and integrating finer details from lower-level features through Hadamard product. Our novel skip connections empower features of all the levels with enriched semantic characteristics and intricate details. The improved features are subsequently transmitted to the decoder for further processing and segmentation. Our method can be seamlessly integrated into any Encoder-Decoder network. We evaluate our method on several public medical image segmentation datasets for skin lesion segmentation and polyp segmentation, and the experimental results demonstrate the segmentation accuracy of our new method over state-of-the-art methods, while preserving memory and computational efficiency. Code is available at: <a class="link-external link-https" href="https://github.com/yaoppeng/U-Net_v2" rel="external noopener nofollow">this https URL</a>

Image and Video Processing,Computer Vision and Pattern Recognition
3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

Chao Huang,Hu Han,Qingsong Yao,Shankuan Zhu,S. Kevin Zhou

DOI: https://doi.org/10.1007/978-3-030-32245-8_33

2019-01-01

Abstract:Fully convolutional neural networks like U-Net have been the state-of-the-art methods in medical image segmentation. Practically, a network is highly specialized and trained separately for each segmentation task. Instead of a collection of multiple models, it is highly desirable to learn a universal data representation for different tasks, ideally a single model with the addition of a minimal number of parameters steered to each task. Inspired by the recent success of multi-domain learning in image classification, for the first time we explore a promising universal architecture that handles multiple medical segmentation tasks and is extendable for new tasks, regardless of different organs and imaging modalities. Our 3D Universal U-Net (3D U$^2$-Net) is built upon separable convolution, assuming that images from different domains have domain-specific spatial correlations which can be probed with channel-wise convolution while also share cross-channel correlations which can be modeled with pointwise convolution. We evaluate the 3D U$^2$-Net on five organ segmentation datasets. Experimental results show that this universal network is capable of competing with traditional models in terms of segmentation accuracy, while requiring only about $1\%$ of the parameters. Additionally, we observe that the architecture can be easily and effectively adapted to a new domain without sacrificing performance in the domains used to learn the shared parameterization of the universal network. We put the code of 3D U$^2$-Net into public domain (https://github.com/huangmozhilv/u2net_torch/).
U-Net Based Architecture for an Improved Multiresolution Segmentation in Medical Images

Simindokht Jahangard,Mohammad Hossein Zangooei,Maysam Shahedi

DOI: https://doi.org/10.48550/arXiv.2007.08238

2020-07-16

Image and Video Processing

Abstract:Purpose: Manual medical image segmentation is an exhausting and time-consuming task along with high inter-observer variability. In this study, our objective is to improve the multi-resolution image segmentation performance of U-Net architecture. Approach: We have proposed a fully convolutional neural network for image segmentation in a multi-resolution framework. We used U-Net as the base architecture and modified that to improve its image segmentation performance. In the proposed architecture (mrU-Net), the input image and its down-sampled versions were used as the network inputs. We added more convolution layers to extract features directly from the down-sampled images. We trained and tested the network on four different medical datasets, including skin lesion photos, lung computed tomography (CT) images (LUNA dataset), retina images (DRIVE dataset), and prostate magnetic resonance (MR) images (PROMISE12 dataset). We compared the performance of mrU-Net to U-Net under similar training and testing conditions. Results: Comparing the results to manual segmentation labels, mrU-Net achieved average Dice similarity coefficients of 70.6%, 97.9%, 73.6%, and 77.9% for the skin lesion, LUNA, DRIVE, and PROMISE12 segmentation, respectively. For the skin lesion, LUNA, and DRIVE datasets, mrU-Net outperformed U-Net with significantly higher accuracy and for the PROMISE12 dataset, both networks achieved similar accuracy. Furthermore, using mrU-Net led to a faster training rate on LUNA and DRIVE datasets when compared to U-Net. Conclusions: The striking feature of the proposed architecture is its higher capability in extracting image-derived features compared to U-Net. mrU-Net illustrated a faster training rate and slightly more accurate image segmentation compared to U-Net.
DDU-Net: A dual dense U-structure network for medical image segmentation

Junlong Cheng,Shengwei Tian,Long Yu,Shijia Liu,Chaoqing Wang,Yuan Ren,Hongchun Lu,Min Zhu,Junlong Cheng,Shengwei Tian,Long Yu,Shijia Liu,Chaoqing Wang,Yuan Ren,Hongchun Lu,Min Zhu

DOI: https://doi.org/10.1016/j.asoc.2022.109297

IF: 8.7

2022-09-01

Applied Soft Computing

Abstract:Medical image segmentation is one of the important steps in medical image analysis and has a wide range of applications and research values in medical research and practice. However, it is still a challenging task due to the characteristics of medical images with diverse lesion scales, blurred structural boundaries and numerous modalities. To address these challenges, we design a simple yet powerful dual dense u-structured network (called DDU-Net) for medical image segmentation. Specifically, we first construct dual encoders with the densely connected, where the first encoder uses DenseNet, whose backbone network is pre-trained on ImageNet, as a fixed feature extractor, and the second encoder uses a network structure similar to the first encoder. Both encoders try to encode information on the input image, and each layer is directly connected to the next layer in a feed-forward manner. This approach not only greatly reduces the number of parameters in the network, but also makes it easier to train with smaller samples. We then design up-sampling paths applicable to the dual encoder structure, and construct deeper decoders through densely connected convolutional layers, fusing the low to high level multi-scale semantic information learned by the two encoders. Finally, we employ a multiple loss function that combines boundary and content information to make DDU-Net more focus on the accuracy of boundary delineation to improve the overall segmentation performance. We have conducted comprehensive experiments on five different medical image segmentation datasets, including skin lesion segmentation, nuclei segmentation, lung segmentation, gland segmentation and vessel segmentation (IoU metrics for DDU-Net are 0.790, 0.860, 0.925, 0.812 and 0.696 respectively). Compared to baseline U-Net and other state-of-the-art methods, DDU-Net achieves competitive segmentation performance in both qualitative and quantitative evaluation.

computer science, artificial intelligence, interdisciplinary applications
CFPNet-M: A Light-Weight Encoder-Decoder Based Network for Multimodal Biomedical Image Real-Time Segmentation

Ange Lou,Shuyue Guan,Murray Loew

DOI: https://doi.org/10.48550/arXiv.2105.04075

2021-05-30

Abstract:Currently, developments of deep learning techniques are providing instrumental to identify, classify, and quantify patterns in medical images. Segmentation is one of the important applications in medical image analysis. In this regard, U-Net is the predominant approach to medical image segmentation tasks. However, we found that those U-Net based models have limitations in several aspects, for example, millions of parameters in the U-Net consuming considerable computation resource and memory, lack of global information, and missing some tough objects. Therefore, we applied two modifications to improve the U-Net model: 1) designed and added the dilated channel-wise CNN module, 2) simplified the U shape network. Based on these two modifications, we proposed a novel light-weight architecture -- Channel-wise Feature Pyramid Network for Medicine (CFPNet-M). To evaluate our method, we selected five datasets with different modalities: thermography, electron microscopy, endoscopy, dermoscopy, and digital retinal images. And we compared its performance with several models having different parameter scales. This paper also involves our previous studies of DC-UNet and some commonly used light-weight neural networks. We applied the Tanimoto similarity instead of the Jaccard index for gray-level image measurements. By comparison, CFPNet-M achieves comparable segmentation results on all five medical datasets with only 0.65 million parameters, which is about 2% of U-Net, and 8.8 MB memory. Meanwhile, the inference speed can reach 80 FPS on a single RTX 2070Ti GPU with the 256 by 192 pixels input size.

Computer Vision and Pattern Recognition,Image and Video Processing
R2U++: a multiscale recurrent residual U-Net with dense skip connections for medical image segmentation

Mubashar, Mehreen,Ali, Hazrat,Grönlund, Christer,Azmat, Shoaib

DOI: https://doi.org/10.1007/s00521-022-07419-7

2022-06-03

Neural Computing and Applications

Abstract:U-Net is a widely adopted neural network in the domain of medical image segmentation. Despite its quick embracement by the medical imaging community, its performance suffers on complicated datasets. The problem can be ascribed to its simple feature extracting blocks: encoder/decoder, and the semantic gap between encoder and decoder. Variants of U-Net (such as R2U-Net) have been proposed to address the problem of simple feature extracting blocks by making the network deeper, but it does not deal with the semantic gap problem. On the other hand, another variant UNET++ deals with the semantic gap problem by introducing dense skip connections but has simple feature extraction blocks. To overcome these issues, we propose a new U-Net based medical image segmentation architecture R2U++. In the proposed architecture, the adapted changes from vanilla U-Net are: (1) the plain convolutional backbone is replaced by a deeper recurrent residual convolution block. The increased field of view with these blocks aids in extracting crucial features for segmentation which is proven by improvement in the overall performance of the network. (2) The semantic gap between encoder and decoder is reduced by dense skip pathways. These pathways accumulate features coming from multiple scales and apply concatenation accordingly. The modified architecture has embedded multi-depth models, and an ensemble of outputs taken from varying depths improves the performance on foreground objects appearing at various scales in the images. The performance of R2U++ is evaluated on four distinct medical imaging modalities: electron microscopy, X-rays, fundus, and computed tomography. The average gain achieved in IoU score is 1.5 ± 0.37% and in dice score is 0.9 ± 0.33% over UNET++, whereas, 4.21 ± 2.72 in IoU and 3.47 ± 1.89 in dice score over R2U-Net across different medical imaging segmentation datasets.

computer science, artificial intelligence
U-Net and its variants for medical image segmentation: theory and applications

Nahian Siddique,Paheding Sidike,Colin Elkin,Vijay Devabhaktuni

DOI: https://doi.org/10.1109/ACCESS.2021.3086020

2020-11-03

Abstract:U-net is an image segmentation technique developed primarily for medical image analysis that can precisely segment images using a scarce amount of training data. These traits provide U-net with a very high utility within the medical imaging community and have resulted in extensive adoption of U-net as the primary tool for segmentation tasks in medical imaging. The success of U-net is evident in its widespread use in all major image modalities from CT scans and MRI to X-rays and microscopy. Furthermore, while U-net is largely a segmentation tool, there have been instances of the use of U-net in other applications. As the potential of U-net is still increasing, in this review we look at the various developments that have been made in the U-net architecture and provide observations on recent trends. We examine the various innovations that have been made in deep learning and discuss how these tools facilitate U-net. Furthermore, we look at image modalities and application areas where U-net has been applied.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Medical Image Segmentation Review: The success of U-Net

Reza Azad,Ehsan Khodapanah Aghdam,Amelie Rauland,Yiwei Jia,Atlas Haddadi Avval,Afshin Bozorgpour,Sanaz Karimijafarbigloo,Joseph Paul Cohen,Ehsan Adeli,Dorit Merhof

DOI: https://doi.org/10.48550/arXiv.2211.14830

2022-11-27

Image and Video Processing

Abstract:Automatic medical image segmentation is a crucial topic in the medical domain and successively a critical counterpart in the computer-aided diagnosis paradigm. U-Net is the most widespread image segmentation architecture due to its flexibility, optimized modular design, and success in all medical image modalities. Over the years, the U-Net model achieved tremendous attention from academic and industrial researchers. Several extensions of this network have been proposed to address the scale and complexity created by medical tasks. Addressing the deficiency of the naive U-Net model is the foremost step for vendors to utilize the proper U-Net variant model for their business. Having a compendium of different variants in one place makes it easier for builders to identify the relevant research. Also, for ML researchers it will help them understand the challenges of the biological tasks that challenge the model. To address this, we discuss the practical aspects of the U-Net model and suggest a taxonomy to categorize each network variant. Moreover, to measure the performance of these strategies in a clinical application, we propose fair evaluations of some unique and famous designs on well-known datasets. We provide a comprehensive implementation library with trained models for future research. In addition, for ease of future studies, we created an online list of U-Net papers with their possible official implementation. All information is gathered in https://github.com/NITR098/Awesome-U-Net repository.
DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation

Qing Xu,Zhicheng Ma,Wenting Duan,Na HE

DOI: https://doi.org/10.1016/j.compbiomed.2023.106626

IF: 7.7

2023-02-03

Computers in Biology and Medicine

Abstract:Deep learning architecture with convolutional neural network achieves outstanding success in the field of computer vision. Where U-Net has made a great breakthrough in biomedical image segmentation and has been widely applied in a wide range of practical scenarios. However, the equal design of every downsampling layer in the encoder part and simply stacked convolutions do not allow U-Net to extract sufficient information of features from different depths. The increasing complexity of medical images brings new challenges to the existing methods. In this paper, we propose a deeper and more compact split-attention u-shape network, which efficiently utilises low-level and high-level semantic information based on two frameworks: primary feature conservation and compact split-attention block. We evaluate the proposed model on CVC-ClinicDB, 2018 Data Science Bowl, ISIC-2018, SegPC-2021 and BraTS-2021 datasets. As a result, our proposed model displays better performance than other state-of-the-art methods in terms of the mean intersection over union and dice coefficient. More significantly, the proposed model demonstrates excellent segmentation performance on challenging images. The code for our work and more technical details can be found at https://github.com/xq141839/DCSAU-Net .

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
DRU-net: An Efficient Deep Convolutional Neural Network for Medical Image Segmentation

Mina Jafari,Dorothee Auer,Susan Francis,Jonathan Garibaldi,Xin Chen

DOI: https://doi.org/10.48550/arXiv.2004.13453

2020-04-28

Image and Video Processing

Abstract:Residual network (ResNet) and densely connected network (DenseNet) have significantly improved the training efficiency and performance of deep convolutional neural networks (DCNNs) mainly for object classification tasks. In this paper, we propose an efficient network architecture by considering advantages of both networks. The proposed method is integrated into an encoder-decoder DCNN model for medical image segmentation. Our method adds additional skip connections compared to ResNet but uses significantly fewer model parameters than DenseNet. We evaluate the proposed method on a public dataset (ISIC 2018 grand-challenge) for skin lesion segmentation and a local brain MRI dataset. In comparison with ResNet-based, DenseNet-based and attention network (AttnNet) based methods within the same encoder-decoder network structure, our method achieves significantly higher segmentation accuracy with fewer number of model parameters than DenseNet and AttnNet. The code is available on GitHub (GitHub link: https://github.com/MinaJf/DRU-net).
Narrowing the semantic gaps in U-Net with learnable skip connections: The case of medical image segmentation

Haonan Wang,Peng Cao,Xiaoli Liu,Jinzhu Yang,Osmar Zaiane

2023-12-23

Abstract:Most state-of-the-art methods for medical image segmentation adopt the encoder-decoder architecture. However, this U-shaped framework still has limitations in capturing the non-local multi-scale information with a simple skip connection. To solve the problem, we firstly explore the potential weakness of skip connections in U-Net on multiple segmentation tasks, and find that i) not all skip connections are useful, each skip connection has different contribution; ii) the optimal combinations of skip connections are different, relying on the specific datasets. Based on our findings, we propose a new segmentation framework, named UDTransNet, to solve three semantic gaps in U-Net. Specifically, we propose a Dual Attention Transformer (DAT) module for capturing the channel- and spatial-wise relationships to better fuse the encoder features, and a Decoder-guided Recalibration Attention (DRA) module for effectively connecting the DAT tokens and the decoder features to eliminate the inconsistency. Hence, both modules establish a learnable connection to solve the semantic gaps between the encoder and the decoder, which leads to a high-performance segmentation model for medical images. Comprehensive experimental results indicate that our UDTransNet produces higher evaluation scores and finer segmentation results with relatively fewer parameters over the state-of-the-art segmentation methods on different public datasets. Code: <a class="link-external link-https" href="https://github.com/McGregorWwww/UDTransNet" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Proceedings: Plasma immunoreactive 'beta-melanocyte-stimulating hormone' in patients on maintenance dialysis.

J. Gilkes,R. Eady,L. Rees,D. D. Munro,J. Moorhead

1975-06-01

Journal of Endocrinology

Abstract:
U-Net Using Stacked Dilated Convolutions for Medical Image Segmentation

Shuhang Wang,Szu-Yeu Hu,Eugene Cheah,Xiaohong Wang,Jingchao Wang,Lei Chen,Masoud Baikpour,Arinc Ozturk,Qian Li,Shinn-Huey Chou,Constance D. Lehman,Viksit Kumar,Anthony Samir

DOI: https://doi.org/10.48550/arXiv.2004.03466

2020-04-10

Abstract:This paper proposes a novel U-Net variant using stacked dilated convolutions for medical image segmentation (SDU-Net). SDU-Net adopts the architecture of vanilla U-Net with modifications in the encoder and decoder operations (an operation indicates all the processing for feature maps of the same resolution). Unlike vanilla U-Net which incorporates two standard convolutions in each encoder/decoder operation, SDU-Net uses one standard convolution followed by multiple dilated convolutions and concatenates all dilated convolution outputs as input to the next operation. Experiments showed that SDU-Net outperformed vanilla U-Net, attention U-Net (AttU-Net), and recurrent residual U-Net (R2U-Net) in all four tested segmentation tasks while using parameters around 40% of vanilla U-Net's, 17% of AttU-Net's, and 15% of R2U-Net's.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
An Exhaustive Analytical Study of U-Net Architecture on Two Diverse Biomedical Imaging Datasets of Electron Microscopy Drosophila ssTEM and Brain MRI BraTS-2021 for Segmentation

Biswajit Jena,Gopal Krishna Nayak,Sudip Paul,Sanjay Saxena

DOI: https://doi.org/10.1007/s42979-022-01347-y

2022-08-05

SN Computer Science

Abstract:Biomedical image segmentation is a mechanism that distinguishes the boundaries of various lesion regions within the image, be it 2D or 3D. In the current scenario, various soft and hard computing approaches have been used for medical image segmentation purposes. This article analyzes deep learning-based U-Net architecture for efficient segmentation by possible variations of its different important hyper-parameters that affect the U-Net performance. This article also investigates U-Net architecture's performance to generate the segmented output over two diverse biomedical imaging datasets, such as brain MRI scans and serial section Transmission Electron Microscopy (ssTEM) dataset of the drosophila first instar larva VNC, hence making 48 possible combinations of execution of the U-Net model. The performance of the segmentation process has been evaluated using metrics like dice similarity coefficient and accuracy, while cross-entropy is considered the loss function. In doing so, an insight into the overall performance of U-Net on biomedical image segmentation problems has been obtained. The best results for accuracy and dice coefficient values out of all possible combinations made in this study come as 0.9881 and 0.9934 , respectively. The main motive of this work is to provide an exhaustive and efficient analysis of the U-Net architecture for biomedical image segmentation and subsequent analysis.
Research on U-Net Medical Image Segmentation

Fangfang Song,Yimin Tian,Xue Gao,Shuai Yang,Meijun Zheng

DOI: https://doi.org/10.1117/12.2631325

2022-01-01

Abstract:With the rapid development of deep learning technology and medical technology, neural networks are widely used in the field of medical image segmentation. Among them, U-Net neural network has gradually become a research hotspot in the field of image segmentation because of its good segmentation performance. It provides doctors with a consistent method of quantifying lesions and is widely used in the field of medical image semantic segmentation. This article studies the U-Net network, learns theoretically from the U-Net network model and its basic principles, and then conducts experiments on three typical medical images of liver medical images, fundus blood vessel images, and lung nodule images to explain various types of medical images. The characteristics of the image and the difficulty of segmentation, and the performance of the U-Net network in the relevant image segmentation is verified. Finally, the problems existing in U-Net network are discussed, and the future development is prospected.
DRINet for Medical Image Segmentation

Liang Chen,Paul Bentley,Kensaku Mori,Kazunari Misawa,Michitaka Fujiwara,Daniel Rueckert

DOI: https://doi.org/10.1109/tmi.2018.2835303

IF: 10.6

2018-11-01

IEEE Transactions on Medical Imaging

Abstract:Convolutional neural networks (CNNs) have revolutionized medical image analysis over the past few years. The U-Net architecture is one of the most well-known CNN architectures for semantic segmentation and has achieved remarkable successes in many different medical image segmentation applications. The U-Net architecture consists of standard convolution layers, pooling layers, and upsampling layers. These convolution layers learn representative features of input images and construct segmentations based on the features. However, the features learned by standard convolution layers are not distinctive when the differences among different categories are subtle in terms of intensity, location, shape, and size. In this paper, we propose a novel CNN architecture, called Dense-Res-Inception Net (DRINet), which addresses this challenging problem. The proposed DRINet consists of three blocks, namely a convolutional block with dense connections, a deconvolutional block with residual inception modules, and an unpooling block. Our proposed architecture outperforms the U-Net in three different challenging applications, namely multi-class segmentation of cerebrospinal fluid on brain CT images, multi-organ segmentation on abdominal CT images, and multi-class brain tumor segmentation on MR images.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
MDA-Unet: A Multi-Scale Dilated Attention U-Net for Medical Image Segmentation

Alyaa Amer,Tryphon Lambrou,Xujiong Ye

DOI: https://doi.org/10.3390/app12073676

2022-04-06

Applied Sciences

Abstract:The advanced development of deep learning methods has recently made significant improvements in medical image segmentation. Encoder–decoder networks, such as U-Net, have addressed some of the challenges in medical image segmentation with an outstanding performance, which has promoted them to be the most dominating deep learning architecture in this domain. Despite their outstanding performance, we argue that they still lack some aspects. First, there is incompatibility in U-Net’s skip connection between the encoder and decoder features due to the semantic gap between low-processed encoder features and highly processed decoder features, which adversely affects the final prediction. Second, it lacks capturing multi-scale context information and ignores the contribution of all semantic information through the segmentation process. Therefore, we propose a model named MDA-Unet, a novel multi-scale deep learning segmentation model. MDA-Unet improves upon U-Net and enhances its performance in segmenting medical images with variability in the shape and size of the region of interest. The model is integrated with a multi-scale spatial attention module, where spatial attention maps are derived from a hybrid hierarchical dilated convolution module that captures multi-scale context information. To ease the training process and reduce the gradient vanishing problem, residual blocks are deployed instead of the basic U-net blocks. Through a channel attention mechanism, the high-level decoder features are used to guide the low-level encoder features to promote the selection of meaningful context information, thus ensuring effective fusion. We evaluated our model on 2 different datasets: a lung dataset of 2628 axial CT images and an echocardiographic dataset of 2000 images, each with its own challenges. Our model has achieved a significant gain in performance with a slight increase in the number of trainable parameters in comparison with the basic U-Net model, providing a dice score of 98.3% on the lung dataset and 96.7% on the echocardiographic dataset, where the basic U-Net has achieved 94.2% on the lung dataset and 93.9% on the echocardiographic dataset.

Effect of Metabolites of γ-Aminobutyric Shunt on Activities of NAD- and NADP-Isocitrate Dehydrogenases and Aconitate Hydratase from Higher Plants

Medical Image Segmentation Using a U-Net type of Architecture

U-Net-Based Medical Image Segmentation

DC-UNet: Rethinking the U-Net Architecture with Dual Channel Efficient CNN for Medical Images Segmentation

U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

U-Net Based Architecture for an Improved Multiresolution Segmentation in Medical Images

DDU-Net: A dual dense U-structure network for medical image segmentation

CFPNet-M: A Light-Weight Encoder-Decoder Based Network for Multimodal Biomedical Image Real-Time Segmentation

R2U++: a multiscale recurrent residual U-Net with dense skip connections for medical image segmentation

U-Net and its variants for medical image segmentation: theory and applications

Medical Image Segmentation Review: The success of U-Net

DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation

DRU-net: An Efficient Deep Convolutional Neural Network for Medical Image Segmentation

Narrowing the semantic gaps in U-Net with learnable skip connections: The case of medical image segmentation

Proceedings: Plasma immunoreactive 'beta-melanocyte-stimulating hormone' in patients on maintenance dialysis.

U-Net Using Stacked Dilated Convolutions for Medical Image Segmentation

An Exhaustive Analytical Study of U-Net Architecture on Two Diverse Biomedical Imaging Datasets of Electron Microscopy Drosophila ssTEM and Brain MRI BraTS-2021 for Segmentation

Research on U-Net Medical Image Segmentation

DRINet for Medical Image Segmentation

MDA-Unet: A Multi-Scale Dilated Attention U-Net for Medical Image Segmentation