Flow dependence of measures of aortic stenosis severity during exercise.

I. Burwash,A. Pearlman,C. Kraft,C. Miyake-Hull,N. L. Healy,C. Otto

DOI: https://doi.org/10.1016/0735-1097(94)90118-X

IF: 24

1994-11-01

Journal of the American College of Cardiology

Abstract:

What problem does this paper attempt to address?

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

Hongyi Wang,Lanfen Lin,Hongjie Hu,Qingqing Chen,Yinhao Li,Yutaro Iwamoto,Xian-Hua Han,Yen-Wei Chen,Ruofeng Tong

DOI: https://doi.org/10.48550/arxiv.2210.14645

2022-01-01

Abstract: High resolution (HR) 3D medical image segmentation plays an important role in clinical diagnoses. However, HR images are difficult to be directly processed by mainstream graphical cards due to limited video memory. Therefore, most existing 3D medical image segmentation methods use patch-based models, which ignores global context information that is useful in accurate segmentation and has low inference efficiency. To address these problems, we propose a super-resolution (SR) guided patch-free 3D medical image segmentation framework that can realize HR segmentation with global information of low-resolution (LR) input. The framework contains two tasks: semantic segmentation (main task) and super resolution (auxiliary task). To balance the information loss with the LR input, we introduce a Self-Supervised Guidance Module (SGM), which employs a selective search method to crop a HR patch from the original image as restoration guidance. Multi-scale convolutional layers are used to mitigate the scale-inconsistency between the HR guidance features and the LR features. Moreover, we propose a Task-Fusion Module (TFM) to exploit the inter connections between segmentation and SR task. This module can also be used for Test Phase Fine-tuning (TPF), leading to a better model generalization ability. When predicting, only the main segmentation task is needed, while other modules can be removed to accelerate the inference. The experiments results on two different datasets show that our framework outperforms current patch-based and patch-free models. Our model also has a four times higher inference speed compared to traditional patch-based methods. Our codes are available at: https://github.com/Dootmaan/PFSeg-Full.
Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Xiaomeng Li,Lequan Yu,Hao Chen,Chi-Wing Fu,Lei Xing,Pheng-Ann Heng

DOI: https://doi.org/10.48550/arXiv.1903.00348

2019-02-28

Computer Vision and Pattern Recognition

Abstract:Deep convolutional neural networks have achieved remarkable progress on a variety of medical image computing tasks. A common problem when applying supervised deep learning methods to medical images is the lack of labeled data, which is very expensive and time-consuming to be collected. In this paper, we present a novel semi-supervised method for medical image segmentation, where the network is optimized by the weighted combination of a common supervised loss for labeled inputs only and a regularization loss for both labeled and unlabeled data. To utilize the unlabeled data, our method encourages the consistent predictions of the network-in-training for the same input under different regularizations. Aiming for the semi-supervised segmentation problem, we enhance the effect of regularization for pixel-level predictions by introducing a transformation, including rotation and flipping, consistent scheme in our self-ensembling model. With the aim of semi-supervised segmentation tasks, we introduce a transformation consistent strategy in our self-ensembling model to enhance the regularization effect for pixel-level predictions. We have extensively validated the proposed semi-supervised method on three typical yet challenging medical image segmentation tasks: (i) skin lesion segmentation from dermoscopy images on International Skin Imaging Collaboration (ISIC) 2017 dataset, (ii) optic disc segmentation from fundus images on Retinal Fundus Glaucoma Challenge (REFUGE) dataset, and (iii) liver segmentation from volumetric CT scans on Liver Tumor Segmentation Challenge (LiTS) dataset. Compared to the state-of-the-arts, our proposed method shows superior segmentation performance on challenging 2D/3D medical images, demonstrating the effectiveness of our semi-supervised method for medical image segmentation.
Unifying and Personalizing Weakly-supervised Federated Medical Image Segmentation via Adaptive Representation and Aggregation

Li Lin,Jiewei Wu,Yixiang Liu,Kenneth K. Y. Wong,Xiaoying Tang

2023-04-12

Abstract:Federated learning (FL) enables multiple sites to collaboratively train powerful deep models without compromising data privacy and security. The statistical heterogeneity (e.g., non-IID data and domain shifts) is a primary obstacle in FL, impairing the generalization performance of the global model. Weakly supervised segmentation, which uses sparsely-grained (i.e., point-, bounding box-, scribble-, block-wise) supervision, is increasingly being paid attention to due to its great potential of reducing annotation costs. However, there may exist label heterogeneity, i.e., different annotation forms across sites. In this paper, we propose a novel personalized FL framework for medical image segmentation, named FedICRA, which uniformly leverages heterogeneous weak supervision via adaptIve Contrastive Representation and Aggregation. Concretely, to facilitate personalized modeling and to avoid confusion, a channel selection based site contrastive representation module is employed to adaptively cluster intra-site embeddings and separate inter-site ones. To effectively integrate the common knowledge from the global model with the unique knowledge from each local model, an adaptive aggregation module is applied for updating and initializing local models at the element level. Additionally, a weakly supervised objective function that leverages a multiscale tree energy loss and a gated CRF loss is employed to generate more precise pseudo-labels and further boost the segmentation performance. Through extensive experiments on two distinct medical image segmentation tasks of different modalities, the proposed FedICRA demonstrates overwhelming performance over other state-of-the-art personalized FL methods. Its performance even approaches that of fully supervised training on centralized data. Our code and data are available at <a class="link-external link-https" href="https://github.com/llmir/FedICRA" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Xiaomeng Li,Lequan Yu,Hao Chen,Chi-Wing Fu,Lei Xing,Pheng-Ann Heng

DOI: https://doi.org/10.1109/tnnls.2020.2995319

IF: 14.255

2021-02-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:A common shortfall of supervised deep learning for medical imaging is the lack of labeled data, which is often expensive and time consuming to collect. This article presents a new semisupervised method for medical image segmentation, where the network is optimized by a weighted combination of a common supervised loss only for the labeled inputs and a regularization loss for both the labeled and unlabeled data. To utilize the unlabeled data, our method encourages consistent predictions of the network-in-training for the same input under different perturbations. With the semisupervised segmentation tasks, we introduce a transformation-consistent strategy in the self-ensembling model to enhance the regularization effect for pixel-level predictions. To further improve the regularization effects, we extend the transformation in a more generalized form including scaling and optimize the consistency loss with a teacher model, which is an averaging of the student model weights. We extensively validated the proposed semisupervised method on three typical yet challenging medical image segmentation tasks: 1) skin lesion segmentation from dermoscopy images in the International Skin Imaging Collaboration (ISIC) 2017 data set; 2) optic disk (OD) segmentation from fundus images in the Retinal Fundus Glaucoma Challenge (REFUGE) data set; and 3) liver segmentation from volumetric CT scans in the Liver Tumor Segmentation Challenge (LiTS) data set. Compared with state-of-the-art, our method shows superior performance on the challenging 2-D/3-D medical images, demonstrating the effectiveness of our semisupervised method for medical image segmentation.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency

Yubin Zheng,Peng Tang,Tianjie Ju,Weidong Qiu,Bo Yan

2024-03-19

Abstract:Medical image segmentation plays a vital role in clinic disease diagnosis and medical image analysis. However, labeling medical images for segmentation task is tough due to the indispensable domain expertise of radiologists. Furthermore, considering the privacy and sensitivity of medical images, it is impractical to build a centralized segmentation dataset from different medical institutions. Federated learning aims to train a shared model of isolated clients without local data exchange which aligns well with the scarcity and privacy characteristics of medical data. To solve the problem of labeling hard, many advanced semi-supervised methods have been proposed in a centralized data setting. As for federated learning, how to conduct semi-supervised learning under this distributed scenario is worth investigating. In this work, we propose a novel federated semi-supervised learning framework for medical image segmentation. The intra-client and inter-client consistency learning are introduced to smooth predictions at the data level and avoid confirmation bias of local models. They are achieved with the assistance of a Variational Autoencoder (VAE) trained collaboratively by clients. The added VAE model plays three roles: 1) extracting latent low-dimensional features of all labeled and unlabeled data; 2) performing a novel type of data augmentation in calculating intra-client consistency loss; 3) utilizing the generative ability of itself to conduct inter-client consistency distillation. The proposed framework is compared with other federated semi-supervised or self-supervised learning methods. The experimental results illustrate that our method outperforms the state-of-the-art method while avoiding a lot of computation and communication overhead.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Hierarchical Self-supervised Learning for Medical Image Segmentation Based on Multi-domain Data Aggregation

Hao Zheng,Jun Han,Hongxiao Wang,Lin Yang,Zhuo Zhao,Chaoli Wang,Danny Z. Chen

DOI: https://doi.org/10.1007/978-3-030-87193-2_59

2021-01-01

Abstract:A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are abundant and easy to acquire. Self-supervised learning (SSL) has shown great potentials in exploiting raw data information and representation learning. In this paper, we propose Hierarchical Self-Supervised Learning (HSSL), a new self-supervised framework that boosts medical image segmentation by making good use of unannotated data. Unlike the current literature on task-specific self-supervised pretraining followed by supervised fine-tuning, we utilize SSL to learn task-agnostic knowledge from heterogeneous data for various medical image segmentation tasks. Specifically, we first aggregate a dataset from several medical challenges, then pre-train the network in a self-supervised manner, and finally fine-tune on labeled data. We develop a new loss function by combining contrastive loss and classification loss, and pre-train an encoder-decoder architecture for segmentation tasks. Our extensive experiments show that multi-domain joint pre-training benefits downstream segmentation tasks and outperforms single-domain pre-training significantly. Compared to learning from scratch, our method yields better performance on various tasks (e.g., +0.69%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$+0.69\%$$end{document} to +18.60%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$+18.60\%$$end{document} in Dice with 5%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$5\%$$end{document} of annotated data). With limited amounts of training data, our method can substantially bridge the performance gap with respect to denser annotations (e.g., 10%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$10\%$$end{document} vs. 100%documentclass[12pt]{minimal}usepackage{amsmath}usepackage{wasysym}usepackage{amsfonts}usepackage{amssymb}usepackage{amsbsy}usepackage{mathrsfs}usepackage{upgreek}setlength{oddsidemargin}{-69pt}egin{document}$$100\%$$end{document} annotations).
Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model

Fenghe Tang,Jianrui Ding,Lingtao Wang,Min Xian,Chunping Ning

DOI: https://doi.org/10.48550/arXiv.2305.09447

2023-05-17

Abstract:Medical image segmentation is a critical step in computer-aided diagnosis, and convolutional neural networks are popular segmentation networks nowadays. However, the inherent local operation characteristics make it difficult to focus on the global contextual information of lesions with different positions, shapes, and sizes. Semi-supervised learning can be used to learn from both labeled and unlabeled samples, alleviating the burden of manual labeling. However, obtaining a large number of unlabeled images in medical scenarios remains challenging. To address these issues, we propose a Multi-level Global Context Cross-consistency (MGCC) framework that uses images generated by a Latent Diffusion Model (LDM) as unlabeled images for semi-supervised learning. The framework involves of two stages. In the first stage, a LDM is used to generate synthetic medical images, which reduces the workload of data annotation and addresses privacy concerns associated with collecting medical data. In the second stage, varying levels of global context noise perturbation are added to the input of the auxiliary decoder, and output consistency is maintained between decoders to improve the representation ability. Experiments conducted on open-source breast ultrasound and private thyroid ultrasound datasets demonstrate the effectiveness of our framework in bridging the probability distribution and the semantic representation of the medical image. Our approach enables the effective transfer of probability distribution knowledge to the segmentation network, resulting in improved segmentation accuracy. The code is available at <a class="link-external link-https" href="https://github.com/FengheTan9/Multi-Level-Global-Context-Cross-Consistency" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Low-Quality Sensor Data-Based Semi-Supervised Learning for Medical Image Segmentation

Hengfan Li,Xuanbo Xu,Ziheng Liu,Qingfeng Xia,Min Xia

DOI: https://doi.org/10.3390/s24237799

IF: 3.9

2024-12-06

Sensors

Abstract:Traditional medical image sensors face multiple challenges. First, these sensors typically rely on large amounts of labeled data, which are time-consuming and costly to obtain. Second, when the data volume and image size are large, traditional sensors have limited computational power, making it difficult to effectively train and infer models. Additionally, traditional sensors have poor generalization ability and struggle to adapt to datasets with different modalities. This paper devises a novel framework, named LSDSL, and deploys it in the sensor. LSDSL utilizes low-quality sensor data for semi-supervised learning in medical image segmentation. in supervised learning, we devise the hard region exploration (hre) module to enhance the model's comprehension of low-quality pixels in hard regions. in unsupervised learning, we introduce a pseudo-label sharing (ps) module, which allows low-quality pixels in one network to learn from the high-quality pixels in the other networks. our model outperforms other semi-supervised methods on the datasets of two different modalities (CT and MRI) in medical image sensors, achieving superior inference speed and segmentation accuracy.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Re: Dickson HG. Re: Dickson's problems with the ICIDH definition of impairment. Disability and Rehabilitation 1997; 19, 122-123.

J. Halbertsma

DOI: https://doi.org/10.1080/096382899297936

1999-03-01

Disability and Rehabilitation

Abstract:
Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

Yifei Chen,Chenyan Zhang,Yifan Ke,Yiyu Huang,Xuezhou Dai,Feiwei Qin,Yongquan Zhang,Xiaodong Zhang,Changmiao Wang

2024-02-17

Abstract:Traditional supervised learning methods have historically encountered certain constraints in medical image segmentation due to the challenging collection process, high labeling cost, low signal-to-noise ratio, and complex features characterizing biomedical images. This paper proposes a semi-supervised model, DFCPS, which innovatively incorporates the Fixmatch concept. This significantly enhances the model's performance and generalizability through data augmentation processing, employing varied strategies for unlabeled data. Concurrently, the model design gives appropriate emphasis to the generation, filtration, and refinement processes of pseudo-labels. The novel concept of cross-pseudo-supervision is introduced, integrating consistency learning with self-training. This enables the model to fully leverage pseudo-labels from multiple perspectives, thereby enhancing training diversity. The DFCPS model is compared with both baseline and advanced models using the publicly accessible Kvasir-SEG dataset. Across all four subdivisions containing different proportions of unlabeled data, our model consistently exhibits superior performance. Our source code is available at

Computer Vision and Pattern Recognition,Artificial Intelligence
Versatile Medical Image Segmentation Learned from Multi-Source Datasets via Model Self-Disambiguation

Xiaoyang Chen,Hao Zheng,Yuemeng Li,Yuncong Ma,Liang Ma,Hongming Li,Yong Fan

2024-03-30

Abstract:A versatile medical image segmentation model applicable to images acquired with diverse equipment and protocols can facilitate model deployment and maintenance. However, building such a model typically demands a large, diverse, and fully annotated dataset, which is challenging to obtain due to the labor-intensive nature of data curation. To address this challenge, we propose a cost-effective alternative that harnesses multi-source data with only partial or sparse segmentation labels for training, substantially reducing the cost of developing a versatile model. We devise strategies for model self-disambiguation, prior knowledge incorporation, and imbalance mitigation to tackle challenges associated with inconsistently labeled multi-source data, including label ambiguity and modality, dataset, and class imbalances. Experimental results on a multi-modal dataset compiled from eight different sources for abdominal structure segmentation have demonstrated the effectiveness and superior performance of our method compared to state-of-the-art alternative approaches. We anticipate that its cost-saving features, which optimize the utilization of existing annotated data and reduce annotation efforts for new data, will have a significant impact in the field.

Computer Vision and Pattern Recognition
Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

Ye Zhu,Jie Yang,Si-Qi Liu,Ruimao Zhang

2023-04-18

Abstract:Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust semantic category representations through the semantic consistency guidance of labeled and unlabeled data to help segmentation. In practice, we introduce two external modules, namely Supervised Semantic Proxy Adaptor (SSPA) and Unsupervised Semantic Consistent Learner (USCL) that is based on the attention mechanism to align the semantic category representations of labeled and unlabeled data, as well as update the global semantic representations over the entire training set. The proposed ICL is a plug-and-play scheme for various network architectures, and the two modules are not involved in the testing stage. Experimental results on three public benchmarks show that the proposed method can outperform the state-of-the-art, especially when the number of annotated data is extremely limited. Code is available at: <a class="link-external link-https" href="https://github.com/zhuye98/ICL.git" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
PoissonSeg: Semi-Supervised Few-Shot Medical Image Segmentation via Poisson Learning

Xiaoang Shen,Guokai Zhang,Huilin Lai,Jihao Luo,Jianwei Lu,Ye Luo

DOI: https://doi.org/10.1109/bibm52615.2021.9669727

2021-12-09

Abstract:The application of deep learning to medical image segmentation has been hampered due to the lack of abundant pixel-level annotated data. Few-shot Semantic Segmentation (FSS) is a promising strategy for breaking the deadlock. However, a high-performing FSS model still requires sufficient pixel-level annotated classes for training to avoid overfitting, which leads to its performance bottleneck in medical image segmentation due to the unmet need for annotations. Thus, semi-supervised FSS for medical images is accordingly proposed to utilize unlabeled data for further performance improvement. Nevertheless, existing semi-supervised FSS methods has two obvious defects: (1) neglecting the relationship between the labeled and unlabeled data; (2) using unlabeled data directly for end-to-end training leads to degenerated representation learning. To address these problems, we propose a novel semi-supervised FSS framework for medical image segmentation. The proposed framework employs Poisson learning for modeling data relationship and propagating supervision signals, and Spatial Consistency Calibration for encouraging the model to learn more coherent representations. In this process, unlabeled samples do not involve in end-to-end training, but provide supervisory information for query image segmentation through graph-based learning. We conduct extensive experiments on three medical image segmentation datasets (i.e. ISIC skin lesion segmentation, abdominal organs segmentation for MRI and abdominal organs segmentation for CT) to demonstrate the state-of-the-art performance and broad applicability of the proposed framework.
Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Xiaowei Liu,Yikun Hu,Jianguo Chen,Keqin Li

DOI: https://doi.org/10.1016/j.compbiomed.2022.105252

Abstract:Supervised learning-based medical image segmentation solutions usually require sufficient labeled training data. Insufficient available labeled training data often leads to the limitations of model performances, such as over-fitting, low accuracy, and poor generalization ability. However, this dilemma may worsen in the field of medical image analysis. Medical image annotation is usually labor-intensive and professional work. In this work, we propose a novel shape and boundary-aware deep learning model for medical image segmentation based on semi-supervised learning. The model makes good use of labeled data and also enables unlabeled data to be well applied by using task consistency loss. Firstly, we adopt V-Net for Pixel-wise Segmentation Map (PSM) prediction and Signed Distance Map (SDM) regression. In addition, we multiply multi-scale features, extracted by Pyramid Pooling Module (PPM) from input X, with 2 - |SDM| to enhance the features around the boundary of the segmented target, and then feed them into the Feature Fusion Module (FFM) for fine segmentation. Besides boundary loss, the high-level semantics implied in SDM facilitate the accurate segmentation of boundary regions. Finally, we get the ultimate result by fusing coarse and boundary-enhanced features. Last but not least, to mine unlabeled training data, we impose consistency constraints on the three core outputs of the model, namely PSM1, SDM, and PSM3. Through extensive experiments over three representative but challenging medical image datasets (LA2018, BraTS2019, and ISIC2018) and comparisons with the existing representative methods, we validate the practicability and superiority of our model.
Semi-supervised Medical Image Segmentation with Distribution Calibration and Non-local Semantic Constraint.

Nan Zhang,Junlin Hou,Rui-Wei Zhao,Rui Feng,Yuejie Zhang

DOI: https://doi.org/10.1109/BIBM52615.2021.9669560

2021-01-01

Abstract:The available medical images with accurate segmentation masks are usually limited due to the expensive and time-consuming annotation cost. Many semi-supervised approaches tried to exploit a large amount of unlabeled data together with the small number of labeled data. However, their learned segmentation models can easily become overfitted on the biased labeled data, mainly because of the misalignment between the labeled and unlabeled data distribution. To address this challenging problem, we propose a novel semi-supervised model with distribution calibration and non-local semantic constraint for medical image segmentation. In specific, we explicitly calibrate the learned feature distributions of the labeled and unlabeled data to make them aligned. Meanwhile, we add a special nonlocal semantic loss to encourage the learned features to be more discriminative for the segmentation task at the same time. Consequently, our final segmentation networks have the advantage to better generalize on the unlabeled data in both training and test set. Experimental results on three popular medical image segmentation benchmarks demonstrate that our proposed model achieves superior performance over other state-of-the-art methods. We will release our source code in this URL.
Correlative studies of cell wall enzymes and growth.

A. Murray,R. Bandurski

DOI: https://doi.org/10.1104/PP.56.1.143

IF: 7.4

1975-07-01

PLANT PHYSIOLOGY

Abstract:If cell wall hydrolytic enzymes are involved in extension growth, a correlation may be expected between hydrolytic activity of the cell walls and growth rate of the tissue from which the walls are prepared. Epicotyl sections from 0 to 5 mm, 6 to 10 mm, and 11 to 15 mm below the apical hook of pea seedlings (Pisum sativum var. Alaska) have relative growth rates of 100:15:2, respectively. The relative beta-glucosidase activities (units/mg wall) of cell walls from these sections are respectively, 100:24:23, for walls prepared in glycerol and 100:42:23 for walls prepared in aqueous solution. Thus, there is a correlation between growth rate of the tissue and specific activity of the wall-associated beta-glucosidase. Similar correlations were found for other cell wall-associated hydrolases.Relative cell numbers for the above sections, as determined by counting, were 100:25:16, and with these data it could be calculated that the amount of cell wall beta-glucosidase activity per cell is essentially a constant. Thus, for epicotyl sections the amount of enzyme per cell does not change during the process of cell elongation but the specific activity declines as the result of deposition of new wall material.
Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Shanfu Lu,Zijian Zhang,Ziye Yan,Yiran Wang,Tingting Cheng,Rongrong Zhou,Guang Yang

DOI: https://doi.org/10.1016/j.neucom.2023.126411

IF: 6

2023-06-04

Neurocomputing

Abstract:Semi-supervised learning has contributed plenty to promoting computer vision tasks. Especially concerning medical images, semi-supervised image segmentation can significantly reduce the labor and time cost of labeling images. Among the existing semi-supervised methods, pseudo-labelling and consistency regularization prevail; however, the current related methods still need to achieve satisfactory results due to the poor quality of the pseudo-labels generated and needing more certainty awareness the models. To address this problem, we propose a novel method that combines pseudo-labelling with dual consistency regularization based on a high capability of uncertainty awareness. This method leverages a cycle-loss regularized to lead to a more accurate uncertainty estimate. Followed by the uncertainty estimation, the certain region with its pseudo-label is further trained in a supervised manner. In contrast, the uncertain region is used to promote the dual consistency between the student and teacher networks. The developed approach was tested on three public datasets and showed that: 1) The proposed method achieves excellent performance improvement by leveraging unlabeled data; 2) Compared with several state-of-the-art (SOTA) semi-supervised segmentation methods, ours achieved better or comparable performance.

computer science, artificial intelligence
FedATA: Adaptive Attention Aggregation for Federated Self-supervised Medical Image Segmentation

Jian Dai,Hao Wu,Huan Liu,Liheng Yu,Xing Hu,Xiao Liu,Daoying Geng

DOI: https://doi.org/10.1016/j.neucom.2024.128691

IF: 6

2025-01-01

Neurocomputing

Abstract:Pre-trained on large-scale datasets has profoundly promoted the development of deep learning models in medical image analysis. For medical image segmentation, collecting a large number of labeled volumetric medical images from multiple institutions is an enormous challenge due to privacy concerns. Self-supervised learning with mask image modeling (MIM) can learn general representation without annotations. Integrating MIM into FL enables collaborative learning of an efficient pre-trained model from unlabeled data, followed by fine-tuning with limited annotations. However, setting pixels as reconstruction targets in traditional MIM fails to facilitate robust representation learning due to the medical image's complexity and distinct characteristics. On the other hand, the generalization of the aggregated model in FL is also impaired under the heterogeneous data distributions among institutions. To address these issues, we proposed a novel self-supervised federated learning, which combines masked self-distillation with adaptive attention federated learning. Such incorporation enjoys two vital benefits. First, masked self-distillation sets high-quality latent representations of masked tokens as the target, improving the descriptive capability of the learned presentation rather than reconstructing low-level pixels. Second, adaptive attention aggregation with Personalized federate learning effectively captures specific-related representation from the aggregated model, thus facilitating local fine-tuning performance for target tasks. We conducted comprehensive experiments on two medical segmentation tasks using a large-scale dataset consisting of volumetric medical images from multiple institutions, demonstrating superior performance compared to existing federated self-supervised learning approaches.
SemiSAM: Enhancing Semi-Supervised Medical Image Segmentation via SAM-Assisted Consistency Regularization

Yichi Zhang,Jin Yang,Yuchen Liu,Yuan Cheng,Yuan Qi

2024-10-23

Abstract:Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which typically requires intensive pixel/voxel-wise labeling by domain experts. Although semi-supervised methods can improve the performance by utilizing unlabeled data, there are still gaps between fully supervised methods under extremely limited annotation scenarios. In this paper, we propose a simple yet efficient strategy to explore the usage of the Segment Anything Model (SAM) for enhancing semi-supervised medical image segmentation. Concretely, the segmentation model trained with domain knowledge provides information for localization and generating input prompts to the SAM. Then the generated pseudo-labels of SAM are utilized as additional supervision to assist in the learning procedure of the semi-supervised framework. Extensive experiments demonstrate that SemiSAM significantly improves the performance of existing semi-supervised frameworks when only one or a few labeled images are available and shows strong efficiency as a plug-and-play strategy for semi-supervised medical image segmentation.

Computer Vision and Pattern Recognition
Enhanced synthesis of adrenal dopamine beta-hydroxylase induced by repeated immobilization in rats.

R. Květňanský,G. Gewirtz,V. Weise,I. Kopin

Molecular Pharmacology

Abstract:Repeated immobilization of rats results in a striking increase in adrenal medullary dopamine β-hydroxylase activity. After six periods of immobilization the levels are highest preceding the next immobilization, decrease during the immobilization, and increase upon termination of the immobilization. Six hours after the immobilization the activities return nearly to the preimmobilization levels. Denervation of the adrenal markedly diminishes the increase in dopamine β-hydroxylase activity that occurs with repeated immobilization. Prior treatment with hexamethonium prevents the decrease in activity during the immobilization interval, whereas the protein synthesis inhibitors actinomycin D and cycloheximide prevent the increase in enzyme activity seen after termination of immobilization. These observations support the view that dopamine β-hydroxylase is released as a result of neural stimulationn during immobilization and suggest that its increase following cessation of immobilization is a consequence of accelerated synthesis of the enzyme.

Flow dependence of measures of aortic stenosis severity during exercise.

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

Unifying and Personalizing Weakly-supervised Federated Medical Image Segmentation via Adaptive Representation and Aggregation

Transformation-Consistent Self-Ensembling Model for Semisupervised Medical Image Segmentation

Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency

Hierarchical Self-supervised Learning for Medical Image Segmentation Based on Multi-domain Data Aggregation

Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model

Low-Quality Sensor Data-Based Semi-Supervised Learning for Medical Image Segmentation

Re: Dickson HG. Re: Dickson's problems with the ICIDH definition of impairment. Disability and Rehabilitation 1997; 19, 122-123.

Semi-supervised Medical Image Segmentation Method Based on Cross-pseudo Labeling Leveraging Strong and Weak Data Augmentation Strategies

Versatile Medical Image Segmentation Learned from Multi-Source Datasets via Model Self-Disambiguation

Inherent Consistent Learning for Accurate Semi-supervised Medical Image Segmentation

PoissonSeg: Semi-Supervised Few-Shot Medical Image Segmentation via Poisson Learning

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation

Semi-supervised Medical Image Segmentation with Distribution Calibration and Non-local Semantic Constraint.

Correlative studies of cell wall enzymes and growth.

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

FedATA: Adaptive Attention Aggregation for Federated Self-supervised Medical Image Segmentation

SemiSAM: Enhancing Semi-Supervised Medical Image Segmentation via SAM-Assisted Consistency Regularization

Enhanced synthesis of adrenal dopamine beta-hydroxylase induced by repeated immobilization in rats.