Development and incorporation of microsatellite markers into the linkage map of sugar beet (Beta vulgaris spp.)

S. Rae,C. Aldam,I. Dominguez,M. Hoebrechts,S. Barnes,K. Edwards

DOI: https://doi.org/10.1007/s001220051430

IF: 5.4

2000-06-08

Theoretical and Applied Genetics

Abstract:

What problem does this paper attempt to address?

A Weakly-Supervised Anomaly Detection Method Via Adversarial Training for Medical Images

He Li,Yutaro Iwamoto,Xianhua Han,Lanfen Lin,Ruofeng Tong,Hongjie Hu,Akira Furukawa,Shuzo Kanasaki,Yen-Wei Chen

DOI: https://doi.org/10.1109/icce53296.2022.9730129

2022-01-01

Abstract:Convolutional neural networks have been widely used for anomaly detection and one of their most common methods is autoencoder. The autoencoder is expected to produce lower reconstruction error for the normal data than the abnormal ones, and the reconstruction error is typically set as a measurement index for distinguishing anomalies. In practice, however, this notion is not always compatible. The autoencoder's reconstruction ability is sometimes so good that it can reconstruct anomalies with low error, resulting in the loss of anomaly detection. To address this limitation, we present a novel weakly-supervised learning method based on the generative adversarial network. The network learns the feature distribution of both normal and abnormal samples. The use of an autoencoder in the generator network allows the model to map the input image to a lower dimension vector and then remap it back to its reconstructions. The additional encoder discriminator network maps the real and generated images to their latent representations and determines whether the generated image is true or false. As a result, a higher error-index indicates that the sample is an anomaly. Experimentation on medical images from a publicly available liver dataset demonstrates the model's superiority over previous state-of-the-art approaches.
A Model-Agnostic Framework for Universal Anomaly Detection of Multi-organ and Multi-modal Images

Yinghao Zhang,Donghuan Lu,Munan Ning,Liansheng Wang,Dong Wei,Yefeng Zheng

DOI: https://doi.org/10.1007/978-3-031-43898-1_23

2023-01-01

Abstract:The recent success of deep learning relies heavily on the large amount of labeled data. However, acquiring manually annotated symptomatic medical images is notoriously time-consuming and laborious, especially for rare or new diseases. In contrast, normal images from symptom-free healthy subjects without the need of manual annotation are much easier to acquire. In this regard, deep learning based anomaly detection approaches using only normal imagesare actively studied, achieving significantly better performance than conventional methods. Nevertheless, the previousworks committed to develop a specific network for each organ and modality separately, ignoring the intrinsic similarity among images within medical field. In this paper, we propose a model-agnostic framework to detect the abnormalities of various organs and modalitieswith a single network. By imposing organ and modality classification constraints along with center constraint on the disentangled latent representation, the proposed framework not only improves the generalization ability of thenetwork towards thesimultaneous detectionof anomalousimageswith various organs and modalities, but also boosts the performance on each single organ and modality. Extensive experiments with four different baseline models on three public datasets demonstrate the superiority of the proposed framework as well as the effectiveness of each component.
Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learning

Behzad Bozorgtabar,Dwarikanath Mahapatra,Guillaume Vray,Jean-Philippe Thiran

DOI: https://doi.org/10.48550/arXiv.2010.09856

2020-10-20

Abstract:Deep anomaly detection models using a supervised mode of learning usually work under a closed set assumption and suffer from overfitting to previously seen rare anomalies at training, which hinders their applicability in a real scenario. In addition, obtaining annotations for X-rays is very time consuming and requires extensive training of radiologists. Hence, training anomaly detection in a fully unsupervised or self-supervised fashion would be advantageous, allowing a significant reduction of time spent on the report by radiologists. In this paper, we present SALAD, an end-to-end deep self-supervised methodology for anomaly detection on X-Ray images. The proposed method is based on an optimization strategy in which a deep neural network is encouraged to represent prototypical local patterns of the normal data in the embedding space. During training, we record the prototypical patterns of normal training samples via a memory bank. Our anomaly score is then derived by measuring similarity to a weighted combination of normal prototypical patterns within a memory bank without using any anomalous patterns. We present extensive experiments on the challenging NIH Chest X-rays and MURA dataset, which indicate that our algorithm improves state-of-the-art methods by a wide margin.

Image and Video Processing,Computer Vision and Pattern Recognition
Anomaly Detection for Medical Images using Heterogeneous Auto-Encoder

Shuai Lu,Weihang Zhang,He Zhao,Hanruo Liu,Ningli Wang,Huiqi Li

DOI: https://doi.org/10.1109/tip.2024.3381435

IF: 10.6

2024-01-01

IEEE Transactions on Image Processing

Abstract:Anomaly detection is an important task for medical image analysis, which can alleviate the reliance of supervised methods on large labelled datasets. Most existing methods use a pixel-wise self-reconstruction framework for anomaly detection. However, there are two challenges of these studies: 1) they tend to overfit learning an identity mapping between the input and output, which leads to failure in detecting abnormal samples; 2) the reconstruction considers the pixel-wise differences which may lead to an undesirable result. To mitigate the above problems, we propose a novel heterogeneous Auto-Encoder (Hetero-AE) for medical anomaly detection. Our model utilizes a convolutional neural network (CNN) as the encoder and a hybrid CNN-Transformer network as the decoder. The heterogeneous structure enables the model to learn the intrinsic information of normal data and enlarge the difference on abnormal samples. To fully exploit the effectiveness of Transformer in the hybrid network, a multi-scale sparse Transformer block is proposed to trade off modelling long-range feature dependencies and high computational costs. Moreover, the multi-stage feature comparison is introduced to reduce the noise of pixel-wise comparison. Extensive experiments on four public datasets (i.e., retinal OCT, chest X-ray, brain MRI, and COVID-19) verify the effectiveness of our method on different imaging modalities for anomaly detection. Additionally, our method can accurately detect tumors in brain MRI and lesions in retinal OCT with interpretable heatmaps to locate lesion areas, assisting clinicians in diagnosing abnormalities efficiently.

computer science, artificial intelligence,engineering, electrical & electronic
Unsupervised Deep Anomaly Detection for Medical Images Using an Improved Adversarial Autoencoder

Haibo Zhang,Wenping Guo,Shiqing Zhang,Hongsheng Lu,Xiaoming Zhao

DOI: https://doi.org/10.1007/s10278-021-00558-8

IF: 4.903

2022-01-10

Journal of Digital Imaging

Abstract:Anomaly detection has been applied in the various disease of medical practice, such as breast cancer, retinal, lung lesion, and skin disease. However, in real-world anomaly detection, there exist a large number of healthy samples, and but very few sick samples. To alleviate the problem of data imbalance in anomaly detection, this paper proposes an unsupervised learning method for deep anomaly detection based on an improved adversarial autoencoder, in which a module called chain of convolutional block (CCB) is employed instead of the conventional skip-connections used in adversarial autoencoder. Such CCB connections provide considerable advantages via direct connections, not only preserving both global and local information but also alleviating the problem of semantic disparity between the encoding features and the corresponding decoding features. The proposed method is thus able to capture the distribution of normal samples within both image space and latent vector space. By means of minimizing the reconstruction error within both spaces during training phase, higher reconstruction error during test phase is indicative of an anomaly. Our method is trained only on the healthy persons in order to learn the distribution of normal samples and can detect sick samples based on high deviation from the distribution of normality in an unsupervised way. Experimental results for multiple datasets from different fields demonstrate that the proposed method yields superior performance to state-of-the-art methods.

radiology, nuclear medicine & medical imaging
Anomaly Detection in Chest X-rays Based on Dual-Attention Mechanism and Multi-Scale Feature Fusion

Dong Liu,Shuzhen Lu,Lingrong Zhang,Yaohui Liu

DOI: https://doi.org/10.3390/sym15030668

2023-01-01

Symmetry

Abstract:The efficient and automatic detection of chest abnormalities is vital for the auxiliary diagnosis of medical images. Many studies utilize computer vision and deep learning approaches involving symmetry and asymmetry concepts to detect chest abnormalities, and achieve promising findings. However, an accurate instance-level and multi-label detection of abnormalities in chest X-rays remains a significant challenge. Here, a novel anomaly detection method for symmetric chest X-rays using dual-attention and multi-scale feature fusion is proposed. Three aspects of our method should be noted in comparison with the previous approaches. We improved the deep neural network with channel-dimensional and spatial-dimensional attention to capture the abundant contextual features. We then used an optimized multi-scale learning framework for feature fusion to adapt to the scale variation in the abnormalities. Considering the influence of the data imbalance and other factors, we introduced a seesaw loss function to flexibly adjust the sample weights and enhance the model learning efficiency. The rigorous experimental evaluation of a public chest X-ray dataset with fourteen different types of abnormalities demonstrates that our model has a mean average precision of 0.362 and outperforms existing methods.
Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images

Yu Cai,Hao Chen,Hao Chen,Xin Yang,Yu Zhou,Kwang-Ting Cheng,Kwang-Ting Cheng

DOI: https://doi.org/10.1016/j.media.2023.102794

IF: 10.9

2023-05-01

Medical Image Analysis

Abstract:Medical anomaly detection is a crucial yet challenging task aimed at recognizing abnormal images to assist in diagnosis. Due to the high-cost annotations of abnormal images, most methods utilize only known normal images during training and identify samples deviating from the normal profile as anomalies in the testing phase. Many readily available unlabeled images containing anomalies are thus ignored in the training phase, restricting the performance. To solve this problem, we introduce one-class semi-supervised learning (OC-SSL) to utilize known normal and unlabeled images for training, and propose Dual-distribution Discrepancy for Anomaly Detection (DDAD) based on this setting. Ensembles of reconstruction networks are designed to model the distribution of normal images and the distribution of both normal and unlabeled images, deriving the normative distribution module (NDM) and unknown distribution module (UDM). Subsequently, the intra-discrepancy of NDM and inter-discrepancy between the two modules are designed as anomaly scores. Furthermore, we propose a new perspective on self-supervised learning, which is designed to refine the anomaly scores rather than directly detect anomalies. Five medical datasets, including chest X-rays, brain MRIs and retinal fundus images, are organized as benchmarks for evaluation. Experiments on these benchmarks comprehensively compare a wide range of anomaly detection methods and demonstrate that our method achieves significant gains and outperforms the state-of-the-art. Code and organized benchmarks are available at https://github.com/caiyu6666/DDAD-ASR.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images

Can Cui,Yaohong Wang,Shunxing Bao,Yucheng Tang,Ruining Deng,Lucas W. Remedios,Zuhayr Asad,Joseph T. Roland,Ken S. Lau,Qi Liu,Lori A. Coburn,Keith T. Wilson,Bennett A. Landman,Yuankai Huo

2023-08-19

Abstract:Many anomaly detection approaches, especially deep learning methods, have been recently developed to identify abnormal image morphology by only employing normal images during training. Unfortunately, many prior anomaly detection methods were optimized for a specific "known" abnormality (e.g., brain tumor, bone fraction, cell types). Moreover, even though only the normal images were used in the training process, the abnormal images were often employed during the validation process (e.g., epoch selection, hyper-parameter tuning), which might leak the supposed ``unknown" abnormality unintentionally. In this study, we investigated these two essential aspects regarding universal anomaly detection in medical images by (1) comparing various anomaly detection methods across four medical datasets, (2) investigating the inevitable but often neglected issues on how to unbiasedly select the optimal anomaly detection model during the validation phase using only normal images, and (3) proposing a simple decision-level ensemble method to leverage the advantage of different kinds of anomaly detection without knowing the abnormality. The results of our experiments indicate that none of the evaluated methods consistently achieved the best performance across all datasets. Our proposed method enhanced the robustness of performance in general (average AUC 0.956).

Computer Vision and Pattern Recognition,Artificial Intelligence
Self-Supervised Multi-Scale Cropping and Simple Masked Attentive Predicting for Lung CT-Scan Anomaly Detection

Wei Li,Guanghai Liu,Haoyi Fan,Zuoyong Li,David Zhang

DOI: https://doi.org/10.1109/tmi.2023.3313778

IF: 10.6

2023-01-01

IEEE Transactions on Medical Imaging

Abstract:Anomaly detection has been widely explored by training an out-of-distribution detector with only normal data for medical images. However, detecting local and subtle irregularities without prior knowledge of anomaly types brings challenges for lung CT-scan image anomaly detection. In this paper, we propose a self-supervised framework for learning representations of lung CT-scan images via both multi-scale cropping and simple masked attentive predicting, which is capable of constructing a powerful out-of-distribution detector. Firstly, we propose CropMixPaste, a self-supervised augmentation task for generating density shadow-like anomalies that encourage the model to detect local irregularities of lung CT-scan images. Then, we propose a self-supervised reconstruction block, named simple masked attentive predicting block (SMAPB), to better refine local features by predicting masked context information. Finally, the learned representations by self-supervised tasks are used to build an out-of-distribution detector. The results on real lung CT-scan datasets demonstrate the effectiveness and superiority of our proposed method compared with state-of-the-art methods.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images

Yu Tian,Guansong Pang,Fengbei Liu,Yuanhong Chen,Seon Ho Shin,Johan W. Verjans,Rajvinder Singh,Gustavo Carneiro

DOI: https://doi.org/10.1007/978-3-030-87240-3_13

2021-01-01

Abstract:Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main advantages over its fully supervised counterpart. Firstly, it is able to directly leverage large datasets available from health screening programs that contain mostly normal image samples, avoiding the costly manual labelling of abnormal samples and the subsequent issues involved in training with extremely class-imbalanced data. Further, UAD approaches can potentially detect and localise any type of lesions that deviate from the normal patterns. One significant challenge faced by UAD methods is how to learn effective low-dimensional image representations to detect and localise subtle abnormalities, generally consisting of small lesions. To address this challenge, we propose a novel self-supervised representation learning method, called Constrained Contrastive Distribution learning for anomaly detection (CCD), which learns fine-grained feature representations by simultaneously predicting the distribution of augmented data and image contexts using contrastive learning with pretext constraints. The learned representations can be leveraged to train more anomaly-sensitive detection models. Extensive experiment results show that our method outperforms current state-of-the-art UAD approaches on three different colonoscopy and fundus screening datasets. Our code is available at https://github.com/tianyu0207/CCD.
Self-Supervised Out-of-Distribution Detection in Brain CT Scans

Abinav Ravi Venkatakrishnan,Seong Tae Kim,Rami Eisawy,Franz Pfister,Nassir Navab

DOI: https://doi.org/10.48550/arXiv.2011.05428

2020-11-11

Abstract:Medical imaging data suffers from the limited availability of annotation because annotating 3D medical data is a time-consuming and expensive task. Moreover, even if the annotation is available, supervised learning-based approaches suffer highly imbalanced data. Most of the scans during the screening are from normal subjects, but there are also large variations in abnormal cases. To address these issues, recently, unsupervised deep anomaly detection methods that train the model on large-sized normal scans and detect abnormal scans by calculating reconstruction error have been reported. In this paper, we propose a novel self-supervised learning technique for anomaly detection. Our architecture largely consists of two parts: 1) Reconstruction and 2) predicting geometric transformations. By training the network to predict geometric transformations, the model could learn better image features and distribution of normal scans. In the test time, the geometric transformation predictor can assign the anomaly score by calculating the error between geometric transformation and prediction. Moreover, we further use self-supervised learning with context restoration for pretraining our model. By comparative experiments on clinical brain CT scans, the effectiveness of the proposed method has been verified.

Image and Video Processing,Computer Vision and Pattern Recognition
Towards Universal Unsupervised Anomaly Detection in Medical Imaging

Cosmin I. Bercea,Benedikt Wiestler,Daniel Rueckert,Julia A. Schnabel

2024-01-19

Abstract:The increasing complexity of medical imaging data underscores the need for advanced anomaly detection methods to automatically identify diverse pathologies. Current methods face challenges in capturing the broad spectrum of anomalies, often limiting their use to specific lesion types in brain scans. To address this challenge, we introduce a novel unsupervised approach, termed \textit{Reversed Auto-Encoders (RA)}, designed to create realistic pseudo-healthy reconstructions that enable the detection of a wider range of pathologies. We evaluate the proposed method across various imaging modalities, including magnetic resonance imaging (MRI) of the brain, pediatric wrist X-ray, and chest X-ray, and demonstrate superior performance in detecting anomalies compared to existing state-of-the-art methods. Our unsupervised anomaly detection approach may enhance diagnostic accuracy in medical imaging by identifying a broader range of unknown pathologies. Our code is publicly available at: \url{

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Images

Yu Tian,Fengbei Liu,Guansong Pang,Yuanhong Chen,Yuyuan Liu,Johan W. Verjans,Rajvinder Singh,Gustavo Carneiro

2023-08-15

Abstract:Unsupervised anomaly detection (UAD) methods are trained with normal (or healthy) images only, but during testing, they are able to classify normal and abnormal (or disease) images. UAD is an important medical image analysis (MIA) method to be applied in disease screening problems because the training sets available for those problems usually contain only normal images. However, the exclusive reliance on normal images may result in the learning of ineffective low-dimensional image representations that are not sensitive enough to detect and segment unseen abnormal lesions of varying size, appearance, and shape. Pre-training UAD methods with self-supervised learning, based on computer vision techniques, can mitigate this challenge, but they are sub-optimal because they do not explore domain knowledge for designing the pretext tasks, and their contrastive learning losses do not try to cluster the normal training images, which may result in a sparse distribution of normal images that is ineffective for anomaly detection. In this paper, we propose a new self-supervised pre-training method for MIA UAD applications, named Pseudo Multi-class Strong Augmentation via Contrastive Learning (PMSACL). PMSACL consists of a novel optimisation method that contrasts a normal image class from multiple pseudo classes of synthesised abnormal images, with each class enforced to form a dense cluster in the feature space. In the experiments, we show that our PMSACL pre-training improves the accuracy of SOTA UAD methods on many MIA benchmarks using colonoscopy, fundus screening and Covid-19 Chest X-ray datasets. The code is made publicly available via <a class="link-external link-https" href="https://github.com/tianyu0207/PMSACL" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition
Unsupervised Anomaly Localization with Structural Feature-Autoencoders

Felix Meissen,Johannes Paetzold,Georgios Kaissis,Daniel Rueckert

DOI: https://doi.org/10.48550/arXiv.2208.10992

2022-08-23

Image and Video Processing

Abstract:Unsupervised Anomaly Detection has become a popular method to detect pathologies in medical images as it does not require supervision or labels for training. Most commonly, the anomaly detection model generates a "normal" version of an input image, and the pixel-wise $l^p$-difference of the two is used to localize anomalies. However, large residuals often occur due to imperfect reconstruction of the complex anatomical structures present in most medical images. This method also fails to detect anomalies that are not characterized by large intensity differences to the surrounding tissue. We propose to tackle this problem using a feature-mapping function that transforms the input intensity images into a space with multiple channels where anomalies can be detected along different discriminative feature maps extracted from the original image. We then train an Autoencoder model in this space using structural similarity loss that does not only consider differences in intensity but also in contrast and structure. Our method significantly increases performance on two medical data sets for brain MRI. Code and experiments are available at https://github.com/FeliMe/feature-autoencoder
Anomaly Detection in Medical Imaging With Deep Perceptual Autoencoders

Nina Shvetsova,Bart Bakker,Irina Fedulova,Heinrich Schulz,Dmitry V. Dylov

DOI: https://doi.org/10.1109/access.2021.3107163

IF: 3.9

2021-01-01

IEEE Access

Abstract:Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex images, such as those encountered in the medical domain. Barely visible abnormalities in chest X-rays or metastases in lymph nodes on the scans of the pathology slides resemble normal images and are very difficult to detect. To address this problem, we introduce a new powerful method of image anomaly detection. It relies on the classical autoencoder approach with a re-designed training pipeline to handle high-resolution, complex images, and a robust way of computing an image abnormality score. We revisit the very problem statement of fully unsupervised anomaly detection, where no abnormal examples are provided during the model setup. We propose to relax this unrealistic assumption by using a very small number of anomalies of confined variability merely to initiate the search of hyperparameters of the model. We evaluate our solution on two medical datasets containing radiology and digital pathology images, where the state-of-the-art anomaly detection models, originally devised for natural image benchmarks, fail to perform sufficiently well. The proposed approach suggests a new baseline for anomaly detection in medical image analysis tasks.

computer science, information systems,telecommunications,engineering, electrical & electronic
Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images

Chaoqin Huang,Aofan Jiang,Jinghao Feng,Ya Zhang,Xinchao Wang,Yanfeng Wang

2024-03-19

Abstract:Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical images limits the effectiveness of these methodologies in medical anomaly detection. This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. This multi-level adaptation is guided by multi-level, pixel-wise visual-language feature alignment loss functions, which recalibrate the model's focus from object semantics in natural imagery to anomaly identification in medical images. The adapted features exhibit improved generalization across various medical data types, even in zero-shot scenarios where the model encounters unseen medical modalities and anatomical regions during training. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models, with an average AUC improvement of 6.24% and 7.33% for anomaly classification, 2.03% and 2.37% for anomaly segmentation, under the zero-shot and few-shot settings, respectively. Source code is available at:

Computer Vision and Pattern Recognition
Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image

Zerui Zhang,Zhichao Sun,Zelong Liu,Bo Du,Rui Yu,Zhou Zhao,Yongchao Xu

2024-05-21

Abstract:Medical anomaly detection is a critical research area aimed at recognizing abnormal images to aid in diagnosis.Most existing methods adopt synthetic anomalies and image restoration on normal samples to detect anomaly. The unlabeled data consisting of both normal and abnormal data is not well explored. We introduce a novel Spatial-aware Attention Generative Adversarial Network (SAGAN) for one-class semi-supervised generation of health images.Our core insight is the utilization of position encoding and attention to accurately focus on restoring abnormal regions and preserving normal regions. To fully utilize the unlabelled data, SAGAN relaxes the cyclic consistency requirement of the existing unpaired image-to-image conversion methods, and generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images.Subsequently, the discrepancy between the generated healthy image and the original image is utilized as an anomaly score.Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.

Image and Video Processing,Computer Vision and Pattern Recognition
Self-Supervised Anomaly Detection from Anomalous Training Data via Iterative Latent Token Masking

Ashay Patel,Petru-Daniel Tudosiu,Walter H L Pinaya,Mark S Graham,Olusola Adeleke,Gary Cook,Vicky Goh,Sebastien Ourselin,M Jorge Cardoso

DOI: https://doi.org/10.1109/ICCVW60793.2023.00254

2023-12-25

Abstract:Anomaly detection and segmentation pose an important task across sectors ranging from medical imaging analysis to industry quality control. However, current unsupervised approaches require training data to not contain any anomalies, a requirement that can be especially challenging in many medical imaging scenarios. In this paper, we propose Iterative Latent Token Masking, a self-supervised framework derived from a robust statistics point of view, translating an iterative model fitting with M-estimators to the task of anomaly detection. In doing so, this allows the training of unsupervised methods on datasets heavily contaminated with anomalous images. Our method stems from prior work on using Transformers, combined with a Vector Quantized-Variational Autoencoder, for anomaly detection, a method with state-of-the-art performance when trained on normal (non-anomalous) data. More importantly, we utilise the token masking capabilities of Transformers to filter out suspected anomalous tokens from each sample's sequence in the training set in an iterative self-supervised process, thus overcoming the difficulties of highly anomalous training data. Our work also highlights shortfalls in current state-of-the-art self-supervised, self-trained and unsupervised models when faced with small proportions of anomalous training data. We evaluate our method on whole-body PET data in addition to showing its wider application in more common computer vision tasks such as the industrial MVTec Dataset. Using varying levels of anomalous training data, our method showcases a superior performance over several state-of-the-art models, drawing attention to the potential of this approach.
Unsupervised anomaly detection for posteroanterior chest X-rays using multiresolution patch-based self-supervised learning

Minki Kim,Ki-Ryum Moon,Byoung-Dai Lee

DOI: https://doi.org/10.1038/s41598-023-30589-w

IF: 4.6

2023-03-04

Scientific Reports

Abstract:The demand for anomaly detection, which involves the identification of abnormal samples, has continued to increase in various domains. In particular, with increases in the data volume of medical imaging, the demand for automated screening systems has also risen. Consequently, in actual clinical practice, radiologists can focus only on diagnosing patients with abnormal findings. In this study, we propose an unsupervised anomaly detection method for posteroanterior chest X-rays (CXR) using multiresolution patch-based self-supervised learning. The core aspect of our approach is to leverage patch images of different sizes for training and testing to recognize diverse anomalies characterized by unknown shapes and scales. In addition, self-supervised contrastive learning is applied to learn the generalized and robust features of the patches. The performance of the proposed method is evaluated using posteroanterior CXR images from a public dataset for training and testing. The results show that the proposed method is superior to state-of-the-art anomaly detection methods. In addition, unlike single-resolution patch-based methods, the proposed method consistently exhibits a good overall performance regardless of the evaluation criteria used for comparison, thus demonstrating the effectiveness of using multiresolution patch-based features. Overall, the results of this study validate the effectiveness of multiresolution patch-based self-supervised learning for detecting anomalies in CXR images.

multidisciplinary sciences
Weakly Supervised Anomaly Detection for Chest X-Ray Image

Haoqi Ni,Ximiao Zhang,Min Xu,Ning Lang,Xiuzhuang Zhou

2023-11-19

Abstract:Chest X-Ray (CXR) examination is a common method for assessing thoracic diseases in clinical applications. While recent advances in deep learning have enhanced the significance of visual analysis for CXR anomaly detection, current methods often miss key cues in anomaly images crucial for identifying disease regions, as they predominantly rely on unsupervised training with normal images. This letter focuses on a more practical setup in which few-shot anomaly images with only image-level labels are available during training. For this purpose, we propose WSCXR, a weakly supervised anomaly detection framework for CXR. WSCXR firstly constructs sets of normal and anomaly image features respectively. It then refines the anomaly image features by eliminating normal region features through anomaly feature mining, thus fully leveraging the scarce yet crucial features of diseased areas. Additionally, WSCXR employs a linear mixing strategy to augment the anomaly features, facilitating the training of anomaly detector with few-shot anomaly images. Experiments on two CXR datasets demonstrate the effectiveness of our approach.

Image and Video Processing,Computer Vision and Pattern Recognition

Development and incorporation of microsatellite markers into the linkage map of sugar beet (Beta vulgaris spp.)

A Weakly-Supervised Anomaly Detection Method Via Adversarial Training for Medical Images

A Model-Agnostic Framework for Universal Anomaly Detection of Multi-organ and Multi-modal Images

Anomaly Detection on X-Rays Using Self-Supervised Aggregation Learning

Anomaly Detection for Medical Images using Heterogeneous Auto-Encoder

Unsupervised Deep Anomaly Detection for Medical Images Using an Improved Adversarial Autoencoder

Anomaly Detection in Chest X-rays Based on Dual-Attention Mechanism and Multi-Scale Feature Fusion

Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images

Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images

Self-Supervised Multi-Scale Cropping and Simple Masked Attentive Predicting for Lung CT-Scan Anomaly Detection

Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images

Self-Supervised Out-of-Distribution Detection in Brain CT Scans

Towards Universal Unsupervised Anomaly Detection in Medical Imaging

Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Images

Unsupervised Anomaly Localization with Structural Feature-Autoencoders

Anomaly Detection in Medical Imaging With Deep Perceptual Autoencoders

Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images

Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image

Self-Supervised Anomaly Detection from Anomalous Training Data via Iterative Latent Token Masking

Unsupervised anomaly detection for posteroanterior chest X-rays using multiresolution patch-based self-supervised learning

Weakly Supervised Anomaly Detection for Chest X-Ray Image