[Prolonged electrostimulation of the heart through the coronary sinus. Report of two cases with position of the electrodes confirmed by autopsy (author's transl)].

H. Präuer,L. Schmück,A. Wirtzfeld

Abstract:

What problem does this paper attempt to address?

Achieving data utility-privacy tradeoff in Internet of Medical Things: A machine learning approach

Zhitao Guan,Zefang Lv,Xiaojiang Du,Longfei Wu,Mohsen Guizani

DOI: https://doi.org/10.1016/j.future.2019.01.058

IF: 7.307

2019-09-01

Future Generation Computer Systems

Abstract:The emergence and rapid development of the Internet of Medical Things (IoMT), an application of the Internet of Things into the medical and healthcare systems, have brought many changes and challenges to modern medical and healthcare systems. Particularly, machine learning technology can be used to process the data involved in IoMT for medical analysis and disease diagnosis. However, in this process, the disclosure of personal privacy information must receive considerable attentions especially for sensitive medical data. Cluster analysis is an important technique for medical analysis and disease diagnosis. To enable privacy-preserving cluster analysis in IoMT, this paper proposed an Efficient Differentially Private Data Clustering scheme (EDPDCS) based on MapReduce framework. In EDPDCS, we optimize the allocation of privacy budgets and the selection of initial centroids to improve the accuracy of differentially private K-means clustering algorithm. Specifically, the number of iterations of the K-means algorithm is set to a fixed value according to the total privacy budget and the minimal privacy budget of each iteration. In addition, an improved initial centroids selection method is proposed to increase the accuracy and efficiency of the clustering algorithm. Finally, we prove that the proposed EDPDCS can improve the accuracy of the differentially private k-means algorithm by comparing the Normalized Intra-Cluster Variance (NICV) produced by our algorithm on two datasets with two other algorithms.
Intelligent medical heterogeneous big data set balanced clustering using deep learning

Xiaofeng Li,Hongshuang Jiao,Dong Li

DOI: https://doi.org/10.1016/j.patrec.2020.08.027

IF: 4.757

2020-10-01

Pattern Recognition Letters

Abstract:<p>In order to address the clustering problem of intelligent medical data, the data sets were not preprocessed using the traditional method, leading to a large amount of calculation, low efficiency, and large data cluster center offset distance. We proposed a balanced clustering algorithm for intelligent medical heterogeneous big data set using deep learning. Firstly, a deep neural network model based on incremental updating was constructed, and adaptive training and adjustment were made according to data scale, and the multi-layer feature learning of heterogeneous big data sets of intelligent medical care. Secondly, under-sampling preprocessing was carried out on the data set so that the data of the heterogeneous big data set was in a balanced state, and on this basis, clustering calculation of the heterogeneous big data was conducted. Then, the clustering center was set according to the kernel density estimation results, and the data cluster center was updated iteratively until convergence by combining the data features obtained from deep learning and euclidean distance calculation, so as to complete the balanced clustering of the heterogeneous big data set of intelligent medical treatment. The results show that the proposed algorithm has the advantages of small data cluster center offset distance, short clustering time, low energy consumption, high Macro-F1 value and NMI value, and the accuracy of clustering can be as high as 95%, the calculational cost is low, which has certain advantages.</p><p>2020 Elsevier Ltd. All rights reserved.</p>

computer science, artificial intelligence
PPHOPCM Privacy-Preserving High-order Possibilistic C-Means Algorithm for Big Data Clustering with Cloud Computing

Vijaya Nanthini,R. Mahalakshmi

DOI: https://doi.org/10.48175/ijarsct-18608

2024-05-30

Abstract:In image analysis and knowledge discovery, the possibilistic c-means technique (PCM), a crucial fuzzy clustering tool in data mining and pattern recognition, is widely used. Nevertheless, because PCM was first developed for small structured datasets, it might be difficult to get good clustering results for huge data, especially when the data is diverse. The research proposes a high-order PCM approach (HOPCM) for big data clustering, which resolves this problem by optimizing the objective function using tensor space. We also build a distributed HOPCM method for extraordinarily large amounts of heterogeneous data using MapReduce. Finally, we create a privacy-preserving HOPCM algorithm (PPHOPCM) to protect sensitive data on cloud servers by utilizing the BGV encryption method. PPHOPCM approximates the functions for updating the membership matrix and clustering canters as polynomial functions, facilitating the safe computation of the BGV method. Based on trial results, PPHOPCM may effectively cluster a large volume of heterogeneous data using cloud computing without revealing personal data.
Text clustering based on pre-trained models and autoencoders

Qiang Xu,Hao Gu,ShengWei Ji

DOI: https://doi.org/10.3389/fncom.2023.1334436

IF: 3.387

2024-01-05

Frontiers in Computational Neuroscience

Abstract:Text clustering is the task of grouping text data based on similarity, and it holds particular importance in the medical field. sIn healthcare, medical data clustering is a highly active and effective research area. It not only provides strong support for making correct medical decisions from medical datasets but also aids in patient record management and medical information retrieval. With the development of the healthcare industry, a large amount of medical data is being generated, and traditional medical data clustering faces significant challenges. Many existing text clustering algorithms are primarily based on the bag-of-words model, which has issues such as high dimensionality, sparsity, and the neglect of word positions and context. Pre-trained models are a deep learning-based approach that treats text as a sequence to accurately capture word positions and context information. Moreover, compared to traditional K-means and fuzzy C-means clustering models, deep learning-based clustering algorithms are better at handling high-dimensional, complex, and nonlinear data. In particular, clustering algorithms based on autoencoders can learn data representations and clustering information, effectively reducing noise interference and errors during the clustering process. This paper combines pre-trained language models with deep embedding clustering models. Experimental results demonstrate that our model performs exceptionally well on four public datasets, outperforming most existing text clustering algorithms, and can be applied to medical data clustering.

neurosciences,mathematical & computational biology
Multiple fuzzy c-means clustering algorithm in medical diagnosis

yanping wu,huilong duan,shufeng du

DOI: https://doi.org/10.3233/THC-150989

IF: 1.6

2015-01-01

Technology and Health Care

Abstract:BACKGROUND: In recent years, the use of the fuzzy c-means (FCM) clustering techniques in medical diagnosis has steadily increased, because of its effectiveness in recognizing systems in the medical database to help medical experts diagnosing diseases. However, its performance is highly dependent on the randomly initialized cluster centroids which may allow the diagnosis to be trapped into the problem of the local optimum. OBJECTIVE: This paper proposes a multiple fuzzy c-means (MFCM) algorithm for medical diagnosis. METHODS: The new method optimizes the initial optimizing cluster centers by comparing the Euclidean distance between patient data. Further, this paper assigns a set of weights to the features of a certain disease to equalize their difference influence as a substitute for data normalization. RESULTS: The performance of proposed MFCM algorithm was demonstrated through dividing complex primary headache data into Migraine, Tension-Type Headache (TTH), Trigeminal Autonomic Cephalalgias (TACs) and other primary headache disorders. In addition the superiority of MFCM algorithm was proven by comparing analytical results with other state-of-the-art clustering methods. CONCLUSIONS: This MFCM method has shown a new application in medical diagnosis.
DICE: Deep Significance Clustering for Outcome-Aware Stratification

Yufang Huang,Kelly M. Axsom,John Lee,Lakshminarayanan Subramanian,Yiye Zhang

DOI: https://doi.org/10.48550/arXiv.2101.02344

2021-01-07

Abstract:We present deep significance clustering (DICE), a framework for jointly performing representation learning and clustering for "outcome-aware" stratification. DICE is intended to generate cluster membership that may be used to categorize a population by individual risk level for a targeted outcome. Following the representation learning and clustering steps, we embed the objective function in DICE with a constraint which requires a statistically significant association between the outcome and cluster membership of learned representations. DICE further includes a neural architecture search step to maximize both the likelihood of representation learning and outcome classification accuracy with cluster membership as the predictor. To demonstrate its utility in medicine for patient risk-stratification, the performance of DICE was evaluated using two datasets with different outcome ratios extracted from real-world electronic health records. Outcomes are defined as acute kidney injury (30.4\%) among a cohort of COVID-19 patients, and discharge disposition (36.8\%) among a cohort of heart failure patients, respectively. Extensive results demonstrate that DICE has superior performance as measured by the difference in outcome distribution across clusters, Silhouette score, Calinski-Harabasz index, and Davies-Bouldin index for clustering, and Area under the ROC Curve (AUC) for outcome classification compared to several baseline approaches.

Machine Learning,Artificial Intelligence,Neural and Evolutionary Computing
Semi-Supervised Possibilistic c-Means Clustering Algorithm Based on Feature Weights for Imbalanced Data

Haiyan Yu,Xiaoyu Xu,Honglei Li,Yuting Wu,Bo Lei

DOI: https://doi.org/10.1016/j.knosys.2024.111388

IF: 8.139

2024-01-12

Knowledge-Based Systems

Abstract:The possibilistic c-means clustering (PCM) algorithm improves the robustness of fuzzy c-means clustering (FCM) to noise and outliers by releasing the probabilistic constraint of memberships. The semi-supervised possibilistic c-means clustering (SSPCM) algorithm improves the clustering effect on datasets with imbalanced sizes by introducing a small amount of label information. However, the traditional semi-supervised algorithm still faces the problem of low utilization of supervision information for datasets with large differences in sample sizes. Moreover, the Euclidean distance, which treats features equally, cannot handle feature-imbalanced data. Therefore, this paper proposes a semi-supervised possibilistic c-means clustering algorithm based on feature weights (FW-SSPCM) by introducing the ideas of supervised centers. First, the algorithm introduces the supervised center into the objective function of the SSPCM to improve the utilization rate of supervision information and thus guide the center iteration of small clusters. Second, the feature weighting strategy is introduced in the objective function to adaptively assign feature weights according to the importance of different features in different clusters, thus improving the adaptability of the algorithm to feature-imbalanced datasets. In addition, to improve the robustness of the antinoise effect and retain additional image details, a new image segmentation algorithm based on FW-SSPCM and local information (LFW-SSPCM) is proposed by introducing local spatial information obtained by bilateral filtering. Finally, through clustering experiments on synthetic data, UCI datasets and on color images characteristic of multiple features, including imbalanced sizes, imbalanced features and strong noise injection, the clustering performances of the proposed FW-SSPCM and LFW-SSPCM proposed in this paper are significantly better than those of several related clustering algorithms.

computer science, artificial intelligence
Regulation of amylase activity in Drosophila melanogaster: Effects of dietary carbohydrate

D. Hickey,B. Benkel

DOI: https://doi.org/10.1007/BF00498936

1982-12-01

Biochemical Genetics

Abstract:
A possibilistic Fuzzy c-means algorithm based on improved Cuckoo search for data clustering

Do Viet Duc,Ngo Thanh Long,Ha Trung Hai,Chu Van Hai,Nghiem Van Tam

DOI: https://doi.org/10.54939/1859-1043.j.mst.csce6.2022.3-15

2022-12-30

Journal of Military Science and Technology

Abstract:Possibilistic Fuzzy c-means (PFCM) algorithm is a powerful clustering algorithm. It is a combination of two algorithms Fuzzy c-means (FCM) and Possibilistic c-means (PCM). PFCM algorithm deals with the weaknesses of FCM in handling noise sensitivity and the weaknesses of PCM in the case of coincidence clusters. However, PFCM still has a common weakness of clustering algorithms that is easy to fall into local optimization. Cuckoo search (CS) is a novel evolutionary algorithm, which has been tested on some optimization problems and proved to be stable and high-efficiency. In this study, we propose a hybrid method encompassing PFCM and improved Cuckoo search to form the proposed PFCM-ICS. The proposed method has been evaluated on 4 data sets issued from the UCI Machine Learning Repository and compared with recent clustering algorithms such as FCM, PFCM, PFCM based on particle swarm optimization (PSO), PFCM based on CS. Experimental results show that the proposed method gives better clustering quality and higher accuracy than other algorithms.
DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorization

Turkay Kart,Wenjia Bai,Ben Glocker,Daniel Rueckert

DOI: https://doi.org/10.1007/978-3-030-88210-5_26

2021-10-01

Abstract:In recent years, the research landscape of machine learning in medical imaging has changed drastically from supervised to semi-, weakly- or unsupervised methods. This is mainly due to the fact that ground-truth labels are time-consuming and expensive to obtain manually. Generating labels from patient metadata might be feasible but it suffers from user-originated errors which introduce biases. In this work, we propose an unsupervised approach for automatically clustering and categorizing large-scale medical image datasets, with a focus on cardiac MR images, and without using any labels. We investigated the end-to-end training using both class-balanced and imbalanced large-scale datasets. Our method was able to create clusters with high purity and achieved over 0.99 cluster purity on these datasets. The results demonstrate the potential of the proposed method for categorizing unstructured large medical databases, such as organizing clinical PACS systems in hospitals.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Deep Online Probability Aggregation Clustering

Yuxuan Yan,Na Lu,Ruofan Yan

2024-07-13

Abstract:Combining machine clustering with deep models has shown remarkable superiority in deep clustering. It modifies the data processing pipeline into two alternating phases: feature clustering and model training. However, such alternating schedule may lead to instability and computational burden issues. We propose a centerless clustering algorithm called Probability Aggregation Clustering (PAC) to proactively adapt deep learning technologies, enabling easy deployment in online deep clustering. PAC circumvents the cluster center and aligns the probability space and distribution space by formulating clustering as an optimization problem with a novel objective function. Based on the computation mechanism of the PAC, we propose a general online probability aggregation module to perform stable and flexible feature clustering over mini-batch data and further construct a deep visual clustering framework deep PAC (DPAC). Extensive experiments demonstrate that PAC has superior clustering robustness and performance and DPAC remarkably outperforms the state-of-the-art deep clustering methods.

Machine Learning,Computer Vision and Pattern Recognition
Deep Multi-Kernel Auto-Encoder Network for Clustering Brain Functional Connectivity Data.

Hu Lu,Saixiong Liu,Hui Wei,Chao Chen,Xia Geng

DOI: https://doi.org/10.1016/j.neunet.2020.12.005

IF: 7.8

2020-01-01

Neural Networks

Abstract:In this study, we propose a deep-learning network model called the deep multi-kernel auto-encoder clustering network (DMACN) for clustering functional connectivity data for brain diseases. This model is an end-to-end clustering algorithm that can learn potentially advanced features and cluster disease categories. Unlike other auto-encoders, DMACN has an added self-expression layer and standard back-propagation is used to learn the features that are beneficial for clustering brain functional connectivity data. In the self-expression layer, the kernel matrix is constructed to extract effective features and a new loss function is proposed to constrain the clustering portion, which enables the training of a deep neural learning network that tends to cluster. To test the performance of the proposed algorithm, we applied the end-to-end deep unsupervised clustering algorithm to brain connectivity data. We then conducted experiments based on four public brain functional connectivity data sets and our own functional connectivity data set. The DMACN algorithm yielded good results in various evaluations compared with the existing clustering algorithm for brain functional connectivity data, the deep auto-encoder clustering algorithm, and several other relevant clustering algorithms. The deep-learning-based clustering algorithm has great potential for use in the unsupervised recognition of brain diseases.
Deep Embedded K-Means Clustering

Wengang Guo,Kaiyan Lin,Wei Ye

DOI: https://doi.org/10.48550/arXiv.2109.15149

2021-09-30

Abstract:Recently, deep clustering methods have gained momentum because of the high representational power of deep neural networks (DNNs) such as autoencoder. The key idea is that representation learning and clustering can reinforce each other: Good representations lead to good clustering while good clustering provides good supervisory signals to representation learning. Critical questions include: 1) How to optimize representation learning and clustering? 2) Should the reconstruction loss of autoencoder be considered always? In this paper, we propose DEKM (for Deep Embedded K-Means) to answer these two questions. Since the embedding space generated by autoencoder may have no obvious cluster structures, we propose to further transform the embedding space to a new space that reveals the cluster-structure information. This is achieved by an orthonormal transformation matrix, which contains the eigenvectors of the within-class scatter matrix of K-means. The eigenvalues indicate the importance of the eigenvectors' contributions to the cluster-structure information in the new space. Our goal is to increase the cluster-structure information. To this end, we discard the decoder and propose a greedy method to optimize the representation. Representation learning and clustering are alternately optimized by DEKM. Experimental results on the real-world datasets demonstrate that DEKM achieves state-of-the-art performance.

Machine Learning
FedMCC: Federated multi-center clustering algorithm to improve privacy healthcare

Zhiwei An,Jinli Zhang,Zongli Jiang,Jinlian Du,Zhiyi Yin,Chen Li

DOI: https://doi.org/10.1016/j.ymeth.2023.07.006

IF: 4.647

Methods

Abstract:In recent years, healthcare data from various sources such as clinical institutions, patients, and pharmaceutical industries have become increasingly abundant. However, due to the complex healthcare system and data privacy concerns, aggregating and utilizing these data in a centralized manner can be challenging. Federated learning (FL) has emerged as a promising solution for distributed training in edge computing scenarios, utilizing on-device user data while reducing server costs. In traditional FL, a central server trains a global model sampled client data randomly, and the server combines the collected model from different clients into one global model. However, for not independent and identically distributed (non-i.i.d.) datasets, randomly selecting users to train server is not an optimal choice and can lead to poor model training performance. To address this limitation, we propose the Federated Multi-Center Clustering algorithm (FedMCC) to enhance the robustness and accuracy for all clients. FedMCC leverages the Model-Agnostic Meta-Learning (MAML) algorithm, focusing on training a robust base model during the initial training phase and better capturing features from different users. Subsequently, clustering methods are used to ensure that features among users within each cluster are similar, approximating an i.i.d. training process in each round, resulting in more effective training of the global model. We validate the effectiveness and generalizability of FedMCC through extensive experiments on public healthcare datasets. The results demonstrate that FedMCC achieves improved performance and accuracy for all clients while maintaining data privacy and security, showcasing its potential for various healthcare applications.
Using deep clustering to improve fMRI dynamic functional connectivity analysis

Arthur P C Spencer,Marc Goodfellow

DOI: https://doi.org/10.1016/j.neuroimage.2022.119288

IF: 5.7

2022-08-15

NeuroImage

Abstract:Dynamic functional connectivity (dFC) analysis of resting-state fMRI data is commonly performed by calculating sliding-window correlations (SWC), followed by k-means clustering in order to assign each window to a given state. Studies using synthetic data have shown that k-means performance is highly dependent on sliding window parameters and signal-to-noise ratio. Additionally, sources of heterogeneity between subjects may affect the accuracy of group-level clustering, thus affecting measurements of dFC state temporal properties such as dwell time and fractional occupancy. This may result in spurious conclusions regarding differences between groups (e.g. when comparing a clinical population to healthy controls). Therefore, is it important to quantify the ability of k-means to estimate dFC state temporal properties when applied to cohorts of multiple subjects, and to explore ways in which clustering performance can be maximised. Here, we explore the use of dimensionality reduction methods prior to clustering in order to map high-dimensional data to a lower dimensional space, providing salient features to the subsequent clustering step. We assess the use of deep autoencoders for dimensionality reduction prior to applying k-means clustering to the encoded data. We compare this deep clustering method to dimensionality reduction using principle component analysis (PCA), uniform manifold approximation and projection (UMAP), as well as applying k-means to the original feature space using either L1 or L2 distance. We provide extensive quantitative evaluation of clustering performance using synthetic datasets, representing data from multiple heterogeneous subjects. In synthetic data we find that deep clustering gives the best performance, while other approaches are often insufficient to capture temporal properties of dFC states. We then demonstrate the application of each method to real-world data from human subjects and show that the choice of dimensionality reduction method has a significant effect on group-level measurements of state temporal properties.
Y-net: Biomedical Image Segmentation and Clustering

Sharmin Pathan,Anant Tripathi

DOI: https://doi.org/10.48550/arXiv.2004.05698

2020-05-27

Abstract:We propose a deep clustering architecture alongside image segmentation for medical image analysis. The main idea is based on unsupervised learning to cluster images on severity of the disease in the subject's sample, and this image is then segmented to highlight and outline regions of interest. We start with training an autoencoder on the images for segmentation. The encoder part from the autoencoder branches out to a clustering node and segmentation node. Deep clustering using Kmeans clustering is performed at the clustering branch and a lightweight model is used for segmentation. Each of the branches use extracted features from the autoencoder. We demonstrate our results on ISIC 2018 Skin Lesion Analysis Towards Melanoma Detection and Cityscapes datasets for segmentation and clustering. The proposed architecture beats UNet and DeepLab results on the two datasets, and has less than half the number of parameters. We use the deep clustering branch for clustering images into four clusters. Our approach can be applied to work with high complexity datasets of medical imaging for analyzing survival prediction for severe diseases or customizing treatment based on how far the disease has propagated. Clustering patients can help understand how binning should be done on real valued features to reduce feature sparsity and improve accuracy on classification tasks. The proposed architecture can provide an early diagnosis and reduce human intervention on labeling as it can become quite costly as the datasets grow larger. The main idea is to propose a one shot approach to segmentation with deep clustering.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Possibilistic picture fuzzy product partition C-means clustering incorporating rich local information for medical image segmentation

Liu, Tairong

DOI: https://doi.org/10.1007/s11042-024-19080-4

IF: 2.577

2024-04-26

Multimedia Tools and Applications

Abstract:Picture fuzzy C-means clustering is a new computational intelligence method that has more significant potential advantages than fuzzy clustering in medical image interpretation. However, the practical application of picture fuzzy clustering in medical image segmentation is severely limited by its sensitivity to noise or outliers. Therefore, this paper proposes a medical image segmentation method called possibilistic picture fuzzy product partition C-means clustering with local information. This method combines picture fuzzy clustering with fuzzy possibilistic product partition C-means clustering to solve the segmentation problem of noisy medical image. Firstly, this paper extends picture fuzzy clustering to construct a possibilistic picture C-means clustering, enhancing the robustness of picture fuzzy clustering to noise or outliers. Secondly, by combining picture fuzzy clustering with possibilistic picture C-means clustering, a novel possibilistic picture fuzzy product partition C-means clustering is proposed, further enhancing the adaptability of picture fuzzy clustering in medical image analysis. Finally, a weighted squared Euclidean distance with complement spatial information and a novel possibilistic picture fuzzy local information factor are constructed, and they are introduced into the possibilistic picture fuzzy product partition clustering to enhance the robustness of this method in noisy image segmentation. The experimental results on medical images indicate that the proposed method not only has good segmentation performance and strong anti-noise robustness, but also improves segmentation accuracy by 1.66% to 17.39% compared with FRFCM method.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Deep multi-semantic fuzzy K-means with adaptive weight adjustment

Xiaodong Wang,Longfu Hong,Fei Yan,Jiayu Wang,Zhiqiang Zeng

DOI: https://doi.org/10.1007/s10115-024-02221-4

IF: 2.7

2024-09-20

Knowledge and Information Systems

Abstract:Existing deep fuzzy clustering methods employ deep neural networks to extract high-level feature embeddings from data, thereby enhancing subsequent clustering and achieving superior performance compared to traditional methods. However, solely relying on feature embeddings may cause clustering models to ignore detailed information within data. To address this issue, this paper designs a deep multi-semantic fuzzy K-means (DMFKM) model. Our method harnesses the semantic complementarity of various kinds of features within autoencoder to improve clustering performance. Additionally, to fully exploit the contribution of different types of features to each cluster, we propose an adaptive weight adjustment mechanism to dynamically calculate the importance of different features during clustering. To validate the effectiveness of the proposed method, we applied it to six benchmark datasets. DMFKM significantly outperforms the prevailing fuzzy clustering techniques across different evaluation metrics. Specifically, on the six benchmark datasets, our method achieves notable gains over the second-best comparison method, with an ACC improvement of approximately 2.42%, a Purity boost of around 1.94%, and an NMI enhancement of roughly 0.65%.

computer science, information systems, artificial intelligence
Deep Density-based Image Clustering

Yazhou Ren,Ni Wang,Mingxia Li,Zenglin Xu

DOI: https://doi.org/10.48550/arXiv.1812.04287

2018-12-11

Abstract:Recently, deep clustering, which is able to perform feature learning that favors clustering tasks via deep neural networks, has achieved remarkable performance in image clustering applications. However, the existing deep clustering algorithms generally need the number of clusters in advance, which is usually unknown in real-world tasks. In addition, the initial cluster centers in the learned feature space are generated by $k$-means. This only works well on spherical clusters and probably leads to unstable clustering results. In this paper, we propose a two-stage deep density-based image clustering (DDC) framework to address these issues. The first stage is to train a deep convolutional autoencoder (CAE) to extract low-dimensional feature representations from high-dimensional image data, and then apply t-SNE to further reduce the data to a 2-dimensional space favoring density-based clustering algorithms. The second stage is to apply the developed density-based clustering technique on the 2-dimensional embedded data to automatically recognize an appropriate number of clusters with arbitrary shapes. Concretely, a number of local clusters are generated to capture the local structures of clusters, and then are merged via their density relationship to form the final clustering result. Experiments demonstrate that the proposed DDC achieves comparable or even better clustering performance than state-of-the-art deep clustering methods, even though the number of clusters is not given.

Machine Learning,Computer Vision and Pattern Recognition
Density Peaks Clustering Based on Jaccard Similarity and Label Propagation

Xiaowei Qin,Xiaoxia Han,Junwen Chu,Yan Zhang,Xinying Xu,Jun Xie,Gang Xie

DOI: https://doi.org/10.1007/s12559-021-09906-w

IF: 4.89

2021-11-01

Cognitive Computation

Abstract:Cognitive computing involves discovering hidden rules and patterns in massive volumes of data. Density peaks clustering (DPC) is a powerful data mining tool that can identify density peaks in decision graphs and assign labels to them without requiring iterations. It can efficiently and simply detect clusters of arbitrary shapes. However, on the one hand, density measurement using the ϵ neighbor or Gaussian kernel only reflects the global structure of the data, so that correct density peaks cannot be found, and performance on manifold datasets is weakened. On the other hand, the one-step allocation strategy results in chain reaction. Once a point with high density is misallocated, a series of points will be incorrectly assigned. To solve this problem, this paper proposes the Jaccard coefficient to measure the similarity between points. The proposed density measurement based on Jaccard coefficient is only related to the k points that share the max similarity with the given point, which can reflect the local structure of manifold datasets, and the density peaks can be identified accurately. Aiming at the chain reaction caused by the assignment strategy of DPC, we develop a two-step allocation strategy based on label propagation and the proposed measurement of similarity. The first step is to assign labels to points close to the clustering centers, where these are equal to labeled points in the label propagation algorithm. The second step is to complete the assignment of labels to the remaining points according to labeled data which is the nearest to each unassigned sample. We compared the proposed algorithm with four algorithms on synthetic datasets and real-world datasets. The three metrics among these algorithms show that the proposed algorithm outperforms other algorithms. The results of clustering on synthetic datasets verified the effectiveness of the proposed method for manifold datasets, and three metrics on the UCI datasets and the Olivetti Faces dataset show that it can reveal the patterns and associations of real-world datasets.

computer science, artificial intelligence,neurosciences

[Prolonged electrostimulation of the heart through the coronary sinus. Report of two cases with position of the electrodes confirmed by autopsy (author's transl)].

Achieving data utility-privacy tradeoff in Internet of Medical Things: A machine learning approach

Intelligent medical heterogeneous big data set balanced clustering using deep learning

PPHOPCM Privacy-Preserving High-order Possibilistic C-Means Algorithm for Big Data Clustering with Cloud Computing

Text clustering based on pre-trained models and autoencoders

Multiple fuzzy c-means clustering algorithm in medical diagnosis

DICE: Deep Significance Clustering for Outcome-Aware Stratification

Semi-Supervised Possibilistic c-Means Clustering Algorithm Based on Feature Weights for Imbalanced Data

Regulation of amylase activity in Drosophila melanogaster: Effects of dietary carbohydrate

A possibilistic Fuzzy c-means algorithm based on improved Cuckoo search for data clustering

DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorization

Deep Online Probability Aggregation Clustering

Deep Multi-Kernel Auto-Encoder Network for Clustering Brain Functional Connectivity Data.

Deep Embedded K-Means Clustering

FedMCC: Federated multi-center clustering algorithm to improve privacy healthcare

Using deep clustering to improve fMRI dynamic functional connectivity analysis

Y-net: Biomedical Image Segmentation and Clustering

Possibilistic picture fuzzy product partition C-means clustering incorporating rich local information for medical image segmentation

Deep multi-semantic fuzzy K-means with adaptive weight adjustment

Deep Density-based Image Clustering

Density Peaks Clustering Based on Jaccard Similarity and Label Propagation