Deep embedded clustering generalisability and adaptation for integrating mixed datatypes: two critical care cohorts

Jip W. T. M. de Kok,Frank van Rosmalen,Jacqueline Koeze,Frederik Keus,Sander M. J. van Kuijk,José Castela Forte,Ronny M. Schnabel,Rob G. H. Driessen,Thijs T. W. van Herpt,Jan-Willem E. M. Sels,Dennis C. J. J. Bergmans,Chris P. H. Lexis,William P. T. M. van Doorn,Steven J. R. Meex,Minnan Xu,Xavier Borrat,Rachel Cavill,Iwan C. C. van der Horst,Bas C. T. van Bussel
DOI: https://doi.org/10.1038/s41598-024-51699-z
IF: 4.6
2024-01-11
Scientific Reports
Abstract:We validated a Deep Embedded Clustering (DEC) model and its adaptation for integrating mixed datatypes (in this study, numerical and categorical variables). Deep Embedded Clustering (DEC) is a promising technique capable of managing extensive sets of variables and non-linear relationships. Nevertheless, DEC cannot adequately handle mixed datatypes. Therefore, we adapted DEC by replacing the autoencoder with an X-shaped variational autoencoder (XVAE) and optimising hyperparameters for cluster stability. We call this model "X-DEC". We compared DEC and X-DEC by reproducing a previous study that used DEC to identify clusters in a population of intensive care patients. We assessed internal validity based on cluster stability on the development dataset. Since generalisability of clustering models has insufficiently been validated on external populations, we assessed external validity by investigating cluster generalisability onto an external validation dataset. We concluded that both DEC and X-DEC resulted in clinically recognisable and generalisable clusters, but X-DEC produced much more stable clusters.
multidisciplinary sciences
What problem does this paper attempt to address?