Tissue-specific expression of two mRNA species transcribed from a single vimentin gene

Y. Capetanaki,J. Ngai,C. Flytzanis,E. Lazarides

DOI: https://doi.org/10.1016/0092-8674(83)90174-5

IF: 64.5

1983-12-01

Cell

Abstract:

What problem does this paper attempt to address?

DeepHealth: Deep Representation Learning with Autoencoders for Healthcare Prediction

Wen Xu,Jing He,Yanfeng Shu

DOI: https://doi.org/10.1109/SSCI47803.2020.9308129

2020-01-01

Abstract:General practitioners/doctors usually make disease diagnoses based on some predefined rules, which may lead to omitting some important hidden factors. Deep neural networks are well known for their ability to extract features from large amounts of labeled data, which can be used to learn and discover knowledge from electronic medical records (EMRs). Existing methods have mostly focused on treating deep networks as black-box feature extractors based on the information of labels. However, it is labor-intensive and expensive to manually generate ground-truth labels for EMRs. In this paper, we propose DeepHealth, a general semi-supervised learning framework for automatic diagnoses and feature interpretation based on autoencoders. Specifically, our end-to-end DeeptleaIth framework is constructed of two parts: a supervised classifier network for extracting high-level representation for classification; an unsupervised autoencoder network to make sure the features extracted from the input are meaningful and can be further used for reconstruction. Compared with existing methods, the experimental results show that our method, on both numerical data and medical images, can achieve the state-of-the-art results for EMRs classification. Hence, DeepHealth is a general flexible framework for high-precision diagnoses in healthcare, it can utilize both labeled and unlabeled data to address the problem of insufficient labels in EMRs, meanwhile, it can also reconstruct medical images to help interpret the features learned by a deep neural model.
A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

Chengkai Wu,Tianshu Zhou,Yu Tian,Junya Wu,Jingsong Li,Zhong Liu

DOI: https://doi.org/10.1016/j.artmed.2022.102262

IF: 7.011

2022-01-01

Artificial Intelligence in Medicine

Abstract:Noncommunicable diseases (NCDs) have become the leading cause of death worldwide. NCDs' chronicity, hiddenness, and irreversibility make patients' disease self-awareness extremely important in disease control but hard to achieve. With an accumulation of electronic health record (EHR) data, it has become possible to predict NCDs early through machine learning approaches. However, EHR data from latent NCD patients are often irregularly sampled temporally, and the data sequences are short and imbalanced, which prevents researchers from fully and effectively using such data. Here, we outline the characteristics of typical short sequential data for NCD early prediction and emphasize the importance of using such data in machine learning schemes. We then propose a novel NCD early prediction method: the short sequential medical data-based early prediction method (SSEPM). The SSEPM network contains two stacked subnetworks for multilabel enhancement. In each subnetwork, long short-term memory (LSTM) and attention layers are implemented to extract both temporal and nontemporal embedded features. During training, with prior clinical knowledge of the NCD characteristics, a random connection (RC) process is proposed for data augmentation. Comparative experiments involving ten-fold cross-validation are performed with real-world medical data to predict 5 NCDs. The result shows that the SSEPM outperforms the state-of-the-art NCD early prediction algorithms and works well in dealing with short sequential data. The results also suggest that the direct use of short sequential data could be more effective than formatting datasets with temporal exclusion limitations.
An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data

Ryan King,Shivesh Kodali,Conrad Krueger,Tianbao Yang,Bobak J. Mortazavi

2024-10-12

Abstract:Machine learning has revolutionized the modeling of clinical timeseries data. Using machine learning, a Deep Neural Network (DNN) can be automatically trained to learn a complex mapping of its input features for a desired task. This is particularly valuable in Electronic Health Record (EHR) databases, where patients often spend extended periods in intensive care units (ICUs). Machine learning serves as an efficient method for extract meaningful information. However, many state-of-the-art (SOTA) methods for training DNNs demand substantial volumes of labeled data, posing significant challenges for clinics in terms of cost and time. Self-supervised learning offers an alternative by allowing practitioners to extract valuable insights from data without the need for costly labels. Yet, current SOTA methods often necessitate large data batches to achieve optimal performance, increasing computational demands. This presents a challenge when working with long clinical timeseries data. To address this, we propose an efficient method of contrastive pretraining tailored for long clinical timeseries data. Our approach utilizes an estimator for negative pair comparison, enabling effective feature extraction. We assess the efficacy of our pretraining using standard self-supervised tasks such as linear evaluation and semi-supervised learning. Additionally, our model demonstrates the ability to impute missing measurements, providing clinicians with deeper insights into patient conditions. We demonstrate that our pretraining is capable of achieving better performance as both the size of the model and the size of the measurement vocabulary scale. Finally, we externally validate our model, trained on the MIMIC-III dataset, using the eICU dataset. We demonstrate that our model is capable of learning robust clinical information that is transferable to other clinics.

Machine Learning
CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

Hui Chen,Guijin Wang,Guodong Zhang,Ping Zhang,Huazhong Yang

DOI: https://doi.org/10.1109/lsp.2021.3114119

2021-01-01

IEEE Signal Processing Letters

Abstract:Deep learning-based intelligent electrocardiogram (ECG) diagnosis algorithms heavily rely on large annotated datasets. Unfortunately, in the context of ECG diagnosis, privacy issues and the high cost of data annotations lead to a shortage of ECG datasets which severely limits the performance of the state-of-the-art ECG diagnosis algorithms. In this paper, we propose a novel instance-level contrastive learning scheme for ECG signals, namely CLECG, to mine effective information from unlabeled data. During the pre-training, CLECG encourages the representations of different augmented views of the same signal (positive samples) to be similar and increases the distance between representations of augmented views from the different signals (negative samples). The whole pre-training process does not require any form of labeling. Experimental results show that the proposed CLECG strategy outperforms other self-supervised methods and supervised transfer learning strategies.
MPLite: Multi-Aspect Pretraining for Mining Clinical Health Records

Eric Yang,Pengfei Hu,Xiaoxue Han,Yue Ning

2024-11-18

Abstract:The adoption of digital systems in healthcare has resulted in the accumulation of vast electronic health records (EHRs), offering valuable data for machine learning methods to predict patient health outcomes. However, single-visit records of patients are often neglected in the training process due to the lack of annotations of next-visit information, thereby limiting the predictive and expressive power of machine learning models. In this paper, we present a novel framework MPLite that utilizes Multi-aspect Pretraining with Lab results through a light-weight neural network to enhance medical concept representation and predict future health outcomes of individuals. By incorporating both structured medical data and additional information from lab results, our approach fully leverages patient admission records. We design a pretraining module that predicts medical codes based on lab results, ensuring robust prediction by fusing multiple aspects of features. Our experimental evaluation using both MIMIC-III and MIMIC-IV datasets demonstrates improvements over existing models in diagnosis prediction and heart failure prediction tasks, achieving a higher weighted-F1 and recall with MPLite. This work reveals the potential of integrating diverse aspects of data to advance predictive modeling in healthcare.

Machine Learning,Artificial Intelligence
Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performance

Kuba Weimann,Tim O. F. Conrad

2024-10-02

Abstract:Accurate diagnosis of heart arrhythmias requires the interpretation of electrocardiograms (ECG), which capture the electrical activity of the heart. Automating this process through machine learning is challenging due to the need for large annotated datasets, which are difficult and costly to collect. To address this issue, transfer learning is often employed, where models are pre-trained on large datasets and fine-tuned for specific ECG classification tasks with limited labeled data. Self-supervised learning has become a widely adopted pre-training method, enabling models to learn meaningful representations from unlabeled datasets. In this work, we explore the joint-embedding predictive architecture (JEPA) for self-supervised learning from ECG data. Unlike invariance-based methods, JEPA does not rely on hand-crafted data augmentations, and unlike generative methods, it predicts latent features rather than reconstructing input data. We create a large unsupervised pre-training dataset by combining ten public ECG databases, amounting to over one million records. We pre-train Vision Transformers using JEPA on this dataset and fine-tune them on various PTB-XL benchmarks. Our results show that JEPA outperforms existing invariance-based and generative approaches, achieving an AUC of 0.945 on the PTB-XL all statements task. JEPA consistently learns the highest quality representations, as demonstrated in linear evaluations, and proves advantageous for pre-training even in the absence of additional data.

Signal Processing,Machine Learning
Supervised Pretraining through Contrastive Categorical Positive Samplings to Improve COVID-19 Mortality Prediction

Tingyi Wanyan,Mingquan Lin,Eyal Klang,Kartikeya M Menon,Faris F Gulamali,Ariful Azad,Yiye Zhang,Ying Ding,Zhangyang Wang,Fei Wang,Benjamin Glicksberg,Yifan Peng

DOI: https://doi.org/10.1145/3535508.3545541

Abstract:Clinical EHR data is naturally heterogeneous, where it contains abundant sub-phenotype. Such diversity creates challenges for outcome prediction using a machine learning model since it leads to high intra-class variance. To address this issue, we propose a supervised pre-training model with a unique embedded k-nearest-neighbor positive sampling strategy. We demonstrate the enhanced performance value of this framework theoretically and show that it yields highly competitive experimental results in predicting patient mortality in real-world COVID-19 EHR data with a total of over 7,000 patients admitted to a large, urban health system. Our method achieves a better AUROC prediction score of 0.872, which outperforms the alternative pre-training models and traditional machine learning methods. Additionally, our method performs much better when the training data size is small (345 training instances).
Applying contrastive pre-training for depression and anxiety risk prediction in type 2 diabetes patients based on heterogeneous electronic health records: a primary healthcare case study

Wei Feng,Honghan Wu,Hui Ma,Zhenhuan Tao,Mengdie Xu,Xin Zhang,Shan Lu,Cheng Wan,Yun Liu

DOI: https://doi.org/10.1093/jamia/ocad228

2023-12-07

Journal of the American Medical Informatics Association

Abstract:Abstract Objective Due to heterogeneity and limited medical data in primary healthcare services (PHS), assessing the psychological risk of type 2 diabetes mellitus (T2DM) patients in PHS is difficult. Using unsupervised contrastive pre-training, we proposed a deep learning framework named depression and anxiety prediction (DAP) to predict depression and anxiety in T2DM patients. Materials and Methods The DAP model consists of two sub-models. Firstly, the pre-trained model of DAP used unlabeled discharge records of 85 085 T2DM patients from the First Affiliated Hospital of Nanjing Medical University for unsupervised contrastive learning on heterogeneous electronic health records (EHRs). Secondly, the fine-tuned model of DAP used case–control cohorts (17 491 patients) selected from 149 596 T2DM patients’ EHRs in the Nanjing Health Information Platform (NHIP). The DAP model was validated in 1028 patients from PHS in NHIP. Evaluation included receiver operating characteristic area under the curve (ROC-AUC) and precision-recall area under the curve (PR-AUC), and decision curve analysis (DCA). Results The pre-training step allowed the DAP model to converge at a faster rate. The fine-tuned DAP model significantly outperformed the baseline models (logistic regression, extreme gradient boosting, and random forest) with ROC-AUC of 0.91±0.028 and PR-AUC of 0.80±0.067 in 10-fold internal validation, and with ROC-AUC of 0.75 ± 0.045 and PR-AUC of 0.47 ± 0.081 in external validation. The DCA indicate the clinical potential of the DAP model. Conclusion The DAP model effectively predicted post-discharge depression and anxiety in T2DM patients from PHS, reducing data fragmentation and limitations. This study highlights the DAP model’s potential for early detection and intervention in depression and anxiety, improving outcomes for diabetes patients.

information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics
Representation Learning with Autoencoders for Electronic Health Records: A Comparative Study

Najibesadat Sadati,Milad Zafar Nezhad,Ratna Babu Chinnam,Dongxiao Zhu

DOI: https://doi.org/10.48550/arXiv.1801.02961

2019-09-29

Abstract:Increasing volume of Electronic Health Records (EHR) in recent years provides great opportunities for data scientists to collaborate on different aspects of healthcare research by applying advanced analytics to these EHR clinical data. A key requirement however is obtaining meaningful insights from high dimensional, sparse and complex clinical data. Data science approaches typically address this challenge by performing feature learning in order to build more reliable and informative feature representations from clinical data followed by supervised learning. In this paper, we propose a predictive modeling approach based on deep learning based feature representations and word embedding techniques. Our method uses different deep architectures (stacked sparse autoencoders, deep belief network, adversarial autoencoders and variational autoencoders) for feature representation in higher-level abstraction to obtain effective and robust features from EHRs, and then build prediction models on top of them. Our approach is particularly useful when the unlabeled data is abundant whereas labeled data is scarce. We investigate the performance of representation learning through a supervised learning approach. Our focus is to present a comparative study to evaluate the performance of different deep architectures through supervised learning and provide insights in the choice of deep feature representation techniques. Our experiments demonstrate that for small data sets, stacked sparse autoencoder demonstrates a superior generality performance in prediction due to sparsity regularization whereas variational autoencoders outperform the competing approaches for large data sets due to its capability of learning the representation distribution.

Machine Learning
rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement

Xin Liu,Yuting Zhang,Zitong Yu,Hao Lu,Huanjing Yue,Jingyu Yang

2023-06-04

Abstract:Remote photoplethysmography (rPPG) is an important technique for perceiving human vital signs, which has received extensive attention. For a long time, researchers have focused on supervised methods that rely on large amounts of labeled data. These methods are limited by the requirement for large amounts of data and the difficulty of acquiring ground truth physiological signals. To address these issues, several self-supervised methods based on contrastive learning have been proposed. However, they focus on the contrastive learning between samples, which neglect the inherent self-similar prior in physiological signals and seem to have a limited ability to cope with noisy. In this paper, a linear self-supervised reconstruction task was designed for extracting the inherent self-similar prior in physiological signals. Besides, a specific noise-insensitive strategy was explored for reducing the interference of motion and illumination. The proposed framework in this paper, namely rPPG-MAE, demonstrates excellent performance even on the challenging VIPL-HR dataset. We also evaluate the proposed method on two public datasets, namely PURE and UBFC-rPPG. The results show that our method not only outperforms existing self-supervised methods but also exceeds the state-of-the-art (SOTA) supervised methods. One important observation is that the quality of the dataset seems more important than the size in self-supervised pre-training of rPPG. The source code is released at <a class="link-external link-https" href="https://github.com/linuxsino/rPPG-MAE" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
PECon: Contrastive Pretraining to Enhance Feature Alignment between CT and EHR Data for Improved Pulmonary Embolism Diagnosis

Santosh Sanjeev,Salwa K. Al Khatib,Mai A. Shaaban,Ibrahim Almakky,Vijay Ram Papineni,Mohammad Yaqub

2023-08-27

Abstract:Previous deep learning efforts have focused on improving the performance of Pulmonary Embolism(PE) diagnosis from Computed Tomography (CT) scans using Convolutional Neural Networks (CNN). However, the features from CT scans alone are not always sufficient for the diagnosis of PE. CT scans along with electronic heath records (EHR) can provide a better insight into the patients condition and can lead to more accurate PE diagnosis. In this paper, we propose Pulmonary Embolism Detection using Contrastive Learning (PECon), a supervised contrastive pretraining strategy that employs both the patients CT scans as well as the EHR data, aiming to enhance the alignment of feature representations between the two modalities and leverage information to improve the PE diagnosis. In order to achieve this, we make use of the class labels and pull the sample features of the same class together, while pushing away those of the other class. Results show that the proposed work outperforms the existing techniques and achieves state-of-the-art performance on the RadFusion dataset with an F1-score of 0.913, accuracy of 0.90 and an AUROC of 0.943. Furthermore, we also explore the explainability of our approach in comparison to other methods. Our code is publicly available at <a class="link-external link-https" href="https://github.com/BioMedIA-MBZUAI/PECon" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence
Contrastive Learning-based Imputation-Prediction Networks for In-hospital Mortality Risk Modeling using EHRs

Yuxi Liu,Zhenhao Zhang,Shaowen Qin,Flora D. Salim,Antonio Jimeno Yepes

2023-08-19

Abstract:Predicting the risk of in-hospital mortality from electronic health records (EHRs) has received considerable attention. Such predictions will provide early warning of a patient's health condition to healthcare professionals so that timely interventions can be taken. This prediction task is challenging since EHR data are intrinsically irregular, with not only many missing values but also varying time intervals between medical records. Existing approaches focus on exploiting the variable correlations in patient medical records to impute missing values and establishing time-decay mechanisms to deal with such irregularity. This paper presents a novel contrastive learning-based imputation-prediction network for predicting in-hospital mortality risks using EHR data. Our approach introduces graph analysis-based patient stratification modeling in the imputation process to group similar patients. This allows information of similar patients only to be used, in addition to personal contextual information, for missing value imputation. Moreover, our approach can integrate contrastive learning into the proposed network architecture to enhance patient representation learning and predictive performance on the classification task. Experiments on two real-world EHR datasets show that our approach outperforms the state-of-the-art approaches in both imputation and prediction tasks.

Machine Learning
Chondrocyte apoptosis is not essential for cartilage calcification: Evidence from an in vitro avian model

Eric Pourmand,I. Binderman,S. Doty,V. Kudryashov,A. Boskey

DOI: https://doi.org/10.1002/jcb.20977

Journal of Cellular Biochemistry

Abstract:The calcification of cartilage is an essential step in the process of normal bone growth through endochondral ossification. Chondrocyte apoptosis is generally observed prior to the transition of calcified cartilage to bone. There are, however, contradictory reports in the literature as to whether chondrocyte apoptosis is a precursor to cartilage calcification, a co‐event, or occurs after calcification. The purpose of this study was to test the hypothesis that chondrocyte apoptosis is not a requirement for initial calcification using a cell culture system that mimics endochondral ossification. Mesenchymal stem cells harvested from Stages 21–23 chick limb buds were plated as micro‐mass cultures in the presence of 4 mM inorganic phosphate (mineralizing conditions). The cultures were treated with either an apoptosis inhibitor or stimulator and compared to un‐treated controls before the start of calcification on day 7. Inhibition of apoptosis with the caspase inhibitor Z‐Val‐Ala‐Asp (O‐Me)‐fluoromethylketone (Z‐VAD‐fmk) caused no decreases in calcification as indicated by radioactive calcium uptake or Fourier transform infrared (FT‐IR) analysis of mineral properties. When apoptosis was inhibited, the cultures showed more robust histological features (including more intense staining for proteoglycans, and more intact cells within the nodules as well as along the periphery of the cells as compared to untreated controls), more proliferation as noted by bromo‐deoxyuridine (BrdU) labeling, decreases in terminal deoxynucleotidyl transferase (Tdt)‐mediated dUTP nick‐end labeling (TUNEL) staining, and fewer apoptotic bodies in electron microscopy. Stimulation of apoptosis with 40–120 nM staurosporine prior to the onset of calcification resulted in inhibition of calcium accretion, with the extent of total calcium uptake significantly decreased, the amount of matrix deposition impaired, and the formation of abnormal mineral crystals. These results indicate that chondrocyte apoptosis is not a pre‐requisite for calcification in this culture system. J. Cell. Biochem. 100: 43–57, 2007. © 2006 Wiley‐Liss, Inc.
Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Guoxin Wang,Qingyuan Wang,Ganesh Neelakanta Iyer,Avishek Nag,Deepu John

2023-10-17

Abstract:Unsupervised learning methods have become increasingly important in deep learning due to their demonstrated large utilization of datasets and higher accuracy in computer vision and natural language processing tasks. There is a growing trend to extend unsupervised learning methods to other domains, which helps to utilize a large amount of unlabelled data. This paper proposes an unsupervised pre-training technique based on masked autoencoder (MAE) for electrocardiogram (ECG) signals. In addition, we propose a task-specific fine-tuning to form a complete framework for ECG analysis. The framework is high-level, universal, and not individually adapted to specific model architectures or tasks. Experiments are conducted using various model architectures and large-scale datasets, resulting in an accuracy of 94.39% on the MITDB dataset for ECG arrhythmia classification task. The result shows a better performance for the classification of previously unseen data for the proposed approach compared to fully supervised methods.

Computer Vision and Pattern Recognition,Signal Processing
Biometric Contrastive Learning for Data-Efficient Deep Learning from Electrocardiographic Images

Veer Sangha,Akshay Khunte,Gregory Holste,Bobak J Mortazavi,Zhangyang Wang,Evangelos K Oikonomou,Rohan Khera

DOI: https://doi.org/10.1101/2023.09.13.23295494

2023-09-14

MedRxiv

Abstract:Objective: Artificial intelligence (AI) detects heart disease from images of electrocardiograms (ECGs), however traditional supervised learning is limited by the need for large amounts of labeled data. We report the development of Biometric Contrastive Learning (BCL), a self-supervised pretraining approach for label-efficient deep learning on ECG images. Materials and methods: Using pairs of ECGs from 78,288 individuals from Yale (2000-2015), we trained a convolutional neural network to identify temporally-separated ECG pairs that varied in layouts from the same patient. We fine-tuned BCL-pretrained models to detect atrial fibrillation (AF), gender, and LVEF<40%, using ECGs from 2015-2021. We externally tested the models in cohorts from Germany and the US. We compared BCL with random initialization and general-purpose self-supervised contrastive learning for images (simCLR). Results: While with 100% labeled training data, BCL performed similarly to other approaches for detecting AF/Gender/LVEF<40% with AUROC of 0.98/0.90/0.90 in the held-out test sets, it consistently outperformed other methods with smaller proportions of labeled data, reaching equivalent performance at 50% of data. With 0.1% data, BCL achieved AUROC of 0.88/0.79/0.75, compared with 0.51/0.52/0.60 (random) and 0.61/0.53/0.49 (simCLR). In external validation, BCL outperformed other methods even at 100% labeled training data, with AUROC of 0.88/0.88 for Gender and LVEF<40% compared with 0.83/0.83 (random) and 0.84/0.83 (simCLR). Discussion and conclusion: A pretraining strategy that leverages biometric signatures of different ECGs from the same patient enhances the efficiency of developing AI models for ECG images. This represents a major advance in detecting disorders from ECG images with limited labeled data.
Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision

Yingbo Ma,Suraj Kolla,Zhenhong Hu,Dhruv Kaliraman,Victoria Nolan,Ziyuan Guan,Yuanfang Ren,Brooke Armfield,Tezcan Ozrazgat-Baslanti,Jeremy A. Balch,Tyler J. Loftus,Parisa Rashidi,Azra Bihorac,Benjamin Shickel

2024-04-10

Abstract:Modern electronic health records (EHRs) hold immense promise in tracking personalized patient health trajectories through sequential deep learning, owing to their extensive breadth, scale, and temporal granularity. Nonetheless, how to effectively leverage multiple modalities from EHRs poses significant challenges, given its complex characteristics such as high dimensionality, multimodality, sparsity, varied recording frequencies, and temporal irregularities. To this end, this paper introduces a novel multimodal contrastive learning framework, specifically focusing on medical time series and clinical notes. To tackle the challenge of sparsity and irregular time intervals in medical time series, the framework integrates temporal cross-attention transformers with a dynamic embedding and tokenization scheme for learning multimodal feature representations. To harness the interconnected relationships between medical time series and clinical notes, the framework equips a global contrastive loss, aligning a patient's multimodal feature representations with the corresponding discharge summaries. Since discharge summaries uniquely pertain to individual patients and represent a holistic view of the patient's hospital stay, machine learning models are led to learn discriminative multimodal features via global contrasting. Extensive experiments with a real-world EHR dataset demonstrated that our framework outperformed state-of-the-art approaches on the exemplar task of predicting the occurrence of nine postoperative complications for more than 120,000 major inpatient surgeries using multimodal data from UF health system split among three hospitals (UF Health Gainesville, UF Health Jacksonville, and UF Health Jacksonville-North).

Machine Learning,Computation and Language
SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadata

Ajay Jaiswal,Tianhao Li,Cyprian Zander,Yan Han,Justin F. Rousseau,Yifan Peng,Ying Ding

DOI: https://doi.org/10.48550/arXiv.2110.14787

2021-10-28

Abstract:Computer-aided diagnosis plays a salient role in more accessible and accurate cardiopulmonary diseases classification and localization on chest radiography. Millions of people get affected and die due to these diseases without an accurate and timely diagnosis. Recently proposed contrastive learning heavily relies on data augmentation, especially positive data augmentation. However, generating clinically-accurate data augmentations for medical images is extremely difficult because the common data augmentation methods in computer vision, such as sharp, blur, and crop operations, can severely alter the clinical settings of medical images. In this paper, we proposed a novel and simple data augmentation method based on patient metadata and supervised knowledge to create clinically accurate positive and negative augmentations for chest X-rays. We introduce an end-to-end framework, SCALP, which extends the self-supervised contrastive approach to a supervised setting. Specifically, SCALP pulls together chest X-rays from the same patient (positive keys) and pushes apart chest X-rays from different patients (negative keys). In addition, it uses ResNet-50 along with the triplet-attention mechanism to identify cardiopulmonary diseases, and Grad-CAM++ to highlight the abnormal regions. Our extensive experiments demonstrate that SCALP outperforms existing baselines with significant margins in both classification and localization tasks. Specifically, the average classification AUCs improve from 82.8% (SOTA using DenseNet-121) to 83.9% (SCALP using ResNet-50), while the localization results improve on average by 3.7% over different IoU thresholds.

Image and Video Processing,Computer Vision and Pattern Recognition
A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

Guoxin Wang,Qingyuan Wang,Avishek Nag,Deepu John

DOI: https://doi.org/10.1109/jsen.2024.3404141

IF: 4.3

2024-07-02

IEEE Sensors Journal

Abstract:Electrocardiogram (ECG) feature extraction is an important step in applying machine learning for biomedical processing tasks. In deep learning studies centered on ECG data, established methods mainly rely on labeled data to automatically extract signal features. However, obtaining high-quality labeled records from open-source datasets is challenging, whereas many unlabeled data remain underused. Unsupervised pre-training methods have shown significant efficacy in using unlabeled datasets. Therefore, using unsupervised pre-training paradigms for ECG feature extraction could improve overall performance. This article presents an unsupervised pre-training framework based on a masked autoencoder (MAE) for extracting ECG signal features. An encoder-decoder framework is proposed to recover artificially masked ECGs. During the reconstruction process, the framework learns features from masked samples. Benefiting from the utilization of large-scale datasets, the framework enables learning generalized features and has a high performance for a wide range of deep learning tasks. In particular, the framework achieves an accuracy of 95.6% on the MITDB dataset for the ECG arrhythmia classification task and 98.8% on the ECGIDDB dataset for the human identification task. Evaluation using multiple downstream tasks and comparisons with the state-of-the-art confirm the validity of our proposed approach.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Treatment effect prediction with adversarial deep learning using electronic health records

Jiebin Chu,Wei Dong,Jinliang Wang,Kunlun He,Zhengxing Huang

DOI: https://doi.org/10.1186/s12911-020-01151-9

IF: 3.298

2020-12-01

BMC Medical Informatics and Decision Making

Abstract:Abstract Background Treatment effect prediction (TEP) plays an important role in disease management by ensuring that the expected clinical outcomes are obtained after performing specialized and sophisticated treatments on patients given their personalized clinical status. In recent years, the wide adoption of electronic health records (EHRs) has provided a comprehensive data source for intelligent clinical applications including the TEP investigated in this study. Method We examined the problem of using a large volume of heterogeneous EHR data to predict treatment effects and developed an adversarial deep treatment effect prediction model to address the problem. Our model employed two auto-encoders for learning the representative and discriminative features of both patient characteristics and treatments from EHR data. The discriminative power of the learned features was further enhanced by decoding the correlational information between the patient characteristics and subsequent treatments by means of a generated adversarial learning strategy. Thereafter, a logistic regression layer was appended on the top of the resulting feature representation layer for TEP. Result The proposed model was evaluated on two real clinical datasets collected from the cardiology department of a Chinese hospital. In particular, on acute coronary syndrome (ACS) dataset, the proposed adversarial deep treatment effect prediction (ADTEP) (0.662) exhibited 1.4, 2.2, and 6.3% performance gains in terms of the area under the ROC curve (AUC) over deep treatment effect prediction (DTEP) (0.653), logistic regression (LR) (0.648), and support vector machine (SVM) (0.621), respectively. As for heart failure (HF) case study, the proposed ADTEP also outperformed all benchmarks. The experimental results demonstrated that our proposed model achieved competitive performance compared to state-of-the-art models in tackling the TEP problem. Conclusion In this work, we propose a novel model to address the TEP problem by utilizing a large volume of observational data from EHR. With adversarial learning strategy, our proposed model can further explore the correlational information between patient statuses and treatments to extract more robust and discriminative representation of patient samples from their EHR data. Such representation finally benefits the model on TEP. The experimental results of two case studies demonstrate the superiority of our proposed method compared to state-of-the-art methods.

medical informatics
Automated Multi-Task Learning for Joint Disease Prediction on Electronic Health Records

Suhan Cui,Prasenjit Mitra

2024-10-09

Abstract:In the realm of big data and digital healthcare, Electronic Health Records (EHR) have become a rich source of information with the potential to improve patient care and medical research. In recent years, machine learning models have proliferated for analyzing EHR data to predict patients future health conditions. Among them, some studies advocate for multi-task learning (MTL) to jointly predict multiple target diseases for improving the prediction performance over single task learning. Nevertheless, current MTL frameworks for EHR data have significant limitations due to their heavy reliance on human experts to identify task groups for joint training and design model architectures. To reduce human intervention and improve the framework design, we propose an automated approach named AutoDP, which can search for the optimal configuration of task grouping and architectures simultaneously. To tackle the vast joint search space encompassing task combinations and architectures, we employ surrogate model-based optimization, enabling us to efficiently discover the optimal solution. Experimental results on real-world EHR data demonstrate the efficacy of the proposed AutoDP framework. It achieves significant performance improvements over both hand-crafted and automated state-of-the-art methods, also maintains a feasible search cost at the same time. Source code can be found via the link: \url{<a class="link-external link-https" href="https://github.com/SH-Src/AutoDP" rel="external noopener nofollow">this https URL</a>}.

Machine Learning

Tissue-specific expression of two mRNA species transcribed from a single vimentin gene

DeepHealth: Deep Representation Learning with Autoencoders for Healthcare Prediction

A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data

CLECG: A Novel Contrastive Learning Framework for Electrocardiogram Arrhythmia Classification

MPLite: Multi-Aspect Pretraining for Mining Clinical Health Records

Self-Supervised Pre-Training with Joint-Embedding Predictive Architecture Boosts ECG Classification Performance

Supervised Pretraining through Contrastive Categorical Positive Samplings to Improve COVID-19 Mortality Prediction

Applying contrastive pre-training for depression and anxiety risk prediction in type 2 diabetes patients based on heterogeneous electronic health records: a primary healthcare case study

Representation Learning with Autoencoders for Electronic Health Records: A Comparative Study

rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement

PECon: Contrastive Pretraining to Enhance Feature Alignment between CT and EHR Data for Improved Pulmonary Embolism Diagnosis

Contrastive Learning-based Imputation-Prediction Networks for In-hospital Mortality Risk Modeling using EHRs

Chondrocyte apoptosis is not essential for cartilage calcification: Evidence from an in vitro avian model

Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis

Biometric Contrastive Learning for Data-Efficient Deep Learning from Electrocardiographic Images

Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision

SCALP -- Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadata

A Task-Generic High-Performance Unsupervised Pre-Training Framework for ECG

Treatment effect prediction with adversarial deep learning using electronic health records

Automated Multi-Task Learning for Joint Disease Prediction on Electronic Health Records