Abstract:Background:In infertility treatment, blastocyst morphological grading is commonly used in clinical practice for blastocyst evaluation and selection, but has shown limited predictive power on live birth outcomes of blastocysts. To improve live birth prediction, a number of artificial intelligence (AI) models have been established. Most existing AI models for blastocyst evaluation only used images for live birth prediction, and the area under the receiver operating characteristic (ROC) curve (AUC) achieved by these models has plateaued at ~0.65.Methods:This study proposed a multimodal blastocyst evaluation method using both blastocyst images and patient couple’s clinical features (e.g., maternal age, hormone profiles, endometrium thickness, and semen quality) to predict live birth outcomes of human blastocysts. To utilize the multimodal data, we developed a new AI model consisting of a convolutional neural network (CNN) to process blastocyst images and a multilayer perceptron to process patient couple’s clinical features. The data set used in this study consists of 17,580 blastocysts with known live birth outcomes, blastocyst images, and patient couple’s clinical features.Results:This study achieved an AUC of 0.77 for live birth prediction, which significantly outperforms related works in the literature. Sixteen out of 103 clinical features were identified to be predictors of live birth outcomes and helped improve live birth prediction. Among these features, maternal age, the day of blastocyst transfer, antral follicle count, retrieved oocyte number, and endometrium thickness measured before transfer are the top five features contributing to live birth prediction. Heatmaps showed that the CNN in the AI model mainly focuses on image regions of inner cell mass and trophectoderm (TE) for live birth prediction, and the contribution of TE-related features was greater in the CNN trained with the inclusion of patient couple's clinical features compared with the CNN trained with blastocyst images alone.Conclusions:The results suggest that the inclusion of patient couple’s clinical features along with blastocyst images increases live birth prediction accuracy.Funding:Natural Sciences and Engineering Research Council of Canada and the Canada Research Chairs Program.

Automated Morphological Grading of Human Blastocysts From Multi-Focus Images

A Deep Learning Framework Design for Automatic Blastocyst Evaluation with Multifocal Images

Image Segmentation of Zona-Ablated Human Blastocysts

Human Blastocyst Classification after In Vitro Fertilization Using Deep Learning

Detecting Blastocyst Components by Artificial Intelligence for Human Embryological Analysis to Improve Success Rate of In Vitro Fertilization

Prediction of Blastocyst Formation Based on Fusion of Morphokinetic and Morphological Features

Performance of a deep learning based neural network in the selection of human blastocysts for implantation

Multimodal Representation Learning for Blastocyst Assessment.

Evaluation of deep convolutional neural networks in classifying human embryo images based on their morphological quality

Development and Evaluation of a Live Birth Prediction Model for Evaluating Human Blastocysts from a Retrospective Study

3D Morphology Measurement for Blastocyst Evaluation from “All Angles”

A deep learning model for predicting blastocyst formation from cleavage-stage human embryos using time-lapse images

A clinical consensus-compliant deep learning approach to quantitatively evaluate human in vitro fertilization early embryonic development with optical microscope images

Automated Measurements of Key Morphological Features of Human Embryos for IVF

Noninvasive time-lapse 3D subcellular analysis of embryo development for machine learning-enabled prediction of blastocyst formation

Segmentation of mature human oocytes provides interpretable and improved blastocyst outcome predictions by a machine learning model

Automatic Blastomere Recognition from a Single Embryo Image.

Automated and precise recognition of human zygote cytoplasm: A robust image-segmentation system based on a convolutional neural network

Development of deep learning algorithms for predicting blastocyst formation and quality by time-lapse monitoring

An Edge Association Graph Network Conforming to Embryonic Morphology for Automated Grading of Day 3 Human Embryos

deepBlastoid: A Deep Learning-Based High-Throughput Classifier for Human Blastoids Using Brightfield Images with Confidence Assessment