Abstract:Study question: What is the present performance of artificial intelligence (AI) decision support during embryo selection compared to the standard embryo selection by embryologists? Summary answer: AI consistently outperformed the clinical teams in all the studies focused on embryo morphology and clinical outcome prediction during embryo selection assessment. What is known already: The ART success rate is ∼30%, with a worrying trend of increasing female age correlating with considerably worse results. As such, there have been ongoing efforts to address this low success rate through the development of new technologies. With the advent of AI, there is potential for machine learning to be applied in such a manner that areas limited by human subjectivity, such as embryo selection, can be enhanced through increased objectivity. Given the potential of AI to improve IVF success rates, it remains crucial to review the performance between AI and embryologists during embryo selection. Study design size duration: The search was done across PubMed, EMBASE, Ovid Medline, and IEEE Xplore from 1 June 2005 up to and including 7 January 2022. Included articles were also restricted to those written in English. Search terms utilized across all databases for the study were: ('Artificial intelligence' OR 'Machine Learning' OR 'Deep learning' OR 'Neural network') AND ('IVF' OR 'in vitro fertili*' OR 'assisted reproductive techn*' OR 'embryo'), where the character '*' refers the search engine to include any auto completion of the search term. Participants/materials setting methods: A literature search was conducted for literature relating to AI applications to IVF. Primary outcomes of interest were accuracy, sensitivity, and specificity of the embryo morphology grade assessments and the likelihood of clinical outcomes, such as clinical pregnancy after IVF treatments. Risk of bias was assessed using the Modified Down and Black Checklist. Main results and the role of chance: Twenty articles were included in this review. There was no specific embryo assessment day across the studies-Day 1 until Day 5/6 of embryo development was investigated. The types of input for training AI algorithms were images and time-lapse (10/20), clinical information (6/20), and both images and clinical information (4/20). Each AI model demonstrated promise when compared to an embryologist's visual assessment. On average, the models predicted the likelihood of successful clinical pregnancy with greater accuracy than clinical embryologists, signifying greater reliability when compared to human prediction. The AI models performed at a median accuracy of 75.5% (range 59-94%) on predicting embryo morphology grade. The correct prediction (Ground Truth) was defined through the use of embryo images according to post embryologists' assessment following local respective guidelines. Using blind test datasets, the embryologists' accuracy prediction was 65.4% (range 47-75%) with the same ground truth provided by the original local respective assessment. Similarly, AI models had a median accuracy of 77.8% (range 68-90%) in predicting clinical pregnancy through the use of patient clinical treatment information compared to 64% (range 58-76%) when performed by embryologists. When both images/time-lapse and clinical information inputs were combined, the median accuracy by the AI models was higher at 81.5% (range 67-98%), while clinical embryologists had a median accuracy of 51% (range 43-59%). Limitations reasons for caution: The findings of this review are based on studies that have not been prospectively evaluated in a clinical setting. Additionally, a fair comparison of all the studies were deemed unfeasible owing to the heterogeneity of the studies, development of the AI models, database employed and the study design and quality. Wider implications of the findings: AI provides considerable promise to the IVF field and embryo selection. However, there needs to be a shift in developers' perception of the clinical outcome from successful implantation towards ongoing pregnancy or live birth. Additionally, existing models focus on locally generated databases and many lack external validation. Study funding/competing interests: This study was funded by Monash Data Future Institute. All authors have no conflicts of interest to declare. Registration number: CRD42021256333.

Machine learning predicts live-birth occurrence before in-vitro fertilization treatment

Personalized prediction of live birth prior to the first in vitro fertilization treatment: a machine learning method

Live-Birth Prediction of Natural-Cycle In Vitro Fertilization Using 57,558 Linked Cycle Records: A Machine Learning Perspective

Artificial intelligence system for outcome evaluations of human in vitro fertilization-derived embryos

Multifactor Prediction of Embryo Transfer Outcomes Based on a Machine Learning Algorithm

Comparative study of machine learning approaches integrated with genetic algorithm for IVF success prediction

Machine Learning Techniques to Improve the Success Rate in In-Vitro Fertilization (IVF) Procedure

Comparison of machine learning classification techniques to predict implantation success in an IVF treatment cycle

An artificial intelligence algorithm to select most viable embryos considering current process in IVF labs

12355 Prediction of in-Vitro Fertilization Outcome by Ultrasound Strain Analysis and Machine Learning: A Multi-Centre Study

Clinical data-based modeling of IVF live birth outcome and its application

Artificial intelligence model to predict pregnancy and multiple pregnancy risk following in vitro fertilization-embryo transfer (IVF-ET)

The Application of Artificial Intelligence in Predicting Embryo Transfer Outcome of Recurrent Implantation Failure

Predictive models for live birth outcomes of FET: Improving clinical decision-making based on machine learning analysis

Using deep learning to predict the outcome of live birth from more than 10,000 embryo data

Deep learning-based embryo assessment of static images can reduce the time to live birth in in vitro fertilization

Limits of Conventional Machine Learning Methods to Predict Pregnancy and Multiple Pregnancy After Embryo Transfer

Deep learning pipeline reveals key moments in human embryonic development predictive of live birth after in vitro fertilization

Development and Evaluation of a Live Birth Prediction Model for Evaluating Human Blastocysts from a Retrospective Study

Embryo selection through artificial intelligence versus embryologists: a systematic review

Data-Driven Prediction of Embryo Implantation Probability Using IVF Time-lapse Imaging