Abstract:Machine learning is a powerful tool to improve efficiency of industrial processes, but it has not yet been well utilized in aquacultural and hatchery applications. The goal of the present study was to evaluate the feasibility of using a broad array of machine learning approaches (testing of > 200 vectorization and model combinations, reporting on 20) to classify ultrasound images spanning annual ovarian development (i.e., from undeveloped to mature) of channel catfish (Ictalurus punctatus). The specific objectives were to: 1) establish dataset preprocessing to standardize image features; 2) develop and train image classification models with deep learning methods; 3) develop and train models with traditional machine learning methods; 4) compare performance of deep learning and traditional methods on two classification problems (2-class and 5-class), and 5) propose insights to deploy models in practical aquaculture applications for research and hatchery use. A total of 931 ultrasound images of catfish ovaries were used to train and evaluate models for a 2-class problem (as a 'yes' or 'no' answer) to support hormone-injection decisions for spawning management in hatcheries, and a 5-class problem for classifying gonadal development stages for research. By using feature extraction, cropping, dimension reduction, and histogram normalization, a preprocessing method was created to standardize images to develop traditional (i.e., vector input), and deep learning convolutional neural network (CNN) (i.e., image input) approaches. Traditional machine learning models with image classification achieved 100% median accuracy on the 2-class problem (with the models RN-50 and RN-152), and 96% median accuracy for the 5-class problem (with VGG-19 image vectorization). The deep learning approach for the 2-class problem had a median accuracy of > 98% for 15models. The 5-class deep learning models produced a steady increase in median accuracy with training net size, achievable through expansion of the dataset. These models can be developed further, but traditional models (using CNN architectures to simply calculate image vectors) outperformed the deep learning approach. These models can be directly applicable to aquaculture in hatcheries and reproductive biology research, in addition to a wide variety of other image-based applications.

Grading of Mammalian Cumulus Oocyte Complexes using Machine Learning for in Vitro Embryo Culture

Integrating imaging-based classification and transcriptomics for quality assessment of human oocytes according to their reproductive efficiency

A Real-Time Oocyte Polar Body Detection Method

Segmentation of mature human oocytes provides interpretable and improved blastocyst outcome predictions by a machine learning model

Automatic evaluation of human oocyte developmental potential from microscopy images

Identification of Significant Imaging Features for Sensing Oocyte Viability.

OoCount: A machine-learning based approach to mouse ovarian follicle counting and classification

Human Blastocyst Classification after In Vitro Fertilization Using Deep Learning

Automated Measurements of Key Morphological Features of Human Embryos for IVF

Evaluation of deep convolutional neural networks in classifying human embryo images based on their morphological quality

Application of imaging and spectroscopy techniques for grading of bovine embryos - a review

A clinical consensus-compliant deep learning approach to quantitatively evaluate human in vitro fertilization early embryonic development with optical microscope images

Deep learning classification method for boar sperm morphology analysis

Classification Based on LBP and SVM for Human Embryo Microscope Images.

An artificial intelligence tool predicts blastocyst development from static images of fresh mature oocytes

A practical evaluation of machine learning for classification of ultrasound images of ovarian development in channel catfish (Ictalurus punctatus)

Automated Morphological Grading of Human Blastocysts From Multi-Focus Images

Deep learning mediated single time-point image-based prediction of embryo developmental outcome at the cleavage stage

Ex ovo omnia-why don't we know more about egg quality via imaging?

Stereologic Characterization of Bovine (Bos taurus) Cumulus-Oocyte Complexes Aspirated from Small Antral Follicles During the Diestrous Phase1

Evaluation of oocyte maturity using artificial intelligence quantification of follicle volume biomarker by three-dimensional ultrasound