Abstract:Crying is an inevitable character trait that occurs throughout the growth of infants, under conditions where the caregiver may have difficulty interpreting the underlying cause of the cry. Crying can be treated as an audio signal that carries a message about the infant's state, such as discomfort, hunger, and sickness. The primary infant caregiver requires traditional ways of understanding these feelings. Failing to understand them correctly can cause severe problems. Several methods attempt to solve this problem; however, proper audio feature representation and classifiers are necessary for better results. This study uses time-, frequency-, and time-frequency-domain feature representations to gain in-depth information from the data. The time-domain features include zero-crossing rate (ZCR) and root mean square (RMS), the frequency-domain feature includes the Mel-spectrogram, and the time-frequency-domain feature includes Mel-frequency cepstral coefficients (MFCCs). Moreover, time-series imaging algorithms are applied to transform 20 MFCC features into images using different algorithms: Gramian angular difference fields, Gramian angular summation fields, Markov transition fields, recurrence plots, and RGB GAF. Then, these features are provided to different machine learning classifiers, such as decision tree, random forest, K nearest neighbors, and bagging. The use of MFCCs, ZCR, and RMS as features achieved high performance, outperforming state of the art (SOTA). Optimal parameters are found via the grid search method using 10-fold cross-validation. Our MFCC-based random forest (RF) classifier approach achieved an accuracy of 96.39%, outperforming SOTA, the scalogram-based shuffleNet classifier, which had an accuracy of 95.17%.

A Novel Approach for Infant Cry Classification Using Transformer Models

Classification of Infant Crying Sounds Using SE-ResNet-Transformer

Classification of Infant Cry Based on Hybrid Audio Features and ResLSTM

InfantCryNet: A Data-driven Framework for Intelligent Analysis of Infant Cries

Convolutional Neural Networks for Audio-Based Continuous Infant Cry Monitoring at Home

Inherent Emotional Feature Extraction of Neonatal Cry

Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

Using Transfer Learning, SVM, and Ensemble Classification to Classify Baby Cries Based on Their Spectrogram Images.

A review of infant cry analysis and classification

Machine learning-based infant crying interpretation

Baby Cry Recognition by BCRNet Using Transfer Learning and Deep Feature Fusion

Infant Cry Classification with Graph Convolutional Networks

Infant Crying Detection in Real-World Environments

Multi-modal analysis of infant cry types characterization: Acoustics, body language and brain signals

Infant Vocal Tract Development Analysis and Diagnosis by Cry Signals with CNN Age Classification

An Investigation into Audio Features and DTW Algorithms for Infant Cry Classification

A Transformer Model for Segmentation, Classification, and Caller Identification of Marmoset Vocalization

A novel deep learning model based on transformer and cross modality attention for classification of sleep stages

Multi-task Learning for Audio-based Infant Cry Detection and Reasoning

Towards Interpretable Sleep Stage Classification Using Cross-Modal Transformers

InfantNet: A Deep Neural Network for Analyzing Infant Vocalizations