Abstract:Since pig vocalization is an important indicator of monitoring pig conditions, pig vocalization detection and recognition using deep learning play a crucial role in the management and welfare of modern pig livestock farming. However, collecting pig sound data for deep learning model training takes time and effort. Acknowledging the challenges of collecting pig sound data for model training, this study introduces a deep convolutional neural network (DCNN) architecture for pig vocalization and non-vocalization classification with a real pig farm dataset. Various audio feature extraction methods were evaluated individually to compare the performance differences, including Mel-frequency cepstral coefficients (MFCC), Mel-spectrogram, Chroma, and Tonnetz. This study proposes a novel feature extraction method called Mixed-MMCT to improve the classification accuracy by integrating MFCC, Mel-spectrogram, Chroma, and Tonnetz features. These feature extraction methods were applied to extract relevant features from the pig sound dataset for input into a deep learning network. For the experiment, three datasets were collected from three actual pig farms: Nias, Gimje, and Jeongeup. Each dataset consists of 4000 WAV files (2000 pig vocalization and 2000 pig non-vocalization) with a duration of three seconds. Various audio data augmentation techniques are utilized in the training set to improve the model performance and generalization, including pitch-shifting, time-shifting, time-stretching, and background-noising. In this study, the performance of the predictive deep learning model was assessed using the k-fold cross-validation (k = 5) technique on each dataset. By conducting rigorous experiments, Mixed-MMCT showed superior accuracy on Nias, Gimje, and Jeongeup, with rates of 99.50%, 99.56%, and 99.67%, respectively. Robustness experiments were performed to prove the effectiveness of the model by using two farm datasets as a training set and a farm as a testing set. The average performance of the Mixed-MMCT in terms of accuracy, precision, recall, and F1-score reached rates of 95.67%, 96.25%, 95.68%, and 95.96%, respectively. All results demonstrate that the proposed Mixed-MMCT feature extraction method outperforms other methods regarding pig vocalization and non-vocalization classification in real pig livestock farming.

Investigation of Acoustic and Visual Features for Pig Cough Classification

Heterogeneous fusion of biometric and deep physiological features for accurate porcine cough recognition

Study on a Pig Vocalization Classification Method Based on Multi-Feature Fusion

Combined spectral and speech features for pig speech recognition

Novel Method for Detecting Coughing Pigs with Audio-Visual Multimodality for Smart Agriculture Monitoring

Sound identification of abnormal pig vocalizations: Enhancing livestock welfare monitoring on smart farms

Cough Detection Using Selected Informative Features from Audio Signals

DCNN for Pig Vocalization and Non-Vocalization Classification: Evaluate Model Robustness with New Data

Research on Pig Sound Recognition Based on Deep Neural Network and Hidden Markov Models

A Novel Approach for Swallow Detection by Fusing Throat Acceleration and PPG Signal.

Assessment of Audio Features for Automatic Cough Detection

Cough Detection from Acoustic signals for patient monitoring system

Croup and pertussis cough sound classification algorithm based on channel attention and multiscale Mel-spectrogram

Cough Detection by Ensembling Multiple Frequency Subband Features.

Investigation of acoustic and visual features for acoustic scene classification

COVID-19 Detection System: A Comparative Analysis of System Performance Based on Acoustic Features of Cough Audio Signals

Domestic pig sound classification based on TransformerCNN

A forced cough sound based pulmonary function assessment method by using machine learning

Cough sound analysis for diagnosing croup in pediatric patients using biologically inspired features

Cough detection using deep neural networks

Cough detection based on high-frequency subbandfeatures