Abstract:Since birds are members of ecosystem which can be assumed as monitors of ecological environment. Bird recognition, especially birdsong recognition, has attracted more and more attention in the field of artificial intelligence. At present, traditional machine learning and deep learning are widely used in birdsong recognition. Deep learning can not only classify and recognize the spectrum features of birdsong, but also be used as a feature extractor. Machine learning is often used to classify and recognize the extracted birdsong handcrafted feature parameters. As the data samples of the classifier, the feature of birdsong directly determines the performance of the classifier. Multi-view features, different methods of feature extraction can obtain more perfect information of birdsong. Therefore, aiming at enriching the representational capacity of single feature and getting a better way to combine features, this paper proposes a birdsong classification model based multi-view features, which combines the deep features extracted by convolutional neural network (CNN) and handcrafted features. Firstly, four kinds of handcrafted features are extracted. Those are wavelet transform (WT) spectrum, Hilbert-Huang transform (HHT) spectrum, short-time Fourier transform (STFT) spectrum and Mel-frequency cepstral coefficients (MFCC). Then CNN is used to extract the deep features from WT, HHT and STFT spectrum features, and the minimal-redundancy-maximal-relevance (mRMR) to select optimal features. Finally, three classification models (random forest, support vector machine and multi-layer perceptron) are built with the deep features and handcrafted features, and the probability of classification results of the two types of features are fused as the new features to recognize birdsong. Taking sixteen species of birds as research objects, the experimental results show that the three classifiers obtain the accuracy of 95.49%, 96.25% and 96.16% respectively for the features of the proposed method, and which are better than the seven single features and three fused features involved in the experiment. This proposed method effectively combines the deep features and handcrafted features from the perspectives of signal. The fused features can more comprehensively express the information of the bird audio itself, and have higher classification accuracy and lower dimension, which can effectively improve the performance of bird audio classification.

Study on a Pig Vocalization Classification Method Based on Multi-Feature Fusion

Combined spectral and speech features for pig speech recognition

Domestic pig sound classification based on TransformerCNN

Sound identification of abnormal pig vocalizations: Enhancing livestock welfare monitoring on smart farms

DCNN for Pig Vocalization and Non-Vocalization Classification: Evaluate Model Robustness with New Data

Research on Pig Sound Recognition Based on Deep Neural Network and Hidden Markov Models

Heterogeneous fusion of biometric and deep physiological features for accurate porcine cough recognition

A classification method of marine mammal calls based on two-channel fusion network

Analyzing and Classifying Fish Vocalization in the East China Sea Coastal Area

Classification of pig calls produced from birth to slaughter according to their emotional valence and context of production

Detection of Pig Movement and Aggression Using Deep Learning Approaches

An Integrated Gather-and-Distribute Mechanism and Attention-Enhanced Deformable Convolution Model for Pig Behavior Recognition

Automatic Recognition and Quantification Feeding Behaviors of Nursery Pigs Using Improved YOLOV5 and Feeding Functional Area Proposals

Efficient Aggressive Behavior Recognition of Pigs Based on Temporal Shift Module

Multi Modal Information Fusion of Acoustic and Linguistic Data for Decoding Dairy Cow Vocalizations in Animal Welfare Assessment

Pig-ear detection from the thermal infrared image based on improved YOLOv8n

Advanced Framework for Animal Sound Classification With Features Optimization

Novel Method for Detecting Coughing Pigs with Audio-Visual Multimodality for Smart Agriculture Monitoring

Birdsong classification based on multi-feature fusion

A Spatiotemporal Convolutional Network for Multi-Behavior Recognition of Pigs

Multi-view features fusion for birdsong classification