Abstract:The majority of Digital Audio Tampering Detection (DATD) methods, which are based on Electrical Network Frequency (ENF), predominantly concentrate on the static spatial information of ENF. Unfortunately, this focus neglects the temporal variation present in the ENF time series. This limitation significantly hampers the ENF feature representation capability, consequently diminishing the overall accuracy of tampering detection. To address this gap, our paper introduces an innovative digital audio tampering detection method founded on ENF spatio-temporal feature representation learning. To enhance the feature representation capability and subsequently improve tampering detection accuracy, we propose the construction of a parallel spatio-temporal network model. This model incorporates both Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) network architectures. Through this hybrid model, we aim to deeply extract both ENF spatial and temporal feature information. In the process of extracting spatial and temporal features of ENF, we utilize high-precision Discrete Fourier Transform (DFT) analysis on digital audio. This analysis allows us to extract ENF phase sequences, which are then adaptively divided into frames through frame shifting. The result is feature matrices of uniform size, effectively representing the spatial features of ENF. Concurrently, phase sequences are segmented into frames based on ENF time changes to capture the temporal features of ENF. Subsequently, deep spatial and temporal features are extracted using CNN and BiLSTM, respectively. To further enhance the representation capability of the spatio-temporal features, we introduce an attention mechanism. This mechanism dynamically assigns weights to the deep spatial and temporal features, providing a nuanced and refined representation. Finally, a deep neural network is employed to discern whether the audio has undergone tampering. Our experimental results validate the effectiveness of our approach, showcasing superior performance compared to six state-of-the-art methods across three public databases for digital audio tampering detection. This comprehensive methodology, focusing on both spatial and temporal aspects of ENF, establishes a robust foundation for advancing the field of DATD and contributes significantly to improving detection accuracy.

SyncNet: Using Causal Convolutions and Correlating Objective for Time Delay Estimation in Audio Signals

Deep Correlation Analysis for Audio-EEG Decoding

Synchronization of Discrete-Time Neural Networks with Time Delays Subject to Missing Data

A Time-domain Unsupervised Learning Based Sound Source Localization Method

Synchronization of Coupled Neural Networks with Constant Time-Delay Using Sampled-Data Information.

Audio Scanning Network: Bridging Time and Frequency Domains for Audio Classification

Interpretable Convolutional SyncNet

Robust Interaural Time Difference Estimation Based on Convolutional Neural Network

A Deep Learning Model for Correlation Analysis between Electroencephalography Signal and Speech Stimuli

Deep Multimodal Representation Learning from Temporal Data

Audio Impairment Recognition Using a Correlation-Based Feature Representation

Canonical Cortical Graph Neural Networks and its Application for Speech Enhancement in Audio-Visual Hearing Aids

A Deep Learning Approach for Low-Latency Packet Loss Concealment of Audio Signals in Networked Music Performance Applications

Time Difference of Arrival Estimation from Frequency-Sliding Generalized Cross-Correlations Using Convolutional Neural Networks

Audio Time-Scale Modification with Temporal Compressing Networks

Adaptive DCTNet for Audio Signal Classification

Deep Learning Approaches for Robust Time of Arrival Estimation in Acoustic Emission Monitoring

Efficient Sound Field Reconstruction with Conditional Invertible Neural Networks

A research for sound event localization and detection based on local–global adaptive fusion and temporal importance network

Digital audio tampering detection based on spatio-temporal representation learning of electrical network frequency