Abstract:The majority of Digital Audio Tampering Detection (DATD) methods, which are based on Electrical Network Frequency (ENF), predominantly concentrate on the static spatial information of ENF. Unfortunately, this focus neglects the temporal variation present in the ENF time series. This limitation significantly hampers the ENF feature representation capability, consequently diminishing the overall accuracy of tampering detection. To address this gap, our paper introduces an innovative digital audio tampering detection method founded on ENF spatio-temporal feature representation learning. To enhance the feature representation capability and subsequently improve tampering detection accuracy, we propose the construction of a parallel spatio-temporal network model. This model incorporates both Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) network architectures. Through this hybrid model, we aim to deeply extract both ENF spatial and temporal feature information. In the process of extracting spatial and temporal features of ENF, we utilize high-precision Discrete Fourier Transform (DFT) analysis on digital audio. This analysis allows us to extract ENF phase sequences, which are then adaptively divided into frames through frame shifting. The result is feature matrices of uniform size, effectively representing the spatial features of ENF. Concurrently, phase sequences are segmented into frames based on ENF time changes to capture the temporal features of ENF. Subsequently, deep spatial and temporal features are extracted using CNN and BiLSTM, respectively. To further enhance the representation capability of the spatio-temporal features, we introduce an attention mechanism. This mechanism dynamically assigns weights to the deep spatial and temporal features, providing a nuanced and refined representation. Finally, a deep neural network is employed to discern whether the audio has undergone tampering. Our experimental results validate the effectiveness of our approach, showcasing superior performance compared to six state-of-the-art methods across three public databases for digital audio tampering detection. This comprehensive methodology, focusing on both spatial and temporal aspects of ENF, establishes a robust foundation for advancing the field of DATD and contributes significantly to improving detection accuracy.

Leveraging Electric Network Frequency Estimation for Audio Authentication

Electric Network Frequency Estimation Based on Linear Canonical Transform for Audio Signal Authentication

Detection of Audio Tampering Based on Electric Network Frequency Signal

ENFformer: Long-short term representation of electric network frequency for digital audio tampering detection

Geographic Location Estimation from ENF Signals with High Accuracy

1D-CNN-based audio tampering detection using ENF signals

Mmear: Push the Limit of COTS Mmwave Eavesdropping on Headphones

Digital Audio Tampering Detection Based on ENF Spatio-temporal Features Representation Learning

Digital audio tampering detection based on spatio-temporal representation learning of electrical network frequency

Electric Network Frequency Optical Sensing Devices

An Enhanced STFT Segmentation Framework for ENF-Based Media Forensics

Shallow and deep feature fusion for digital audio tampering detection

Deletion and insertion tampering detection for speech authentication based on fluctuating super vector of electrical network frequency

"Seeing'' Electric Network Frequency from Events

An Approach to Identifying Recording Locations Based on BP Neural Networks

Detecting Malicious False Frame Injection Attacks on Surveillance Systems at the Edge Using Electrical Network Frequency Signals

MusicECAN: An Automatic Denoising Network for Music Recordings With Efficient Channel Attention

The efficiency assessment of using hybrid neural networks for the detection of forged audio data in socially oriented systems

Music Augmentation and Denoising For Peak-Based Audio Fingerprinting

EnCodecMAE: Leveraging neural codecs for universal audio representation learning

Speaker Distance Estimation in Enclosures from Single-Channel Audio