Abstract:Automatic detection of synthetic speech is becoming increasingly important as current synthesis methods are both near indistinguishable from human speech and widely accessible to the public. Audio watermarking and other active disclosure methods of are attracting research activity, as they can complement traditional deepfake defenses based on passive detection. In both active and passive detection, robustness is of major interest. Traditional audio watermarks are particularly susceptible to removal attacks by audio codec application. Most generated speech and audio content released into the wild passes through an audio codec purely as a distribution method. We recently proposed collaborative watermarking as method for making generated speech more easily detectable over a noisy but differentiable transmission channel. This paper extends the channel augmentation to work with non-differentiable traditional audio codecs and neural audio codecs and evaluates transferability and effect of codec bitrate over various configurations. The results show that collaborative watermarking can be reliably augmented by black-box audio codecs using a waveform-domain straight-through-estimator for gradient approximation. Furthermore, that results show that channel augmentation with a neural audio codec transfers well to traditional codecs. Listening tests demonstrate collaborative watermarking incurs negligible perceptual degradation with high bitrate codecs or DAC at 8kbps.

A Generative Adversarial Net-Based Bandwidth Extension Method for Audio Compression

MFCC-GAN Codec: A New AI-based Audio Coding

A High Fidelity and Low Complexity Neural Audio Coding

A GAN-based Tunable Image Compression System

Bandwidth Extension on Raw Audio via Generative Adversarial Networks

Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks

Native Multi-Band Audio Coding within Hyper-Autoencoded Reconstruction Propagation Networks

Vector Quantized Diffusion Model Based Speech Bandwidth Extension

BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networks

MusicHiFi: Fast High-Fidelity Stereo Vocoding

An Intra-BRNN and GB-RVQ Based END-TO-END Neural Audio Codec

Stochastic Restoration of Heavily Compressed Musical Audio using Generative Adversarial Networks

High-Fidelity Audio Compression with Improved RVQGAN

A Low-Bitrate Neural Audio Codec Framework with Bandwidth Reduction and Recovery for High-Sampling-Rate Waveforms

An Adaptive Bandwidth Reduction Scheme For Video Coding

MDCTCodec: A Lightweight MDCT-based Neural Audio Codec towards High Sampling Rate and Low Bitrate Scenarios

HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancement

Unified Signal Compression Using Generative Adversarial Networks

A low computational complexity bandwidth extension method for mobile audio coding

VQCPC-GAN: Variable-Length Adversarial Audio Synthesis Using Vector-Quantized Contrastive Predictive Coding

Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis