Forensic analysis of AI-compression traces in spatial and frequency domain

Sandra Bergmann,Denise Moussa,Fabian Brand,André Kaup,Christian Riess
DOI: https://doi.org/10.1016/j.patrec.2024.02.015
IF: 4.757
2024-02-25
Pattern Recognition Letters
Abstract:The classical JPEG compression is a rich source of cues for forensic image analysis. However, this compression standard will in the near future be complemented by a new, highly efficient learning-based compression standard called JPEG-AI. JPEG-AI is fundamentally different from classical JPEG. Hence, its forensic traces can also be expected to be fundamentally different. We argue that there is a pressing need for image forensics research to investigate these traces. In this work, we characterize forensic compression traces of different AI compression algorithms. Our analysis investigates AI compression artifacts in frequency domain and in spatial domain. Both domains exhibit similar artifacts that likely stem from upsampling operations of the decoders. Additionally, we report for one AI codec another artifact in homogeneous regions. We also investigate the artifact detectability in several scenarios including unseen AI compression traces and postprocessing. Here, frequency and autocorrelation features are better on additive noise and classical JPEG post-compression, while RGB features perform better on blurred and downsampled images.
computer science, artificial intelligence
What problem does this paper attempt to address?