Controlled evaluation reveals marked performance loss in deepfake detectors across evolving generation methods, indicating standard benchmarks overestimate detector robustness.
This paper investigates the generalization of deepfake detectors under controlled fake-generation distribution shift. Two paired datasets derived from FaceForensics++ are used: a benchmark-era dataset using Deepfakes face swapping and a diffusion-era dataset using Stable Diffusion face-region inpainting, while holding the real-image distribution constant. Xception and DINOv2-based detectors are evaluated using a 2×2 train/test protocol to measure both in-domain and cross-domain performance. Results show strong in-domain performance but substantial degradation under cross-domain evaluation, demonstrating that benchmark-only evaluation can overestimate robustness to evolving manipulation methods.
No takes yet. Share an insight, caveat, or question.
Hammad et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: