特徴ロバスト拡張と根拠に基づく説明最適化による説明可能なディープフェイク検出
Explainable Deepfake Detection with Feature-robust Augmentation and Evidence-grounded Explanation Optimization
画像品質低下への耐性と説明の正確性を両立するため、劣化対応の拡張と教師あり対比学習、および証拠に基づく選好最適化を導入した説明可能なディープフェイク検出フレームワークを提案した。
著者: Zhu Xu, Jiaqi Tang, Pokai Chen, Yuxin Peng, Yang Liu
分類: cs.CV, cs.AI
原文アブストラクト
Explainable deepfake detection extends binary classification by requiring models to not only predict authenticity but also provide interpretable justifications. This expanded scope is critical in practice, where users like forensic analysts need insight into the rationale behind the detection. Despite advancements, current approaches suffer from two critical deficiencies: (1)vulnerability to image quality degradation: detection accuracy plummets on low-quality samples, while naive augmentation strategies may induce feature drift and impair performance as diversity expands. (2) factually flawed explanations: explanation models may omit manipulation evidence or hallucinate irrelevant details, undermining interpretability. To address it, we propose a framework with two innovations. For robust deepfake detection, we introduce Feature-robust Augmentation, which comprises diversified degradation-aware augmentation strategies, and a supervised contrastive learning pattern paired with a mean-teacher architecture that stabilizes features against augmentations through consistency constraints. For explanation, we devise an evidence-grounded preference optimization process that guides model to prioritize genuine manipulation traces by learning from chosen-rejected explanation pairs, where rejected samples are constructed via evidence omission or irrelevant information injection. The proposed approach wins the first place in ACM Multimedia 2026 Explainable Deepfake Detection Challenge.The code is available at https://github.com/oceanflowlab/EDD.git.