Recent research has highlighted a key issue in speech deepfake detection:
models trained on one set of deepfakes perform poorly on others. The question
arises: is this due to the continuously improving quality of Text-to-Speech
(TTS) models, i.e., are newer DeepFakes just 'harder' to detect? Or, is it
because deepfakes generated with one model are fundamentally different to those
generated using another model? We answer this question by decomposing the
performance gap between in-domain and out-of-domain test data into 'hardness'
and 'difference' components. Experiments performed using ASVspoof databases
indicate that the hardness component is practically negligible, with the
performance gap being attributed primarily to the difference component. This
has direct implications for real-world deepfake detection, highlighting that
merely increasing model capacity, the currently-dominant research trend, may
not effectively address the generalization challenge.

语音深度伪造检测中的关键问题是不同模型训练的深度伪造模型在其他模型上表现较差。实验证明，性能差距主要是由于深度伪造生成的模型不同，而不是由于深度伪造的新质量提高而导致的，这对实际的深度伪造检测有直接影响，强调仅仅增加模型容量可能无法有效应对泛化挑战。