Pith. sign in

REVIEW 2 major objections 6 minor 3 cited by

Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics

T0 review · 2 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read All 24 tested deepfake detectors lose accuracy on a new, more diverse benchmark.

desk verdict A genuinely large and method-diverse deepfake video benchmark that deserves a serious referee, but its central 'generalizable forensics' interpretation is undercut by a talking-face construction confound that the paper never ablates. read the letter →

arxiv 2507.18015 v1 pith:T56O23BW submitted 2025-07-24 cs.CV

classification cs.CV
keywords deepfakedetectionbenchmarkgeneralizableforensicsface-swapface-reenactmenttalking-facevideoAUCevaluation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces Celeb-DF++, a large-scale video deepfake benchmark built to test whether detectors can generalize to unseen forgery types. It expands the earlier Celeb-DF dataset with 53,196 fake videos generated by 22 recent methods spanning face-swap, face-reenactment, and talking-face scenarios. Evaluated on this benchmark, all 24 recent detection methods drop in AUC compared with Celeb-DF, with average falls of about 5.2 points at frame level and 7.1 points at video level. In a cross-method protocol, the detectors average roughly 72 percent AUC, indicating that none of them reliably identifies forgeries produced by methods they were not trained on. The paper argues that current detectors are not yet ready for generalizable forensics and offers the benchmark as a shared testbed to drive progress.

What carries the argument

The central object is the benchmark itself: 53,196 forged videos produced by 22 methods (8 face-swap, 7 face-reenactment, 7 talking-face), built on 590 real videos of 59 celebrities. The evaluation machinery is a set of three protocols: GF-eval trains detectors on Celeb-DF in the face-swap scenario and tests across all other methods and scenarios; GFQ-eval adds H.264 compression at two strengths; GFD-eval trains on FaceForensics++ (HQ) and tests across all Celeb-DF++ methods. These protocols convert the question 'can detectors generalize?' into measurable AUC scores at frame and video level.

What would settle it

A detector that generalizes well on Celeb-DF++ but fails on an independent collection of real-world deepfakes (or vice versa) would disconfirm the benchmark's role as a proxy for real-world difficulty. Concretely, one could train a detector on Celeb-DF++ face-swap methods and evaluate it on a held-out set of verified in-the-wild deepfake videos; if its AUC there is close to chance while its Celeb-DF++ AUC is high, the benchmark's cross-method scores overstate real-world generalizability.

Watch

Extended reading notes

Core claim

The central discovery claimed in this paper is that the difficulty of deepfake detection is substantially underestimated when benchmarks contain only a small number of forgery methods. By extending Celeb-DF to include 22 generation pipelines across three scenarios, the authors show that every one of 24 detectors performs worse on Celeb-DF++ than on the original Celeb-DF, and that cross-method generalization remains low even for the latest detectors. The work further claims that compressed versions of the benchmark degrade performance further, and that detectors trained on FaceForensics++ lose additional accuracy under a cross-dataset protocol. The result is presented as evidence that forgery diversity, not just scale, is the key missing ingredient in existing benchmarks.

Load-bearing premise

The claim that the benchmark measures generalizable forensics rests on the assumption that the artifacts left by these 22 generation pipelines are representative of the deepfakes a detector would meet in the wild, so that a detector's failure on them predicts failure on real-world forgeries.

Editorial extensions

If this is right

  • State-of-the-art detectors overstate their real-world readiness: their published AUCs on single-method benchmarks do not transfer to diverse forgeries.
  • Cross-method generalization, not just within-method accuracy, becomes the primary evaluation target for new detectors.
  • Compression is a first-order obstacle: stronger H.264 compression (c45) cuts average frame-level AUC by an additional 4.4 points over already-low cross-method scores.
  • Training domain matters: detectors trained on FaceForensics++ do worse on Celeb-DF++ than detectors retrained on Celeb-DF, confirming a domain-gap penalty in GFD-eval.
  • The best-performing detector in the benchmark is not a solution: it leads within face-swap but degrades sharply on talking-face methods.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The talking-face videos are generated from a single first frame and five VoxCeleb2 audio clips, so their motion and background are simpler than in-the-wild talking-head videos; a detector that exploits this pipeline's constraints might score well on the benchmark while failing on real social-media forgeries.
  • The benchmark stops at 2024-generation methods; diffusion-based video generators that appeared later could behave differently, so the measured gap may be a floor or a ceiling for future detectors.
  • A productive next test would be to use the benchmark to measure per-method difficulty and correlate it with model architecture, which would tell practitioners which kinds of forgery artifacts are the hardest to model.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 6 minor

Summary. The paper introduces Celeb-DF++, a large-scale video deepfake benchmark extending the authors' earlier Celeb-DF dataset. It contains 53,196 (sic) fake videos generated by 22 methods spanning face-swap (FS), face-reenactment (FR), and talking-face (TF) scenarios, and evaluates 24 detection methods under three new protocols: GF-eval (cross-method generalization), GFQ-eval (cross-compression robustness), and GFD-eval (cross-dataset generalization). The reported results show that all assessed detectors drop on Celeb-DF++ relative to Celeb-DF, with average decreases of approximately 5.2% frame-level AUC and 7.1% video-level AUC, and that the eight detectors retrained under GF-eval average about 71.7% frame-level and 72.1% video-level AUC. The dataset is released publicly.

Significance. If the construct-validity issues are addressed, this is a potentially valuable community resource: it is one of the largest and most method-diverse video deepfake benchmarks, with 22 generation pipelines and 24 assessed detectors, and the proposed per-method evaluation tables are detailed enough to support future comparisons. The authors are transparent about protocol details and release the dataset, which will enable reproducibility. However, the benchmark's interpretation as a faithful measure of generalizable forensics for real-world forgeries is not yet secured: the TF construction protocol and the GFQ-eval compression design may confound the measured difficulty with artifacts of the synthetic pipeline. Since the paper's central claim is that the benchmark reflects the diversity of forgeries 'witnessed in the wild,' the current evidence is incomplete without human evaluation, quality metrics, or ablations that separate method-specific artifacts from shared construction choices.

major comments (2)
  1. [III-B, Tables VI-VII] The Talking-face scenario is constructed from the first frame of each real video as a single source image, driven by audio segments from VoxCeleb2 that do not match the target speaker (Section III-B, Data Generation Details). Because all seven TF generators share this protocol, the uniformly low per-method AUCs in the TF columns of Tables VI and VII (e.g., EchoMimic 51.2/46.3, SadTalker 53.8/45.7) may be driven by these common pipeline artifacts—static background, frozen identity image, audio-visual mismatch—rather than by the subtlety of the manipulations or by genuine diversity of real-world talking-face forgeries. The manuscript provides no human realism evaluation, no per-method quality or failure-rate statistics, and no ablation separating method-specific artifacts from the shared source-frame/audio protocol. As the paper's stated contribution is a benchmark for generalizable forensics against forgeries 'witnessed in the wild,' this construct-validity gap leaves the central interpretation of the cross-scenario drops unsecured. Please add a limitations discussion and supporting analyses (e.g., full-video sources, matched audio, or human perceptual ratings).
  2. [III-E, Protocol #2] In the GFQ-eval protocol, the text states that FFmpeg is used to compress 'DeepFake videos,' and the table captions refer to compression of the fake methods; there is no statement that the real videos are subjected to the same H.264 (c35/c45) re-encoding. If the real test videos retain their original quality while only the forged videos are re-compressed, the AUC drops in Tables VIII–XI conflate the obscuration of forgery traces with a class-conditional quality artifact that detectors can exploit (e.g., recognizing H.264-induced artifacts as a fake cue). Please clarify whether real videos are compressed in the same way; if they are not, the protocol should be re-run with matched compression of both classes, or the paper should explicitly justify why the current procedure is a valid measure of compression robustness.
minor comments (6)
  1. [III-B] The phrase 'randomly select 5 audio segments from VoxCeleb2 for each video frame' is ambiguous and likely meant 'for each video' rather than 'for each video frame.' Please clarify the audio-selection procedure.
  2. [III-B, Abstract] The total fake-video count of 53,196 does not match the sum of the per-method counts shown in Fig. 2 (5,639 + 13,646 + 13,631 + 20,279 = 53,195). In addition, the sentence 'For Face-swap and Face-reenactment scenario, we randomly select 2,000 identity pairs ... resulting in 13,646 videos' misattributes the FS-only count to both scenarios; the seven additional FS methods sum to 13,646, while the seven FR methods sum to 13,631. Please correct the counts and the wording.
  3. [III-C] The statement that all detectors are run 'using their default settings' is not fully specified; it is unclear whether the default settings in DeepfakeBench match the original papers' recommended hyperparameters, and whether the recent methods (CFM, ProDet, ForAda, Effort) are trained with identical data splits. Please provide implementation details or a pointer to the code repository.
  4. [III-E, GF-eval] The selection of eight detectors for retraining under GF-eval should be justified; please specify which of the 24 detectors had released training code and how the chosen eight are representative of the design-space categories in Table III.
  5. [Section III-D] The reported average decreases of 'approximately 5.2% in frame-level AUC and 7.1% in video-level AUC' do not specify the baseline version of Celeb-DF; from Tables IV and V, the drops are relative to the v2 (official) version. Please state this explicitly.
  6. [Throughout] There are several minor typos and grammatical issues, including 'developement' (Introduction), 'larges-scale' (Related Works), 'boarder range' (Conclusion), and inconsistent use of singular/plural in 'Face-swap and Face-reenactment scenario.' A careful proofread is recommended.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the paper is an empirical benchmark measurement, not a derivation whose outputs are equivalent to its inputs.

full rationale

Celeb-DF++ is an empirical measurement paper. Its central results, such as the 'average decrease of approximately 5.2% in frame-level AUC and 7.1% in video-level AUC' (Section III-D) and the GF-eval averages of 71.7% / 72.1% (Tables VI and VII), are obtained by training detectors on FF++ (HQ) or Celeb-DF and testing them on newly generated videos; no parameter is fitted to the Celeb-DF++ test data and then renamed as a prediction. The drop in AUC is a measured outcome across 24 detectors, not a quantity that is equal to the dataset construction by definition. The paper's self-references — Celeb-DF [21] as the base dataset, DeepfakeBench [94] as the implementation infrastructure, and ForAda [15] as one of the 24 assessed detectors — are provenance and evaluation constituents rather than load-bearing unverified premises that the conclusion reduces to. The skeptical concern that the talking-face videos are synthesized from a single first frame with VoxCeleb2 audio is a construct-validity question about whether the measured drop reflects real-world forgery difficulty; it does not make any prediction equivalent to its input. No circular step satisfying the required reduction standard can be exhibited, so the score is 0.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

No fitted scientific parameters: this is an empirical benchmark. The listed free parameters are hand-chosen evaluation constants on which the headline AUC drops directly depend. The axioms are representativeness and fairness assumptions shared by benchmark papers in this line; the strongest is the pipeline-representativeness assumption for the talking-face scenario. No new theoretical entities are introduced.

free parameters (3)
  • Number of test videos per method (200/200/300)
    Hand-chosen test-set sizes per scenario (Section III-B); they set the variance of all reported AUCs, but no variance is reported.
  • Compression levels c35 and c45 = H.264 CRF 35 and 45
    Hand-selected to represent medium and high compression in GFQ-eval (Section III-E, Protocol #2); the measured 3.5%, 4.4%, 2.2%, and 7.5% drops are defined relative to these two arbitrary levels.
  • 32 sampled frames per video = 32
    Sampling count for frame-level and video-level AUC (Section III-C); a standard but hand-chosen evaluation constant.
assumptions (3)
  • domain assumption The 22 selected generation methods represent the space of real-world deepfakes ('covering the most prevalent DeepFake cases witnessed in the wild').
    Abstract and Section I; no prevalence data or independent survey supports the representativeness claim, and no overlap analysis versus methods already in DF-Platter or DefakeAVMiT is given.
  • domain assumption Detectors run with default settings and DeepfakeBench pipelines represent each detector's intended capability.
    Section III-C; if defaults are suboptimal for specific generators, the benchmark understates detector performance.
  • domain assumption Frame-level and video-level AUC computed on 32 sampled frames captures detection performance faithfully.
    Section III-C; standard for the field, but video-level pooling over 32 frames is an arbitrary aggregation.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics." pith.science (2026). https://pith.science/paper/T56O23BW

@misc{pith2026250718015,
  author       = {Pith},
  title        = {Pith review of: Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/T56O23BW}},
  note         = {Machine review of arXiv:2507.18015}
}
read the original abstract

The rapid advancement of AI technologies has significantly increased the diversity of DeepFake videos circulating online, posing a pressing challenge for \textit{generalizable forensics}, \ie, detecting a wide range of unseen DeepFake types using a single model. Addressing this challenge requires datasets that are not only large-scale but also rich in forgery diversity. However, most existing datasets, despite their scale, include only a limited variety of forgery types, making them insufficient for developing generalizable detection methods. Therefore, we build upon our earlier Celeb-DF dataset and introduce {Celeb-DF++}, a new large-scale and challenging video DeepFake benchmark dedicated to the generalizable forensics challenge. Celeb-DF++ covers three commonly encountered forgery scenarios: Face-swap (FS), Face-reenactment (FR), and Talking-face (TF). Each scenario contains a substantial number of high-quality forged videos, generated using a total of 22 various recent DeepFake methods. These methods differ in terms of architectures, generation pipelines, and targeted facial regions, covering the most prevalent DeepFake cases witnessed in the wild. We also introduce evaluation protocols for measuring the generalizability of 24 recent detection methods, highlighting the limitations of existing detection methods and the difficulty of our new dataset.

Figures

Figures reproduced from arXiv: 2507.18015 by the authors.

Figure 1
Figure 1. Overview of the proposed Celeb-DF++ benchmark. This benchmark is motivated by the need of generalizable forensics in deepfake detection. their diversity. With continuous architectural refinements and evolving generation strategies, DeepFakes become increas￾ingly diverse, and more concerningly, many of their details are likely unknown. This circumstance raises a practical and urgent challenge for DeepFake detection, … view at source ↗
Figure 2
Figure 2. The sunburst chart highlights that our Celeb-DF++ includes a wide range of both DeepFake methods and assessed detection methods. See Table I, Table II and Table III for details. the target individuals. For each scenario, we adopt a diverse set of state-of-the-art DeepFake methods, 8 for FS, 7 for FR, and 7 for TF, covering 22 representative methods in total. These methods vary in architectures, generation pipelines,… view at source ↗
Figure 3
Figure 3. Visual examples of Celeb-DF++. The first column denotes the source identity face and the bottom-left embedded image represents the target face or the driving face/audio. The remaining columns display the results generated by each DeepFake method. TABLE III ASSESSED DEEPFAKE DETECTION METHODS. Detector Venue Architecture Category5 Code MesoNet [4] WIFS’18 Designed CNN Data-driven Link MesoInception [4] WIFS’18 Design… view at source ↗

Discussion (0). Sign in to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A three-stream detector with disagreement-calibrated evidential uncertainty cuts calibration error roughly in half on four of five cross-dataset deepfake benchmarks.

  2. Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A continuously refreshed, incentive-driven deepfake detector beats static detectors on in-the-wild benchmarks and improves on post-export AI-generated media.

  3. Physiological Signals as a Forensic Modality for Talking-Face Deepfake Detection

    cs.LG 2026-07 reject novelty 5.0 of 10

    A classifier trained on rPPG waveforms from face videos detects talking-face deepfakes with AUC 0.806, and detection difficulty varies by generator (AUC 0.690–0.985).

Reference graph

Works this paper leans on

95 extracted references · 72 canonical work pages · cited by 3 Pith papers

  1. [1]

    Deepfake technology and its impact: ethical considerations, societal disruptions, and security threats in ai- generated media,

    F. Folorunsho and B. F. Boamah, “Deepfake technology and its impact: ethical considerations, societal disruptions, and security threats in ai- generated media,” International Journal of Information Technology and Management Information Systems , 2025

  2. [2]

    Deepfake: Creation, purpose, risks,

    A. Busacca and M. A. Monaca, “Deepfake: Creation, purpose, risks,” Innovations and Economic and Social Changes due to Artificial Intelli- gence: The State of the Art , 2023

  3. [3]

    Defending informational sovereignty by detecting deepfakes: Risks and opportunities of an ai- based detector for deepfake-based disinformation and illegal activities,

    M. Tahraoui, C. Kr ¨atzer, and J. Dittmann, “Defending informational sovereignty by detecting deepfakes: Risks and opportunities of an ai- based detector for deepfake-based disinformation and illegal activities,” in Weizenbaum Conference Practicing Sovereignty: Interventions for Open Digital Futures , 2023

  4. [4]

    Mesonet: a compact facial video forgery detection network,

    D. Afchar, V . Nozick, J. Yamagishi, and I. Echizen, “Mesonet: a compact facial video forgery detection network,” in IEEE International Workshop on Information Forensics and Security , 2018

  5. [5]

    End-to-end reconstruction-classification learning for face forgery detection,

    J. Cao, C. Ma, T. Yao, S. Chen, S. Ding, and X. Yang, “End-to-end reconstruction-classification learning for face forgery detection,” inIEEE Conference on Computer Vision and Pattern Recognition , 2022

  6. [6]

    In ictu oculi: Exposing AI generated fake face videos by detecting eye blinking,

    Y . Li, M.-C. Chang, and S. Lyu, “In ictu oculi: Exposing AI generated fake face videos by detecting eye blinking,” in IEEE International Workshop on Information Forensics and Security , 2018

  7. [7]

    Exposing deep fakes using inconsistent head poses,

    X. Yang, Y . Li, and S. Lyu, “Exposing deep fakes using inconsistent head poses,” in IEEE International Conference on Acoustics, Speech and Signal Processing , 2019

  8. [8]

    Exploiting visual artifacts to expose deepfakes and face manipulations,

    F. Matern, C. Riess, and M. Stamminger, “Exploiting visual artifacts to expose deepfakes and face manipulations,” in IEEE Winter Applications of Computer Vision Workshops , 2019

Show all 95 references
  1. [9]

    Exposing deepfake videos by detecting face warping artifacts,

    Y . Li and S. Lyu, “Exposing deepfake videos by detecting face warping artifacts,” in IEEE Conference on Computer Vision and Pattern Recog- nition Workshops, 2019

  2. [10]

    Capsule-forensics: Using capsule networks to detect forged images and videos,

    H. H. Nguyen, J. Yamagishi, and I. Echizen, “Capsule-forensics: Using capsule networks to detect forged images and videos,” in IEEE Interna- tional Conference on Acoustics, Speech and Signal Processing , 2019

  3. [11]

    Thinking in frequency: Face forgery detection by mining frequency-aware clues,

    Y . Qian, G. Yin, L. Sheng, Z. Chen, and J. Shao, “Thinking in frequency: Face forgery detection by mining frequency-aware clues,” in European Conference on Computer Vision , 2020. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 11

  4. [12]

    An information theoretic approach for attention-driven face forgery detection,

    K. Sun, H. Liu, T. Yao, X. Sun, S. Chen, S. Ding, and R. Ji, “An information theoretic approach for attention-driven face forgery detection,” in European Conference on Computer Vision , 2022

  5. [13]

    Ucf: Uncovering common features for generalizable deepfake detection,

    Z. Yan, Y . Zhang, Y . Fan, and B. Wu, “Ucf: Uncovering common features for generalizable deepfake detection,” in IEEE International Conference on Computer Vision , 2023

  6. [14]

    Orthogonal subspace decomposition for generalizable ai-generated image detection,

    Z. Yan, J. Wang, Z. Wang, P. Jin, K.-Y . Zhang, S. Chen, T. Yao, S. Ding, B. Wu, and L. Yuan, “Orthogonal subspace decomposition for generalizable ai-generated image detection,” in International Conference on Machine Learning , 2025

  7. [15]

    Forensics adapter: Adapt- ing clip for generalizable face forgery detection,

    X. Cui, Y . Li, A. Luo, J. Zhou, and J. Dong, “Forensics adapter: Adapt- ing clip for generalizable face forgery detection,” in IEEE Conference on Computer Vision and Pattern Recognition , 2025

  8. [16]

    Deeprhythm: Exposing deepfakes with attentional visual heartbeat rhythms,

    H. Qi, Q. Guo, F. Juefei-Xu, X. Xie, L. Ma, W. Feng, Y . Liu, and J. Zhao, “Deeprhythm: Exposing deepfakes with attentional visual heartbeat rhythms,” in ACM International Conference on Multimedia , 2020

  9. [17]

    Deepfakes: a new threat to face recogni- tion? assessment and detection,

    P. Korshunov and S. Marcel, “Deepfakes: a new threat to face recogni- tion? assessment and detection,” arXiv preprint arXiv:1812.08685, 2018

  10. [18]

    Faceforensics++: Learning to detect manipulated facial images,

    A. Rossler, D. Cozzolino, L. Verdoliva, C. Riess, J. Thies, and M. Nießner, “Faceforensics++: Learning to detect manipulated facial images,” in IEEE International Conference on Computer Vision , 2019

  11. [19]

    Deepfakes detection dataset by google & jigsaw,

    N. Dufour, A. Gully, P. Karlsson, A. V . V orbyov, T. Leung, J. Childs, and C. Bregler, “Deepfakes detection dataset by google & jigsaw,” 2019

  12. [20]

    The deepfake detection challenge (dfdc) dataset,

    B. Dolhansky, J. Bitton, B. Pflaum, J. Lu, R. Howes, M. Wang, and C. C. Ferrer, “The deepfake detection challenge (dfdc) dataset,” arXiv preprint arXiv:2006.07397, 2020

  13. [21]

    Celeb-df: A large-scale challenging dataset for deepfake forensics,

    Y . Li, X. Yang, P. Sun, H. Qi, and S. Lyu, “Celeb-df: A large-scale challenging dataset for deepfake forensics,” in IEEE Conference on Computer Vision and Pattern Recognition , 2020

  14. [22]

    Generative adversarial nets,

    I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y . Bengio, “Generative adversarial nets,” in Conference on Neural Information Processing Systems , 2014

  15. [23]

    Denoising diffusion probabilistic models,

    J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” in Conference on Neural Information Processing Systems , 2020

  16. [24]

    Multi- attentional deepfake detection,

    H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, “Multi- attentional deepfake detection,” in IEEE Conference on Computer Vision and Pattern Recognition, 2021

  17. [25]

    The dee pfake detection challenge (dfdc) pre view dataset,

    B. Dolhansky, “The dee pfake detection challenge (dfdc) pre view dataset,” arXiv preprint arXiv:1910.08854 , 2019

  18. [26]

    On the detection of digital face manipulation,

    H. Dang, F. Liu, J. Stehouwer, X. Liu, and A. K. Jain, “On the detection of digital face manipulation,” in IEEE Conference on Computer Vision and Pattern Recognition, 2020

  19. [27]

    Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection,

    L. Jiang, R. Li, W. Wu, C. Qian, and C. C. Loy, “Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection,” in IEEE Conference on Computer Vision and Pattern Recognition , 2020

  20. [28]

    Wilddeepfake: A challenging real-world dataset for deepfake detection,

    B. Zi, M. Chang, J. Chen, X. Ma, and Y .-G. Jiang, “Wilddeepfake: A challenging real-world dataset for deepfake detection,” in ACM International Conference on Multimedia , 2020

  21. [29]

    Openforensics: Large-scale challenging dataset for multi-face forgery detection and seg- mentation in-the-wild,

    T.-N. Le, H. H. Nguyen, J. Yamagishi, and I. Echizen, “Openforensics: Large-scale challenging dataset for multi-face forgery detection and seg- mentation in-the-wild,” in IEEE International Conference on Computer Vision, 2021

  22. [30]

    Kodf: A large-scale korean deepfake detection dataset,

    P. Kwon, J. You, G. Nam, S. Park, and G. Chae, “Kodf: A large-scale korean deepfake detection dataset,” in IEEE International Conference on Computer Vision , 2021

  23. [31]

    Face forensics in the wild,

    T. Zhou, W. Wang, Z. Liang, and J. Shen, “Face forensics in the wild,” in IEEE Conference on Computer Vision and Pattern Recognition, 2021

  24. [32]

    Fakeavceleb: A novel audio-video multimodal deepfake dataset,

    H. Khalid, S. Tariq, M. Kim, and S. S. Woo, “Fakeavceleb: A novel audio-video multimodal deepfake dataset,” in Conference on Neural Information Processing Systems , 2021

  25. [33]

    Model attribution of face-swap deepfake videos,

    S. Jia, X. Li, and S. Lyu, “Model attribution of face-swap deepfake videos,” in IEEE International Conference on Image Processing , 2022

  26. [34]

    Df-platter: Multi-face heterogeneous deepfake dataset,

    K. Narayan, H. Agarwal, K. Thakral, S. Mittal, M. Vatsa, and R. Singh, “Df-platter: Multi-face heterogeneous deepfake dataset,” in IEEE Con- ference on Computer Vision and Pattern Recognition , 2023

  27. [35]

    Avoid-df: Audio-visual joint learning for detecting deepfake,

    W. Yang, X. Zhou, Z. Chen, B. Guo, Z. Ba, Z. Xia, X. Cao, and K. Ren, “Avoid-df: Audio-visual joint learning for detecting deepfake,” IEEE Transactions on Information Forensics and Security , 2023

  28. [36]

    Av-deepfake1m: A large-scale llm-driven audio-visual deepfake dataset,

    Z. Cai, S. Ghosh, A. P. Adatia, M. Hayat, A. Dhall, T. Gedeon, and K. Stefanov, “Av-deepfake1m: A large-scale llm-driven audio-visual deepfake dataset,” in ACM International Conference on Multimedia , 2024

  29. [37]

    Talkingheadbench: A multi-modal bench- mark & analysis of talking-head deepfake detection,

    X. Xiong, P. Patel, Q. Fan, A. Wadhwa, S. Selvam, X. Guo, L. Qi, X. Liu, and R. Sengupta, “Talkingheadbench: A multi-modal bench- mark & analysis of talking-head deepfake detection,” arXiv preprint arXiv:2505.24866, 2025

  30. [38]

    FakeApp,

    “FakeApp,” https://www.malavida.com/en/soft/fakeapp

  31. [39]

    “DFaker,” https://github.com/dfaker/df

  32. [40]

    faceswap-GAN,

    “faceswap-GAN,” https://github.com/shaoanlu/faceswap-GAN

  33. [41]

    faceswap,

    “faceswap,” https://github.com/deepfakes/faceswap

  34. [42]

    DeepFaceLab,

    “DeepFaceLab,” https://github.com/iperov/DeepFaceLab

  35. [43]

    FaceFusion,

    “FaceFusion,” https://github.com/facefusion/facefusion

  36. [44]

    3D FaceSwap,

    “3D FaceSwap,” https://github.com/MarekKowalski/FaceSwap

  37. [45]

    Simswap: An efficient framework for high fidelity face swapping,

    R. Chen, X. Chen, B. Ni, and Y . Ge, “Simswap: An efficient framework for high fidelity face swapping,” in ACM International Conference on Multimedia, 2020

  38. [46]

    Blendface: Re-designing identity encoders for face-swapping,

    K. Shiohara, X. Yang, and T. Taketomi, “Blendface: Re-designing identity encoders for face-swapping,” in IEEE International Conference on Computer Vision , 2023

  39. [47]

    Fsrt: Facial scene representa- tion transformer for face reenactment from factorized appearance head- pose and facial expression features,

    A. Rochow, M. Schwarz, and S. Behnke, “Fsrt: Facial scene representa- tion transformer for face reenactment from factorized appearance head- pose and facial expression features,” in IEEE Conference on Computer Vision and Pattern Recognition , 2024

  40. [48]

    Liveportrait: Efficient portrait animation with stitching and retargeting control,

    J. Guo, D. Zhang, X. Liu, Z. Zhong, Y . Zhang, P. Wan, and D. Zhang, “Liveportrait: Efficient portrait animation with stitching and retargeting control,” arXiv preprint arXiv:2407.03168 , 2024

  41. [49]

    Sadtalker: Learning realistic 3d motion coefficients for stylized audio-driven single image talking face animation,

    W. Zhang, X. Cun, X. Wang, Y . Zhang, X. Shen, Y . Guo, Y . Shan, and F. Wang, “Sadtalker: Learning realistic 3d motion coefficients for stylized audio-driven single image talking face animation,” in IEEE Conference on Computer Vision and Pattern Recognition , 2023

  42. [50]

    Anitalker: animate vivid and diverse talking faces through identity-decoupled facial motion encoding,

    T. Liu, F. Chen, S. Fan, C. Du, Q. Chen, X. Chen, and K. Yu, “Anitalker: animate vivid and diverse talking faces through identity-decoupled facial motion encoding,” in ACM International Conference on Multimedia , 2024

  43. [51]

    Towards high- quality and disentangled face editing in a 3d gan,

    K. Jiang, S.-Y . Chen, F.-L. Liu, H. Fu, and L. Gao, “Towards high- quality and disentangled face editing in a 3d gan,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2025

  44. [52]

    Sdgan: disentangling semantic manipulation for facial attribute editing,

    W. Huang, W. Luo, J. Huang, and X. Cao, “Sdgan: disentangling semantic manipulation for facial attribute editing,” in AAAI Conference on Artificial Intelligence , 2024

  45. [53]

    Deformable one-shot face stylization via dino semantic guidance,

    Y . Zhou, Z. Chen, and H. Huang, “Deformable one-shot face stylization via dino semantic guidance,” in IEEE Conference on Computer Vision and Pattern Recognition, 2024

  46. [54]

    Stylessp: Sampling startpoint enhancement for training-free diffusion-based method for style transfer,

    R. Xu, W. Xi, X. Wang, Y . Mao, and Z. Cheng, “Stylessp: Sampling startpoint enhancement for training-free diffusion-based method for style transfer,” in IEEE Conference on Computer Vision and Pattern Recognition, 2025

  47. [55]

    Cosyvoice: A scalable multilin- gual zero-shot text-to-speech synthesizer based on supervised semantic tokens,

    Z. Du, Q. Chen, S. Zhang, K. Hu, H. Lu, Y . Yang, H. Hu, S. Zheng, Y . Gu, Z. Ma, Z. Gao, and Z. Yan, “Cosyvoice: A scalable multilin- gual zero-shot text-to-speech synthesizer based on supervised semantic tokens,” arXiv preprint arXiv:2407.05407 , 2024

  48. [56]

    F5-tts: A fairytaler that fakes fluent and faithful speech with flow matching,

    Y . Chen, Z. Niu, Z. Ma, K. Deng, C. Wang, J. Zhao, K. Yu, and X. Chen, “F5-tts: A fairytaler that fakes fluent and faithful speech with flow matching,” arXiv preprint arXiv:2410.06885 , 2024

  49. [57]

    Beyond the prior forgery knowledge: Mining critical clues for general face forgery detection,

    A. Luo, C. Kong, J. Huang, Y . Hu, X. Kang, and A. C. Kot, “Beyond the prior forgery knowledge: Mining critical clues for general face forgery detection,” IEEE Transactions on Information Forensics and Security , 2023

  50. [58]

    Face forgery video detection via temporal forgery cue unraveling,

    Z. Guo, Y . Liu, J. Zhang, H. Zheng, and S. Shan, “Face forgery video detection via temporal forgery cue unraveling,” in IEEE Conference on Computer Vision and Pattern Recognition , 2025

  51. [59]

    Mining gen- eralized multi-timescale inconsistency for detecting deepfake videos,

    Y . Yu, R. Ni, S. Yang, Y . Ni, Y . Zhao, and A. C. Kot, “Mining gen- eralized multi-timescale inconsistency for detecting deepfake videos,” International Journal of Computer Vision , 2025

  52. [60]

    Dual contrastive learning for general face forgery detection,

    K. Sun, T. Yao, S. Chen, S. Ding, J. Li, and R. Ji, “Dual contrastive learning for general face forgery detection,” in AAAI conference on artificial intelligence, 2022

  53. [61]

    Detecting deepfakes with self-blended images,

    K. Shiohara and T. Yamasaki, “Detecting deepfakes with self-blended images,” in IEEE Conference on Computer Vision and Pattern Recog- nition, 2022

  54. [62]

    Freqblender: Enhancing deepfake detection by blending frequency knowledge,

    H. Li, J. Zhou, Y . Li, B. Wu, B. Li, and J. Dong, “Freqblender: Enhancing deepfake detection by blending frequency knowledge,” in Conference on Neural Information Processing Systems , 2024

  55. [63]

    Can we leave deepfake data behind in training deepfake detector?

    J. Cheng, Z. Yan, Y . Zhang, Y . Luo, Z. Wang, and C. Li, “Can we leave deepfake data behind in training deepfake detector?” in Conference on Neural Information Processing Systems , 2024

  56. [64]

    Self-supervised learning of adversarial example: Towards good generalizations for deep- fake detection,

    L. Chen, Y . Zhang, Y . Song, L. Liu, and J. Wang, “Self-supervised learning of adversarial example: Towards good generalizations for deep- fake detection,” in IEEE Conference on Computer Vision and Pattern Recognition, 2022

  57. [65]

    Spatio-temporal catcher: A self-supervised transformer for deepfake video detection,

    M. Li, X. Li, K. Yu, C. Deng, H. Huang, F. Mao, H. Xue, and M. Li, “Spatio-temporal catcher: A self-supervised transformer for deepfake video detection,” in ACM International Conference on Multimedia, 2023

  58. [66]

    InSwapper,

    “InSwapper,” https://github.com/haofanwang/inswapper. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 12

  59. [67]

    Hififace: 3d shape and semantic prior guided high fidelity face swapping,

    Y . Wang, X. Chen, J. Zhu, W. Chu, Y . Tai, C. Wang, J. Li, Y . Wu, F. Huang, and R. Ji, “Hififace: 3d shape and semantic prior guided high fidelity face swapping,” in International Joint Conference on Artificial Intelligence, 2021

  60. [68]

    Ghost—a new face swap approach for image and video domains,

    A. Groshev, A. Maltseva, D. Chesakov, A. Kuznetsov, and D. Dimitrov, “Ghost—a new face swap approach for image and video domains,”IEEE Access, 2022

  61. [69]

    Designing one unified framework for high-fidelity face reenactment and swapping,

    C. Xu, J. Zhang, Y . Han, G. Tian, X. Zeng, Y . Tai, Y . Wang, C. Wang, and Y . Liu, “Designing one unified framework for high-fidelity face reenactment and swapping,” in European Conference on Computer Vision, 2022

  62. [70]

    Mobilefaceswap: A lightweight framework for video face swapping,

    Z. Xu, Z. Hong, C. Ding, Z. Zhu, J. Han, J. Liu, and E. Ding, “Mobilefaceswap: A lightweight framework for video face swapping,” in AAAI Conference on Artificial Intelligence , 2022

  63. [71]

    Depth-aware generative adversarial network for talking head video generation,

    F.-T. Hong, L. Zhang, L. Shen, and D. Xu, “Depth-aware generative adversarial network for talking head video generation,” in IEEE Con- ference on Computer Vision and Pattern Recognition , 2022

  64. [72]

    Thin-plate spline motion model for image anima- tion,

    J. Zhao and H. Zhang, “Thin-plate spline motion model for image anima- tion,” in IEEE Conference on Computer Vision and Pattern Recognition, 2022

  65. [73]

    Implicit identity representation conditioned memory compensation network for talking head video generation,

    F.-T. Hong and D. Xu, “Implicit identity representation conditioned memory compensation network for talking head video generation,” in IEEE International Conference on Computer Vision , 2023

  66. [74]

    Hyperreenact: one-shot reenactment via jointly learning to refine and retarget faces,

    S. Bounareli, C. Tzelepis, V . Argyriou, I. Patras, and G. Tzimiropoulos, “Hyperreenact: one-shot reenactment via jointly learning to refine and retarget faces,” in IEEE International Conference on Computer Vision , 2023

  67. [75]

    Lia: Latent image animator,

    Y . Wang, D. Yang, F. Bremond, and A. Dantcheva, “Lia: Latent image animator,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

  68. [76]

    Identity- preserving talking face generation with landmark and appearance priors,

    W. Zhong, C. Fang, Y . Cai, P. Wei, G. Zhao, L. Lin, and G. Li, “Identity- preserving talking face generation with landmark and appearance priors,” in IEEE Conference on Computer Vision and Pattern Recognition, 2023

  69. [77]

    Edtalk: Efficient disentanglement for emotional talking head synthesis,

    S. Tan, B. Ji, M. Bi, and Y . Pan, “Edtalk: Efficient disentanglement for emotional talking head synthesis,” in European Conference on Computer Vision, 2024

  70. [78]

    Real3d- portrait: One-shot realistic 3d talking portrait synthesis,

    Z. Ye, T. Zhong, Y . Ren, J. Yang, W. Li, J. Huang, Z. Jiang, J. He, R. Huang, J. Liu, C. Zhang, X. Yin, Z. Ma, and Z. Zhao, “Real3d- portrait: One-shot realistic 3d talking portrait synthesis,” in International Conference on Learning Representations , 2024

  71. [79]

    Echomimic: Lifelike audio-driven portrait animations through editable landmark conditions,

    Z. Chen, J. Cao, Z. Chen, Y . Li, and C. Ma, “Echomimic: Lifelike audio-driven portrait animations through editable landmark conditions,” in AAAI Conference on Artificial Intelligence , 2025

  72. [80]

    Float: Generative motion latent flow match- ing for audio-driven talking portrait,

    T. Ki, D. Min, and G. Chae, “Float: Generative motion latent flow match- ing for audio-driven talking portrait,” in IEEE International Conference on Computer Vision , 2025

  73. [81]

    On face seg- mentation, face swapping, and face perception,

    Y . Nirkin, I. Masi, A. T. Tuan, T. Hassner, and G. Medioni, “On face seg- mentation, face swapping, and face perception,” in IEEE International Conference on Automatic Face & Gesture Recognition , 2018

  74. [82]

    Deferred neural rendering: Image synthesis using neural textures,

    J. Thies, M. Zollh ¨ofer, and M. Nießner, “Deferred neural rendering: Image synthesis using neural textures,” ACM Transactions on Graphics, 2019

  75. [83]

    Face2face: Real-time face capture and reenactment of rgb videos,

    J. Thies, M. Zollhofer, M. Stamminger, C. Theobalt, and M. Nießner, “Face2face: Real-time face capture and reenactment of rgb videos,” in IEEE Conference on Computer Vision and Pattern Recognition , 2016

  76. [84]

    Efficientnet: Rethinking model scaling for con- volutional neural networks,

    M. Tan and Q. Le, “Efficientnet: Rethinking model scaling for con- volutional neural networks,” in International Conference on Machine Learning, 2019

  77. [85]

    Cnn- generated images are surprisingly easy to spot... for now,

    S.-Y . Wang, O. Wang, R. Zhang, A. Owens, and A. A. Efros, “Cnn- generated images are surprisingly easy to spot... for now,” in IEEE Conference on Computer Vision and Pattern Recognition , 2020

  78. [86]

    Spatial-phase shallow learning: rethinking face forgery detection in frequency domain,

    H. Liu, X. Li, W. Zhou, Y . Chen, Y . He, H. Xue, W. Zhang, and N. Yu, “Spatial-phase shallow learning: rethinking face forgery detection in frequency domain,” in IEEE Conference on Computer Vision and Pattern Recognition, 2021

  79. [87]

    Generalizing face forgery de- tection with high-frequency features,

    Y . Luo, Y . Zhang, J. Yan, and W. Liu, “Generalizing face forgery de- tection with high-frequency features,” in IEEE Conference on Computer Vision and Pattern Recognition , 2021

  80. [88]

    Representative forgery mining for fake face detection,

    C. Wang and W. Deng, “Representative forgery mining for fake face detection,” in IEEE Conference on Computer Vision and Pattern Recog- nition, 2021

  81. [89]

    Learning transferable visual models from natural language supervi- sion,

    A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, G. Krueger, and I. Sutskever, “Learning transferable visual models from natural language supervi- sion,” in International Conference on Machine Learning , 2021

  82. [90]

    Core: Consistent representation learning for face forgery detection,

    Y . Ni, D. Meng, C. Yu, C. Quan, D. Ren, and Y . Zhao, “Core: Consistent representation learning for face forgery detection,” in IEEE Conference on Computer Vision and Pattern Recognition , 2022

  83. [91]

    Implicit identity driven deepfake face swapping detection,

    B. Huang, Z. Wang, J. Yang, J. Ai, Q. Zou, Q. Wang, and D. Ye, “Implicit identity driven deepfake face swapping detection,” in IEEE Conference on Computer Vision and Pattern Recognition , 2023

  84. [92]

    Transcending forgery specificity with latent space augmentation for generalizable deepfake detection,

    Z. Yan, Y . Luo, S. Lyu, Q. Liu, and B. Wu, “Transcending forgery specificity with latent space augmentation for generalizable deepfake detection,” in IEEE Conference on Computer Vision and Pattern Recog- nition, 2024

  85. [93]

    V oxceleb2: Deep speaker recognition,

    J. S. Chung, A. Nagrani, and A. Zisserman, “V oxceleb2: Deep speaker recognition,” in Conference of the International Speech Communication Association, 2018

  86. [94]

    Deepfakebench: A comprehensive benchmark of deepfake detection,

    Z. Yan, Y . Zhang, X. Yuan, S. Lyu, and B. Wu, “Deepfakebench: A comprehensive benchmark of deepfake detection,” in Conference on Neural Information Processing Systems , 2023

  87. [95]

    Converting video formats with ffmpeg,

    S. Tomar, “Converting video formats with ffmpeg,” Linux Journal, 2006

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.