BZNet: Unsupervised Multi-scale Branch Zooming Network for Detecting Low-quality Deepfake Videos
- Authors
- Lee, S.[Lee, S.]; An, J.[An, J.]; Woo, S.S.[Woo, S.S.]
- Issue Date
- 25-Apr-2022
- Publisher
- Association for Computing Machinery, Inc
- Keywords
- Deepfake Detection; Forensics; Low-quality Deepfakes; Multi-scale Learning; Unsupervised Super-Resolution
- Citation
- WWW 2022 - Proceedings of the ACM Web Conference 2022, pp.3500 - 3510
- Indexed
- SCOPUS
- Journal Title
- WWW 2022 - Proceedings of the ACM Web Conference 2022
- Start Page
- 3500
- End Page
- 3510
- URI
- https://scholarworks.bwise.kr/skku/handle/2021.sw.skku/98869
- DOI
- 10.1145/3485447.3512245
- ISSN
- 0000-0000
- Abstract
- Generating a deep learning-based fake video has become no longer rocket science. The advancement of automated Deepfake (DF) generation tools that mimic certain targets has rendered society vulnerable to fake news or misinformation propagation. In real-world scenarios, DF videos are compressed to low-quality (LQ) videos, taking up less storage space and facilitating dissemination through the web and social media. Such LQ DF videos are much more challenging to detect than high-quality (HQ) DF videos. To address this challenge, we rethink the design of standard deep learning-based DF detectors, specifically exploiting feature extraction to enhance the features of LQ images. We propose a novel LQ DF detection architecture, multi-scale Branch Zooming Network (BZNet), which adopts an unsupervised super-resolution (SR) technique and utilizes multi-scale images for training. We train our BZNet only using highly compressed LQ images and experiment under a realistic setting, where HQ training data are not readily accessible. Extensive experiments on the FaceForensics++ LQ and GAN-generated datasets demonstrate that our BZNet architecture improves the detection accuracy of existing CNN-based classifiers by 4.21% on average. Furthermore, we evaluate our method against a real-world Deepfake-in-the-Wild dataset collected from the internet, which contains 200 videos featuring 50 celebrities worldwide, outperforming the state-of-the-art methods by 4.13%. © 2022 ACM.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Computing and Informatics > Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.