A Novel Facial Manipulation Detection Method Based on Contrastive Learning

Zhiyuan Ma, Pengxiang Xu, Xue Mei, Jie Shen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Nowadays, numerous synthesized face-swapping videos generated by face forgery algorithms have become an emerging problem, which promotes facial manipulation detection to be a significant topic. With the development of face forgery algorithms, some fake face images or videos generated by those strong forgery algorithms are very realistic, which have brought much difficulty to facial manipulation detection. In this paper, we present a novel facial manipulation detection method based on contrastive learning. We analyze theure features of manipulated facial images and propose to compare and learn the features of the whole face and the center face in order to get more general features. We calculate the similarity and distribution distance between the whole face and the center face. The experiments implemented on FaceForensics++ dataset demonstrate that the proposed method achieves outstanding results and can learn the general features.

Original languageEnglish
Title of host publication2022 IEEE 5th International Conference on Electronics Technology, ICET 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1163-1167
Number of pages5
ISBN (Electronic)9781665485081
DOIs
StatePublished - 2022
Event5th IEEE International Conference on Electronics Technology, ICET 2022 - Chengdu, China
Duration: 13 May 202216 May 2022

Publication series

Name2022 IEEE 5th International Conference on Electronics Technology, ICET 2022

Conference

Conference5th IEEE International Conference on Electronics Technology, ICET 2022
Country/TerritoryChina
CityChengdu
Period13/05/2216/05/22

Keywords

  • Contrastive Learning
  • Deep learning
  • Face Forgery Detection
  • Facial Manipulation Detection
  • Siamese Network

Fingerprint

Dive into the research topics of 'A Novel Facial Manipulation Detection Method Based on Contrastive Learning'. Together they form a unique fingerprint.

Cite this