A Performance Enhancement of Deepfake Video Detection through the use of a Hybrid CNN Deep Learning Model

Authors

  • Sumaiya Thaseen Ikram School of Information Technology and Engineering Vellore Institute of Technology, Vellore, Tamil Nadu, India.
  • Priya V Associate Professor, School of Information Technology and Engineering Vellore Institute of Technology, Vellore, Tamilnadu, India
  • Shourya Chambial Student, School of Information Technology and Engineering Vellore Institute of Technology, Vellore, Tamilnadu, India https://orcid.org/0000-0003-4121-8017
  • Dhruv Sood Student, School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamilnadu, India https://orcid.org/0000-0002-2478-6007
  • Arulkumar V Senior Assistant Professor, School of Computer Science and Engineering Vellore Institute of Technology, Vellore, Tamilnadu, India https://orcid.org/0000-0001-7149-0383

DOI:

https://doi.org/10.32985/ijeces.14.2.6

Keywords:

Deepfake, Machine learning, Deep learning, Inception, Xception

Abstract

In the current era, many fake videos and images are created with the help of various software and new AI (Artificial Intelligence) technologies, which leave a few hints of manipulation. There are many unethical ways videos can be used to threaten, fight, or create panic among people. It is important to ensure that such methods are not used to create fake videos. An AI-based technique for the synthesis of human images is called Deep Fake. They are created by combining and superimposing existing videos onto the source videos. In this paper, a system is developed that uses a hybrid Convolutional Neural Network (CNN) consisting of InceptionResnet v2 and Xception to extract frame-level features. Experimental analysis is performed using the DFDC deep fake detection challenge on Kaggle. These deep learning-based methods are optimized to increase accuracy and decrease training time by using this dataset for training and testing. We achieved a precision of 0.985, a recall of 0.96, an f1-score of 0.98, and support of 0.968.

Downloads

Published

2023-02-17

Issue

Section

Original Scientific Papers