5 research outputs found
Towards Effective Image Forensics via A Novel Computationally Efficient Framework and A New Image Splice Dataset
Splice detection models are the need of the hour since splice manipulations
can be used to mislead, spread rumors and create disharmony in society.
However, there is a severe lack of image splicing datasets, which restricts the
capabilities of deep learning models to extract discriminative features without
overfitting. This manuscript presents two-fold contributions toward splice
detection. Firstly, a novel splice detection dataset is proposed having two
variants. The two variants include spliced samples generated from code and
through manual editing. Spliced images in both variants have corresponding
binary masks to aid localization approaches. Secondly, a novel
Spatio-Compression Lightweight Splice Detection Framework is proposed for
accurate splice detection with minimum computational cost. The proposed
dual-branch framework extracts discriminative spatial features from a
lightweight spatial branch. It uses original resolution compression data to
extract double compression artifacts from the second branch, thereby making it
'information preserving.' Several CNNs are tested in combination with the
proposed framework on a composite dataset of images from the proposed dataset
and the CASIA v2.0 dataset. The best model accuracy of 0.9382 is achieved and
compared with similar state-of-the-art methods, demonstrating the superiority
of the proposed framework
Media Forensics and DeepFakes: an overview
With the rapid progress of recent years, techniques that generate and
manipulate multimedia content can now guarantee a very advanced level of
realism. The boundary between real and synthetic media has become very thin. On
the one hand, this opens the door to a series of exciting applications in
different fields such as creative arts, advertising, film production, video
games. On the other hand, it poses enormous security threats. Software packages
freely available on the web allow any individual, without special skills, to
create very realistic fake images and videos. So-called deepfakes can be used
to manipulate public opinion during elections, commit fraud, discredit or
blackmail people. Potential abuses are limited only by human imagination.
Therefore, there is an urgent need for automated tools capable of detecting
false multimedia content and avoiding the spread of dangerous false
information. This review paper aims to present an analysis of the methods for
visual media integrity verification, that is, the detection of manipulated
images and videos. Special emphasis will be placed on the emerging phenomenon
of deepfakes and, from the point of view of the forensic analyst, on modern
data-driven forensic methods. The analysis will help to highlight the limits of
current forensic tools, the most relevant issues, the upcoming challenges, and
suggest future directions for research