10 research outputs found
Visual Realism Assessment for Face-swap Videos
Deep-learning based face-swap videos, also known as deep fakes, are becoming
more and more realistic and deceiving. The malicious usage of these face-swap
videos has caused wide concerns. The research community has been focusing on
the automatic detection of these fake videos, but the assessment of their
visual realism, as perceived by human eyes, is still an unexplored dimension.
Visual realism assessment, or VRA, is essential for assessing the potential
impact that may be brought by a specific face-swap video, and it is also
important as a quality assessment metric to compare different face-swap
methods. In this paper, we make a small step towards this new VRA direction by
building a benchmark for evaluating the effectiveness of different automatic
VRA models, which range from using traditional hand-crafted features to
different kinds of deep-learning features. The evaluations are based on a
recent competition dataset named DFGC 2022, which contains 1400 diverse
face-swap videos that are annotated with Mean Opinion Scores (MOS) on visual
realism. Comprehensive experiment results using 11 models and 3 protocols are
shown and discussed. We demonstrate the feasibility of devising effective VRA
models for assessing face-swap videos and methods. The particular usefulness of
existing deepfake detection features for VRA is also noted. The code can be
found at https://github.com/XianyunSun/VRA.git.Comment: Accepted by ICIG 202
Attitudes towards suicide in urban and rural China: a population based, cross-sectional study
Improved Fully Convolutional Siamese Networks for Visual Object Tracking Based on Response Behaviour Analysis
Siamese networks have recently attracted significant attention in the visual tracking community due to their balanced accuracy and speed. However, as a result of the non-update of the appearance model and the changing appearance of the target, the problem of tracking drift is a regular occurrence, particularly in background clutter scenarios. As a means of addressing this problem, this paper proposes an improved fully convolutional Siamese tracker that is based on response behaviour analysis (SiamFC-RBA). Firstly, the response map of the SiamFC is normalised to an 8-bit grey image, and the isohypse contours that represent the candidate target region are generated through thresholding. Secondly, the dynamic behaviour of the contours is analysed in order to check if there are distractors approaching the tracked target. Finally, a peak switching strategy is used as a means of determining the real tracking position of all candidates. Extensive experiments conducted on visual tracking benchmarks, including OTB100, GOT-10k and LaSOT, demonstrated that the proposed tracker outperformed the compared trackers such as DaSiamRPN, SiamRPN, SiamFC, CSK, CFNet and Staple and achieved state-of-the-art performance. In addition, the response behaviour analysis module was embedded into DiMP, with the experimental results showing the performance of the tracker to be improved through the use of the proposed architecture
Lower bound of entanglement of formation based on correlation matrix
The entanglement of formation (EOF), which quantifies the required minimally physical resources to prepare a quantum state, plays important roles in many quantum information processes. Due to the convex-roof definition, it is hard to find the explicit analytic formulae of EOF, except for some special quantum systems. The correlation matrix of a quantum state is closely related to entanglement property. In this paper, we use the Lagrange-multiplier approach to obtain an analytic lower bound of EOF for arbitrary dimensional bipartite states, which improves the previous conclusions. Numerical example shows that the bound is also valid for some PPT entangled states
Additional file 1: of Attitudes towards suicide in urban and rural China: a population based, cross-sectional study
Appendix 1. Scale of Public Attitudes about Suicide (SPAS) (translated from the original Chinese). (DOCX 16 Kb