ProtoExplorer: Interpretable Forensic Analysis of Deepfake Videos using Prototype Exploration and Refinement

In high-stakes settings, Machine Learning models that can provide predictions that are interpretable for humans are crucial. This is even more true with the advent of complex deep learning based models with a huge number of tunable parameters. Recently, prototype-based methods have emerged as a promising approach to make deep learning interpretable. We particularly focus on the analysis of deepfake videos in a forensics context. Although prototype-based methods have been introduced for the detection of deepfake videos, their use in real-world scenarios still presents major challenges, in that prototypes tend to be overly similar and interpretability varies between prototypes. This paper proposes a Visual Analytics process model for prototype learning, and, based on this, presents ProtoExplorer, a Visual Analytics system for the exploration and refinement of prototype-based deepfake detection models. ProtoExplorer offers tools for visualizing and temporally filtering prototype-based predictions when working with video data. It disentangles the complexity of working with spatio-temporal prototypes, facilitating their visualization. It further enables the refinement of models by interactively deleting and replacing prototypes with the aim to achieve more interpretable and less biased predictions while preserving detection accuracy. The system was designed with forensic experts and evaluated in a number of rounds based on both open-ended think aloud evaluation and interviews. These sessions have confirmed the strength of our prototype based exploration of deepfake videos while they provided the feedback needed to continuously improve the system

ProtoExplorer: Interpretable forensic analysis of deepfake videos using prototype exploration and refinement

In high-stakes settings, Machine Learning models that can provide predictions that are interpretable for humans are crucial. This is even more true with the advent of complex deep learning based models with a huge number of tunable parameters. Recently, prototype-based methods have emerged as a promising approach to make deep learning interpretable. We particularly focus on the analysis of deepfake videos in a forensics context. Although prototype-based methods have been introduced for the detection of deepfake videos, their use in real-world scenarios still presents major challenges, in that prototypes tend to be overly similar and interpretability varies between prototypes. This paper proposes a Visual Analytics process model for prototype learning, and, based on this, presents ProtoExplorer, a Visual Analytics system for the exploration and refinement of prototype-based deepfake detection models. ProtoExplorer offers tools for visualizing and temporally filtering prototype-based predictions when working with video data. It disentangles the complexity of working with spatio-temporal prototypes, facilitating their visualization. It further enables the refinement of models by interactively deleting and replacing prototypes with the aim to achieve more interpretable and less biased predictions while preserving detection accuracy. The system was designed with forensic experts and evaluated in a number of rounds based on both open-ended think aloud evaluation and interviews. These sessions have confirmed the strength of our prototype-based exploration of deepfake videos while they provided the feedback needed to continuously improve the system

Supramolecular coordination chemistry of aromatic polyoxalamide ligands: A metallosupramolecular approach toward functional magnetic materials

The impressive potential of the metallosupramolecular approach in designing new functional magnetic materials constitutes a great scientific challenge for the chemical research community that requires an interdisciplinary collaboration. New fundamental concepts and future applications in nanoscience and nanotechnology will emerge from the study of magnetism as a supramolecular function in metallosupramolecular chemistry. Our recent work on the rich supramolecular coordination chemistry of a novel family of aromatic polyoxalamide (APOXA) ligands with first-row transition metal ions has allowed us to move one step further in the rational design of metallosupramolecular assemblies of increasing structural and magnetic complexity. Thus, we have taken advantage of the new developments of metallosupramolecular chemistry and, in particular, the molecular-programmed self-assembly methods that exploit the coordination preferences of paramagnetic metal ions and suitable designed polytopic ligands. The resulting self-assembled di- and trinuclear metallacyclic complexes with APOXA ligands, either metallacyclophanes or metallacryptands, are indeed ideal model systems for the study of the electron exchange mechanism between paramagnetic metal centers through extended π-conjugated aromatic bridges. So, the influence of different factors such as the topology and conformation of the bridging ligand or the electronic configuration and magnetic anisotropy of the metal ion have been investigated in a systematic way. These oligonuclear metallacyclic complexes can be important in the development of a new class of molecular magnetic devices, such as molecular magnetic wires (MMWs) and switches (MMSs), which are major goals in the field of molecular electronics and spintronics. On the other hand, because of their metal binding capacity through the outer carbonyl-oxygen atoms of the oxamato groups, they can further be used as ligands, referred to as metal–organic ligands (MOLs), toward either coordinatively unsaturated metal complexes or fully solvated metal ions. This well-known “complex-as-ligand” approach affords a wide variety of high-nuclearity metal–organic clusters (MOCs) and high-dimensionality metal–organic polymers (MOPs). The judicious choice of the oligonuclear MOL, ranging from mono- to di- and trinuclear species, has allowed us to control the overall structure and magnetic properties of the final oxamato-bridged multidimensional (nD, n = 0–3) MOCs and MOPs. The intercrossing between short- (nanoscopic) and long-range (macroscopic) magnetic behavior has been investigated in this unique family of oxamato-bridged metallosupramolecular magnetic materials expanding the examples of low-dimensional, single-molecule (SMMs) and single-chain (SCMs) magnets and high-dimensional, open-framework magnets (OFMs), which are brand-new targets in the field of molecular magnetism and materials science

Search for the standard model Higgs boson in the H to ZZ to 2l 2nu channel in pp collisions at sqrt(s) = 7 TeV

A search for the standard model Higgs boson in the H to ZZ to 2l 2nu decay channel, where l = e or mu, in pp collisions at a center-of-mass energy of 7 TeV is presented. The data were collected at the LHC, with the CMS detector, and correspond to an integrated luminosity of 4.6 inverse femtobarns. No significant excess is observed above the background expectation, and upper limits are set on the Higgs boson production cross section. The presence of the standard model Higgs boson with a mass in the 270-440 GeV range is excluded at 95% confidence level.Comment: Submitted to JHE

Search for New Physics with Jets and Missing Transverse Momentum in pp collisions at sqrt(s) = 7 TeV

A search for new physics is presented based on an event signature of at least three jets accompanied by large missing transverse momentum, using a data sample corresponding to an integrated luminosity of 36 inverse picobarns collected in proton--proton collisions at sqrt(s)=7 TeV with the CMS detector at the LHC. No excess of events is observed above the expected standard model backgrounds, which are all estimated from the data. Exclusion limits are presented for the constrained minimal supersymmetric extension of the standard model. Cross section limits are also presented using simplified models with new particles decaying to an undetected particle and one or two jets

Search for anomalous t t-bar production in the highly-boosted all-hadronic final state

A search is presented for a massive particle, generically referred to as a Z', decaying into a t t-bar pair. The search focuses on Z' resonances that are sufficiently massive to produce highly Lorentz-boosted top quarks, which yield collimated decay products that are partially or fully merged into single jets. The analysis uses new methods to analyze jet substructure, providing suppression of the non-top multijet backgrounds. The analysis is based on a data sample of proton-proton collisions at a center-of-mass energy of 7 TeV, corresponding to an integrated luminosity of 5 inverse femtobarns. Upper limits in the range of 1 pb are set on the product of the production cross section and branching fraction for a topcolor Z' modeled for several widths, as well as for a Randall--Sundrum Kaluza--Klein gluon. In addition, the results constrain any enhancement in t t-bar production beyond expectations of the standard model for t t-bar invariant masses larger than 1 TeV.Comment: Submitted to the Journal of High Energy Physics; this version includes a minor typo correction that will be submitted as an erratu

Measurement of the t t-bar production cross section in the dilepton channel in pp collisions at sqrt(s) = 7 TeV

The t t-bar production cross section (sigma[t t-bar]) is measured in proton-proton collisions at sqrt(s) = 7 TeV in data collected by the CMS experiment, corresponding to an integrated luminosity of 2.3 inverse femtobarns. The measurement is performed in events with two leptons (electrons or muons) in the final state, at least two jets identified as jets originating from b quarks, and the presence of an imbalance in transverse momentum. The measured value of sigma[t t-bar] for a top-quark mass of 172.5 GeV is 161.9 +/- 2.5 (stat.) +5.1/-5.0 (syst.) +/- 3.6(lumi.) pb, consistent with the prediction of the standard model.Comment: Replaced with published version. Included journal reference and DO

Combined search for the quarks of a sequential fourth generation

Results are presented from a search for a fourth generation of quarks produced singly or in pairs in a data set corresponding to an integrated luminosity of 5 inverse femtobarns recorded by the CMS experiment at the LHC in 2011. A novel strategy has been developed for a combined search for quarks of the up and down type in decay channels with at least one isolated muon or electron. Limits on the mass of the fourth-generation quarks and the relevant Cabibbo-Kobayashi-Maskawa matrix elements are derived in the context of a simple extension of the standard model with a sequential fourth generation of fermions. The existence of mass-degenerate fourth-generation quarks with masses below 685 GeV is excluded at 95% confidence level for minimal off-diagonal mixing between the third- and the fourth-generation quarks. With a mass difference of 25 GeV between the quark masses, the obtained limit on the masses of the fourth-generation quarks shifts by about +/- 20 GeV. These results significantly reduce the allowed parameter space for a fourth generation of fermions.Comment: Replaced with published version. Added journal reference and DO

Measurement of the Z/gamma* + b-jet cross section in pp collisions at 7 TeV

The production of b jets in association with a Z/gamma* boson is studied using proton-proton collisions delivered by the LHC at a centre-of-mass energy of 7 TeV and recorded by the CMS detector. The inclusive cross section for Z/gamma* + b-jet production is measured in a sample corresponding to an integrated luminosity of 2.2 inverse femtobarns. The Z/gamma* + b-jet cross section with Z/gamma* to ll (where ll = ee or mu mu) for events with the invariant mass 60 < M(ll) < 120 GeV, at least one b jet at the hadron level with pT > 25 GeV and abs(eta) < 2.1, and a separation between the leptons and the jets of Delta R > 0.5 is found to be 5.84 +/- 0.08 (stat.) +/- 0.72 (syst.) +(0.25)/-(0.55) (theory) pb. The kinematic properties of the events are also studied and found to be in agreement with the predictions made by the MadGraph event generator with the parton shower and the hadronisation performed by PYTHIA.Comment: Submitted to the Journal of High Energy Physic

Search for supersymmetry in events with b-quark jets and missing transverse energy in pp collisions at 7 TeV

Results are presented from a search for physics beyond the standard model based on events with large missing transverse energy, at least three jets, and at least one, two, or three b-quark jets. The study is performed using a sample of proton-proton collision data collected at sqrt(s) = 7 TeV with the CMS detector at the LHC in 2011. The integrated luminosity of the sample is 4.98 inverse femtobarns. The observed number of events is found to be consistent with the standard model expectation, which is evaluated using control samples in the data. The results are used to constrain cross sections for the production of supersymmetric particles decaying to b-quark-enriched final states in the context of simplified model spectra.Comment: Submitted to Physical Review