Generating 2D and 3D Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution

A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. For 2D face verification, multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network to direct the search toward promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a considerable coverage of the identities in the LFW or RFW datasets with less than 10 master faces, for six leading deep face recognition systems. In 3D, we generate faces using the 2D StyleGAN2 generator and predict a 3D structure using a deep 3D face reconstruction network. When employing two different 3D face recognition systems, we are able to obtain a coverage of 40%-50%. Additionally, we present the generation of paired 2D RGB and 3D master faces, which simultaneously match 2D and 3D models with high impersonation rates.Comment: accepted for publication in IEEE Transactions on Biometrics, Behavior, and Identity Science (TBIOM). This paper extends arXiv:2108.01077 that was accepted to IEEE FG 202

Symmetric quivers, invariant theory, and saturation theorems for the classical groups

Let G denote either a special orthogonal group or a symplectic group defined over the complex numbers. We prove the following saturation result for G: given dominant weights \lambda^1, ..., \lambda^r such that the tensor product V_{N\lambda^1} \otimes ... \otimes V_{N\lambda^r} contains nonzero G-invariants for some N \ge 1, we show that the tensor product V_{2\lambda^1} \otimes ... \otimes V_{2\lambda^r} also contains nonzero G-invariants. This extends results of Kapovich-Millson and Belkale-Kumar and complements similar results for the general linear group due to Knutson-Tao and Derksen-Weyman. Our techniques involve the invariant theory of quivers equipped with an involution and the generic representation theory of certain quivers with relations.Comment: 29 pages, no figures; v2: updated Theorem 2.4 to odd characteristic, added Remark 3.9, added references, corrected some definitions and typo