Multilinear Side-Information based Discriminant Analysis for face and kinship verification in the wild

Abstract This paper presents a new approach for face and kinship verification under unconstrained environments. The proposed approach is based on high order tensor representation of face images. The face tensor is built based on local descriptors extracted at multiscales. Besides, we formulate a novel Multilinear Side-Information based Discriminant Analysis (MSIDA) to handle the weakly supervised multilinear subspace projection and classification. Using only the weak label information, MSIDA projects the input face tensor in a new subspace in which the discrimination is improved and the dimension of each tensor mode is reduced simultaneously. Experimental evaluation on four challenging face databases (LFW, Cornell KinFace, UB KinFace and TSKinface) demonstrates that the proposed approach significantly outperforms the current state of the art