From clothing to identity; manual and automatic soft biometrics

Soft biometrics have increasingly attracted research interest and are often considered as major cues for identity, especially in the absence of valid traditional biometrics, as in surveillance. In everyday life, several incidents and forensic scenarios highlight the usefulness and capability of identity information that can be deduced from clothing. Semantic clothing attributes have recently been introduced as a new form of soft biometrics. Although clothing traits can be naturally described and compared by humans for operable and successful use, it is desirable to exploit computer-vision to enrich clothing descriptions with more objective and discriminative information. This allows automatic extraction and semantic description and comparison of visually detectable clothing traits in a manner similar to recognition by eyewitness statements. This study proposes a novel set of soft clothing attributes, described using small groups of high-level semantic labels, and automatically extracted using computer-vision techniques. In this way we can explore the capability of human attributes vis-a-vis those which are inferred automatically by computer-vision. Categorical and comparative soft clothing traits are derived and used for identification/re identification either to supplement soft body traits or to be used alone. The automatically- and manually-derived soft clothing biometrics are employed in challenging invariant person retrieval. The experimental results highlight promising potential for use in various applications

Analysing soft clothing biometrics for retrieval

Soft biometrics continues to attract research interest. Traditional body and face soft biometrics have been the main research focus and have been proven, by many researchers, to be usable for identification and retrieval. Also, soft biometrics have been shown to provide several advantages over classic biometrics, such as invariance to illumination and contrast. Other than body and face, little attention has focussed on semantic descriptions of an individual, including clothing attributes. Research has yet to concern clothing characteristics as a major or complementary set of biometric traits. In this paper, we analyse the reliability and significance of clothing information for retrieval purposes. We investigate and rate the viability of semantic clothing descriptions to retrieve a subject correctly, given a verbal description of their clothing