Covaｒiate-invariant gait analysis for human identification（人識別を目的とする共変量不変歩行解析）

信州大学(Shinshu university)博士（工学)ThesisYEOH TZE WEI. Covaｒiate-invariant gait analysis for human identification（人識別を目的とする共変量不変歩行解析）. 信州大学, 2018, 博士論文. 博士（工学), 甲第692号, 平成30年03月20日授与.doctoral thesi

Person recognition based on deep gait: a survey.

Gait recognition, also known as walking pattern recognition, has expressed deep interest in the computer vision and biometrics community due to its potential to identify individuals from a distance. It has attracted increasing attention due to its potential applications and non-invasive nature. Since 2014, deep learning approaches have shown promising results in gait recognition by automatically extracting features. However, recognizing gait accurately is challenging due to the covariate factors, complexity and variability of environments, and human body representations. This paper provides a comprehensive overview of the advancements made in this field along with the challenges and limitations associated with deep learning methods. For that, it initially examines the various gait datasets used in the literature review and analyzes the performance of state-of-the-art techniques. After that, a taxonomy of deep learning methods is presented to characterize and organize the research landscape in this field. Furthermore, the taxonomy highlights the basic limitations of deep learning methods in the context of gait recognition. The paper is concluded by focusing on the present challenges and suggesting several research directions to improve the performance of gait recognition in the future

From clothing to identity; manual and automatic soft biometrics

Soft biometrics have increasingly attracted research interest and are often considered as major cues for identity, especially in the absence of valid traditional biometrics, as in surveillance. In everyday life, several incidents and forensic scenarios highlight the usefulness and capability of identity information that can be deduced from clothing. Semantic clothing attributes have recently been introduced as a new form of soft biometrics. Although clothing traits can be naturally described and compared by humans for operable and successful use, it is desirable to exploit computer-vision to enrich clothing descriptions with more objective and discriminative information. This allows automatic extraction and semantic description and comparison of visually detectable clothing traits in a manner similar to recognition by eyewitness statements. This study proposes a novel set of soft clothing attributes, described using small groups of high-level semantic labels, and automatically extracted using computer-vision techniques. In this way we can explore the capability of human attributes vis-a-vis those which are inferred automatically by computer-vision. Categorical and comparative soft clothing traits are derived and used for identification/re identification either to supplement soft body traits or to be used alone. The automatically- and manually-derived soft clothing biometrics are employed in challenging invariant person retrieval. The experimental results highlight promising potential for use in various applications

Person re-Identification over distributed spaces and time

PhDReplicating the human visual system and cognitive abilities that the brain uses to process the information it receives is an area of substantial scientific interest. With the prevalence of video surveillance cameras a portion of this scientific drive has been into providing useful automated counterparts to human operators. A prominent task in visual surveillance is that of matching people between disjoint camera views, or re-identification. This allows operators to locate people of interest, to track people across cameras and can be used as a precursory step to multi-camera activity analysis. However, due to the contrasting conditions between camera views and their effects on the appearance of people re-identification is a non-trivial task. This thesis proposes solutions for reducing the visual ambiguity in observations of people between camera views This thesis first looks at a method for mitigating the effects on the appearance of people under differing lighting conditions between camera views. This thesis builds on work modelling inter-camera illumination based on known pairs of images. A Cumulative Brightness Transfer Function (CBTF) is proposed to estimate the mapping of colour brightness values based on limited training samples. Unlike previous methods that use a mean-based representation for a set of training samples, the cumulative nature of the CBTF retains colour information from underrepresented samples in the training set. Additionally, the bi-directionality of the mapping function is explored to try and maximise re-identification accuracy by ensuring samples are accurately mapped between cameras. Secondly, an extension is proposed to the CBTF framework that addresses the issue of changing lighting conditions within a single camera. As the CBTF requires manually labelled training samples it is limited to static lighting conditions and is less effective if the lighting changes. This Adaptive CBTF (A-CBTF) differs from previous approaches that either do not consider lighting change over time, or rely on camera transition time information to update. By utilising contextual information drawn from the background in each camera view, an estimation of the lighting change within a single camera can be made. This background lighting model allows the mapping of colour information back to the original training conditions and thus remove the need for 3 retraining. Thirdly, a novel reformulation of re-identification as a ranking problem is proposed. Previous methods use a score based on a direct distance measure of set features to form a correct/incorrect match result. Rather than offering an operator a single outcome, the ranking paradigm is to give the operator a ranked list of possible matches and allow them to make the final decision. By utilising a Support Vector Machine (SVM) ranking method, a weighting on the appearance features can be learned that capitalises on the fact that not all image features are equally important to re-identification. Additionally, an Ensemble-RankSVM is proposed to address scalability issues by separating the training samples into smaller subsets and boosting the trained models. Finally, the thesis looks at a practical application of the ranking paradigm in a real world application. The system encompasses both the re-identification stage and the precursory extraction and tracking stages to form an aid for CCTV operators. Segmentation and detection are combined to extract relevant information from the video, while several combinations of matching techniques are combined with temporal priors to form a more comprehensive overall matching criteria. The effectiveness of the proposed approaches is tested on datasets obtained from a variety of challenging environments including offices, apartment buildings, airports and outdoor public spaces

Physiognomic Artificial Intelligence

The reanimation of the pseudosciences of physiognomy and phrenology at scale through computer vision and machine learning is a matter of urgent concern. This Article—which contributes to critical data studies, consumer protection law, biometric privacy law, and antidiscrimination law—endeavors to conceptualize and problematize physiognomic artificial intelligence (“AI”) and offer policy recommendations for state and federal lawmakers to forestall its proliferation. Physiognomic AI, as this Article contends, is the practice of using computer software and related systems to infer or create hierarchies of an individual’s body composition, protected class status, perceived character, capabilities, and future social outcomes based on their physical or behavioral characteristics. Physiognomic and phrenological logics are intrinsic to the technical mechanism of computer vision applied to humans. This Article observes how computer vision is a central vector for physiognomic AI technologies and unpacks how computer vision reanimates physiognomy in conception, form, and practice and the dangers this trend presents for civil liberties. This Article thus argues for legislative action to forestall and roll back the proliferation of physiognomic AI. To that end, it considers a potential menu of safeguards and limitations to significantly limit the deployment of physiognomic AI systems, which hopefully can be used to strengthen local, state, and federal legislation. This Article foregrounds its policy discussion by proposing the abolition of physiognomic AI. From there, it posits regimes of U.S. consumer protection law, biometric privacy law, and civil rights law as vehicles for rejecting physiognomy’s digital renaissance in AI. Specifically, it contends that physiognomic AI should be categorically rejected as oppressive and unjust. Second, it argues that lawmakers should declare physiognomic AI unfair and deceptive per se. Third, it proposes that lawmakers should enact or expand biometric privacy laws to prohibit physiognomic AI. Fourth, it recommends that lawmakers should prohibit physiognomic AI in places of public accommodation. It also observes the paucity of procedural and managerial regimes of fairness, accountability, and transparency in ad- dressing physiognomic AI and attend to potential counterarguments in support of physiognomic AI

PREDICT-CP: study protocol of implementation of comprehensive surveillance to predict outcomes for school-aged children with cerebral palsy

Objectives: Cerebral palsy (CP) remains the world’s most common childhood physical disability with total annual costs of care and lost well-being of $A3.87b. The PREDICT-CP (NHMRC 1077257 Partnership Project: Comprehensive surveillance to PREDICT outcomes for school age children with CP) study will investigate the influence of brain structure, body composition, dietary intake, oropharyngeal function, habitual physical activity, musculoskeletal development (hip status, bone health) and muscle performance on motor attainment, cognition, executive function, communication, participation, quality of life and related health resource use costs. The PREDICT-CP cohort provides further follow-up at 8–12 years of two overlapping preschool-age cohorts examined from 1.5 to 5 years (NHMRC 465128 motor and brain development; NHMRC 569605 growth, nutrition and physical activity). Methods and analyses: This population-based cohort study undertakes state-wide surveillance of 245 children with CP born in Queensland (birth years 2006–2009). Children will be classified for Gross Motor Function Classification System; Manual Ability Classification System, Communication Function Classification System and Eating and Drinking Ability Classification System. Outcomes include gross motor function, musculoskeletal development (hip displacement, spasticity, muscle contracture), upper limb function, communication difficulties, oropharyngeal dysphagia, dietary intake and body composition, participation, parent-reported and child-reported quality of life and medical and allied health resource use. These detailed phenotypical data will be compared with brain macrostructure and microstructure using 3 Tesla MRI (3T MRI). Relationships between brain lesion severity and outcomes will be analysed using multilevel mixed-effects models. Ethics and dissemination: The PREDICT-CP protocol is a prospectively registered and ethically accepted study protocol. The study combines data at 1.5–5 then 8–12 years of direct clinical assessment to enable prediction of outcomes and healthcare needs essential for tailoring interventions (eg, rehabilitation, orthopaedic surgery and nutritional supplements) and the projected healthcare utilisation