Gaze is not Enough: Computational Analysis of Infant’s Head Movement Measures the Developing Response to Social Interaction

Schillingmann L, Burling JM, Yoshida H, Nagai Y. Gaze is not Enough: Computational Analysis of Infant’s Head Movement Measures the Developing Response to Social Interaction. Presented at the 37th Annual Meeting of the Cognitive Science Society

How do Infants Coordinate Head and Gaze?: Computational Analysis of Infant’s First Person View in Social Interactions

Schillingmann L, Burling JM, Yoshida H, Nagai Y. How do Infants Coordinate Head and Gaze?: Computational Analysis of Infant’s First Person View in Social Interactions. Presented at the Biennial Meeting of the SRCD, Philadelphia

Evaluation of PSA and PSA Density in a Multiparametric Magnetic Resonance Imaging-Directed Diagnostic Pathway for Suspected Prostate Cancer: The INNOVATE Trial.

Objectives: To assess the clinical outcomes of mpMRI before biopsy and evaluate the space remaining for novel biomarkers. Methods: The INNOVATE study was set up to evaluate the validity of novel fluidic biomarkers in men with suspected prostate cancer who undergo pre-biopsy mpMRI. We report the characteristics of this clinical cohort, the distribution of clinical serum biomarkers, PSA and PSA density (PSAD), and compare the mpMRI Likert scoring system to the Prostate Imaging-Reporting and Data System v2.1 (PI-RADS) in men undergoing biopsy. Results: 340 men underwent mpMRI to evaluate suspected prostate cancer. 193/340 (57%) men had subsequent MRI-targeted prostate biopsy. Clinically significant prostate cancer (csigPCa), i.e., overall Gleason ≥ 3 + 4 of any length OR maximum cancer core length (MCCL) ≥4 mm of any grade including any 3 + 3, was found in 96/195 (49%) of biopsied patients. Median PSA (and PSAD) was 4.7 (0.20), 8.0 (0.17), and 9.7 (0.31) ng/mL (ng/mL/mL) in mpMRI scored Likert 3,4,5 respectively for men with csigPCa on biopsy. The space for novel biomarkers was shown to be within the group of men with mpMRI scored Likert3 (178/340) and 4 (70/350), in whom an additional of 40% (70/178) men with mpMRI-scored Likert3, and 37% (26/70) Likert4 could have been spared biopsy. PSAD is already considered clinically in this cohort to risk stratify patients for biopsy, despite this 67% (55/82) of men with mpMRI-scored Likert3, and 55% (36/65) Likert4, who underwent prostate biopsy had a PSAD below a clinical threshold of 0.15 (or 0.12 for men aged <50 years). Different thresholds of PSA and PSAD were assessed in mpMRI-scored Likert4 to predict csigPCa on biopsy, to achieve false negative levels of ≤5% the proportion of patients whom who test as above the threshold were unsuitably high at 86 and 92% of patients for PSAD and PSA respectively. When PSA was re tested in a sub cohort of men repeated PSAD showed its poor reproducibility with 43% (41/95) of patients being reclassified. After PI-RADS rescoring of the biopsied lesions, 66% (54/82) of the Likert3 lesions received a different PI-RADS score. Conclusions: The addition of simple biochemical and radiological markers (Likert and PSAD) facilitate the streamlining of the mpMRI-diagnostic pathway for suspected prostate cancer but there remains scope for improvement, in the introduction of novel biomarkers for risk assessment in Likert3 and 4 patients, future application of novel biomarkers tested in a Likert cohort would also require re-optimization around Likert3/PI-RADS2, as well as reproducibility testing

Gaze is not Enough: Computational Analysis of Infant's Head Movement Measures the Developing Response to Social Interaction

Infant eye gaze is frequently studied because of its rel- evance as an indicator of early attention and learning. However, the coupling of eye gaze with an individual's head motion is often overlooked. This paper analyzes how head motion develops within a social interaction context. To measure this interaction, we developed an approach that can estimate infant head motion from ego perspective recordings as they are typically provided by eye-tracking systems. Our method is able to quan- tify infant head motion from existing social interaction recordings even if the head was not explicitly tracked. Therefore, data from longitudinal studies that has been collected over the years can be reanalyzed in more detail. We applied our method to an existing longitudinal study of parent infant interaction and found that infants' head motion in response to social interaction shows a devel- opmental trend. Furthermore, our results indicate that this trend is less visible within gaze data alone. This suggests that head motion is an important element for understanding and measuring infants' behavior during parent-child interactions

Patterns of Saliency and Semantic Features Distinguish Gaze of Expert and Novice Viewers of Surveillance Footage

When viewing the actions of others, we not only see patterns of body movements, but we also "see" the intentions and social relations of people. Experienced forensic examiners—Closed Circuit Television (CCTV) operators—have been shown to convey superior performance in identifying and predicting hostile intentions from surveillance footages than novices. However, it remains largely unknown what visual content CCTV operators actively attend to, and whether CCTV operators develop different strategies for active information seeking from what novices do. Here, we conducted computational analysis for the gaze-centered stimuli captured by experienced CCTV operators and novices' eye movements when viewing the same surveillance footage. Low-level image features were extracted by a visual saliency model, whereas object-level semantic features were extracted by a deep convolutional neural network (DCNN), AlexNet, from gaze-centered regions. We found that the looking behavior of CCTV operators differs from novices by actively attending to different patterns of saliency and semantic features in both low-level and high-level visual processing. Expertise in selectively attending to informative features at different levels of visual hierarchy may play an important role in facilitating the efficient detection of social relationships between agents and the prediction of harmful intentions