Self-Supervised Vision-Based Detection of the Active Speaker as Support for Socially-Aware Language Acquisition

This paper presents a self-supervised method for visual detection of the active speaker in a multi-person spoken interaction scenario. Active speaker detection is a fundamental prerequisite for any artificial cognitive system attempting to acquire language in social settings. The proposed method is intended to complement the acoustic detection of the active speaker, thus improving the system robustness in noisy conditions. The method can detect an arbitrary number of possibly overlapping active speakers based exclusively on visual information about their face. Furthermore, the method does not rely on external annotations, thus complying with cognitive development. Instead, the method uses information from the auditory modality to support learning in the visual domain. This paper reports an extensive evaluation of the proposed method using a large multi-person face-to-face interaction dataset. The results show good performance in a speaker dependent setting. However, in a speaker independent setting the proposed method yields a significantly lower performance. We believe that the proposed method represents an essential component of any artificial cognitive system or robotic platform engaging in social interactions.Comment: 10 pages, IEEE Transactions on Cognitive and Developmental System

Scientific access into Mercer Subglacial Lake: Scientific objectives, drilling operations and initial observations

The Subglacial Antarctic Lakes Scientific Access (SALSA) Project accessed Mercer Subglacial Lake using environmentally clean hot-water drilling to examine interactions among ice, water, sediment, rock, microbes and carbon reservoirs within the lake water column and underlying sediments. A ∼0.4 m diameter borehole was melted through 1087 m of ice and maintained over ∼10 days, allowing observation of ice properties and collection of water and sediment with various tools. Over this period, SALSA collected: 60 L of lake water and 10 L of deep borehole water; microbes \u3e0.2 μm in diameter from in situ filtration of ∼100 L of lake water; 10 multicores 0.32-0.49 m long; 1.0 and 1.76 m long gravity cores; three conductivity-temperature-depth profiles of borehole and lake water; five discrete depth current meter measurements in the lake and images of ice, the lake water-ice interface and lake sediments. Temperature and conductivity data showed the hydrodynamic character of water mixing between the borehole and lake after entry. Models simulating melting of the ∼6 m thick basal accreted ice layer imply that debris fall-out through the ∼15 m water column to the lake sediments from borehole melting had little effect on the stratigraphy of surficial sediment cores

Scientific access into Mercer Subglacial Lake: scientific objectives, drilling operations and initial observations

© The Author(s), 2021. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Priscu, J. C., Kalin, J., Winans, J., Campbell, T., Siegfried, M. R., Skidmore, M., Dore, J. E., Leventer, A., Harwood, D. M., Duling, D., Zook, R., Burnett, J., Gibson, D., Krula, E., Mironov, A., McManis, J., Roberts, G., Rosenheim, B. E., Christner, B. C., Kasic, K., Fricker, H. A., Lyons, W. B., Barker, J., Bowling, M., Collins, B., Davis, C., Gagnon, A., Gardner, C., Gustafson, C., Kim, O-S., Li, W., Michaud, A., Patterson, M. O., Tranter, M., Ryan Venturelli, R., Trista Vick-Majors, T., & Elsworth, C. Scientific access into Mercer Subglacial Lake: scientific objectives, drilling operations and initial observations. Annals of Glaciology, 62(85–86), (2021): 340–352, https://doi.org/10.1017/aog.2021.10.The Subglacial Antarctic Lakes Scientific Access (SALSA) Project accessed Mercer Subglacial Lake using environmentally clean hot-water drilling to examine interactions among ice, water, sediment, rock, microbes and carbon reservoirs within the lake water column and underlying sediments. A ~0.4 m diameter borehole was melted through 1087 m of ice and maintained over ~10 days, allowing observation of ice properties and collection of water and sediment with various tools. Over this period, SALSA collected: 60 L of lake water and 10 L of deep borehole water; microbes >0.2 μm in diameter from in situ filtration of ~100 L of lake water; 10 multicores 0.32–0.49 m long; 1.0 and 1.76 m long gravity cores; three conductivity–temperature–depth profiles of borehole and lake water; five discrete depth current meter measurements in the lake and images of ice, the lake water–ice interface and lake sediments. Temperature and conductivity data showed the hydrodynamic character of water mixing between the borehole and lake after entry. Models simulating melting of the ~6 m thick basal accreted ice layer imply that debris fall-out through the ~15 m water column to the lake sediments from borehole melting had little effect on the stratigraphy of surficial sediment cores.This material is based upon work supported by the US National Science Foundation, Section for Antarctic Sciences, Antarctic Integrated System Science program as part of the interdisciplinary (Subglacial Antarctic Lakes Scientific Access (SALSA): Integrated study of carbon cycling in hydrologically-active subglacial environments) project (NSF-OPP 1543537, 1543396, 1543405, 1543453 and 1543441). Ok-Sun Kim was funded by the Korean Polar Research Institute. We are particularly thankful to the SALSA traverse personnel for crucial technical and logistical support. The United States Antarctic Program enabled our fieldwork; the New York Air National Guard and Kenn Borek Air provided air support; UNAVCO provided geodetic instrument support. Hot water drilling activities, including repair and upgrade modifications of the WISSARD hot water drill system, for the SALSA project were supported by a subaward from the Ice Drilling Program of Dartmouth College (NSF-PLR 1327315) to the University of Nebraska-Lincoln. J. Lawrence assisted with manuscript preparation. Finally, we are grateful to C. Dean, the SALSA Project Manager, and R. Ricards, SALSA Project Coordinator at McMurdo Station, for their organizational skills, and B. Huber of Lamont-Doherty Earth Observatory for providing the SBE39 PT sensors and the Nortek Aquadopp current meter and assisting with interpretation of the data. B. Huber also provided helpful input on programing and calibrating the SBE19PlusV2 6112 CTD

A Kinect Corpus of Swedish Sign Language Signs

Abstract. We describe a corpus of Swedish sign language signs, recorded for the purpose of an educational “signing game”. The primary target group of the game is children with communicative disabilities, and the goal is to offer a playful and interactive way of learning and practicing sign language signs to these children, as well as to their friends and family. As a first step, a dataset consisting of 51 signs has been recorded for a total of 10 adult signers. The signers performed all of the signs five times and were captured with an RGB-D (Microsoft Kinect) sensor, via a purpose-built recording application

Vision-based Active Speaker Detection in Multiparty Interaction

QC 20170809</p

[Injuries in Floorball: a Questionnaire Survey in Swiss National League A Floorball Players]

BACKGROUND: Rapid changes in direction, acceleration, deceleration and deception manoeuvres with rotational movements increase the risk of injuries in floorball players. Up to date, there are no data or facts available from Swiss Floorball League players demonstrating the types of injuries that occur. This study aimed to find out which injuries occur in Swiss National League A floorball players. SUBJECTS/METHODS: This study was carried out in a retrospective, non- experimental design as a questionnaire survey. Five Swiss National League A floorball teams were interviewed in writing on an exposure period of 12 months. The injury rate describes the number of injuries per 1000 hours of exposure. The Wilcoxon rank sum test was used to assess the significance of the results. The significance level was set to p < 0.05 for all tests. RESULTS: During a calendar year, n = 71 of all players (n = 101) sustained an average of 1.14 injuries (+/- 1.05). The injury rate in the presented data set was 2.01. The injury rate in competition was two times higher than in training (rate ratio (RR) = 2.04). Most injuries were sprains, muscle injuries and inflammation, with muscle injuries almost exclusively affecting the thigh. Sprains usually occurred in the ankle. CONCLUSION: This study confirms the hypothesis that the susceptibility to injuries in floorball is significantly higher during competition compared with training. It can be assumed that players in whom physical activity triggers significant fatigue and emotional stress are more susceptible to injuries. Further studies should be performed to evaluate different preventative measures and to make a comparison on gender-specific vulnerability

2000. Recurrence of pneumonia in relation to the antibody response after pneumococcal vaccination in middle-aged and elderly

We have recently studied the efficacy of pneumococcal vaccine in preventing pneumonia recurrences after hospital treatment for community-acquired pneumonia in non-immunocompromised patients aged 50 -85 y. Among these patients, we have now compared the antibody response to the pneumococcal vaccine between patients who developed pneumonia (n =50) and patients without pneumonia recurrences (n= 100), during a mean follow-up period of 32 months after vaccination. The antibody levels of 5 pneumococcal serotypes were measured before, and 4 weeks, 1 y and 3 y after vaccination. A lower risk of pneumonia recurrences was seen in patients with antibody fold increases (FIs) \ 4 from pre-vaccination to post-vaccination compared with patients with lower FIs (p =0.02). The results suggest that in this patient category, the antibody response to pneumococcal vaccination is of importance for the risk of pneumonia recurrence