SALSA: A Novel Dataset for Multimodal Group Behavior Analysis

Studying free-standing conversational groups (FCGs) in unstructured social settings (e.g., cocktail party ) is gratifying due to the wealth of information available at the group (mining social networks) and individual (recognizing native behavioral and personality traits) levels. However, analyzing social scenes involving FCGs is also highly challenging due to the difficulty in extracting behavioral cues such as target locations, their speaking activity and head/body pose due to crowdedness and presence of extreme occlusions. To this end, we propose SALSA, a novel dataset facilitating multimodal and Synergetic sociAL Scene Analysis, and make two main contributions to research on automated social interaction analysis: (1) SALSA records social interactions among 18 participants in a natural, indoor environment for over 60 minutes, under the poster presentation and cocktail party contexts presenting difficulties in the form of low-resolution images, lighting variations, numerous occlusions, reverberations and interfering sound sources; (2) To alleviate these problems we facilitate multimodal analysis by recording the social interplay using four static surveillance cameras and sociometric badges worn by each participant, comprising the microphone, accelerometer, bluetooth and infrared sensors. In addition to raw data, we also provide annotations concerning individuals' personality as well as their position, head, body orientation and F-formation information over the entire event duration. Through extensive experiments with state-of-the-art approaches, we show (a) the limitations of current methods and (b) how the recorded multiple cues synergetically aid automatic analysis of social interactions. SALSA is available at http://tev.fbk.eu/salsa.Comment: 14 pages, 11 figure

Explicit and Inferred Motives for Nonsuicidal Self-Injurious Acts and Urges in Borderline and Avoidant Personality Disorders

Nonsuicidal self-injury (NSSI) is a perplexing phenomenon that may have differing motives. The present study used experience sampling methods (ESM) which inquired explicitly about the motives for NSSI, but also enabled a temporal examination of the antecedents/consequences of NSSI; these allow us to infer other motives which were not explicitly endorsed. Adults (n = 152, aged 18–65) with borderline personality disorder (BPD), avoidant personality disorder (APD), or no psychopathology participated in a 3-week computerized diary study. We examined 5 classes of explicit motives for engaging in NSSI, finding support primarily for internally directed rather than interpersonally directed ones. We then used multilevel regression to examine changes in affect, cognition, and behavior surrounding moments of NSSI acts/urges compared with control moments (i.e., without NSSI). We examined changes in 5 scales of inferred motives, designed to correspond to the 5 classes of explicit motives. The results highlight differing motives for NSSI among individuals with BPD and APD, with some similarities (mostly in the explicit motives) and some differences (mostly in the inferred motives) between the disorders. Despite their infrequent explicit endorsement, fluctuations in interpersonally oriented scales were found surrounding NSSI acts/urges. This highlights the need to continue attending to interpersonal aspects of NSSI in research and in clinical practice. Additionally, NSSI urges, like acts, were followed by decline in affective/interpersonal distress (although in a delayed manner). Thus, interventions that build distress tolerance and enhance awareness for affective changes, and for antecedent/consequence patterns in NSSI, could help individuals resist the urge to self-injure

Academic Performance and Behavioral Patterns

Identifying the factors that influence academic performance is an essential part of educational research. Previous studies have documented the importance of personality traits, class attendance, and social network structure. Because most of these analyses were based on a single behavioral aspect and/or small sample sizes, there is currently no quantification of the interplay of these factors. Here, we study the academic performance among a cohort of 538 undergraduate students forming a single, densely connected social network. Our work is based on data collected using smartphones, which the students used as their primary phones for two years. The availability of multi-channel data from a single population allows us to directly compare the explanatory power of individual and social characteristics. We find that the most informative indicators of performance are based on social ties and that network indicators result in better model performance than individual characteristics (including both personality and class attendance). We confirm earlier findings that class attendance is the most important predictor among individual characteristics. Finally, our results suggest the presence of strong homophily and/or peer effects among university students