Automatic Detection and Intensity Estimation of Spontaneous Smiles

Both the occurrence and intensity of facial expression are critical to what the face reveals. While much progress has been made towards the automatic detection of expression occurrence, controversy exists about how best to estimate expression intensity. Broadly, one approach is to adapt classifiers trained on binary ground truth to estimate expression intensity. An alternative approach is to explicitly train classifiers for the estimation of expression intensity. We investigated this issue by comparing multiple methods for binary smile detection and smile intensity estimation using two large databases of spontaneous expressions. SIFT and Gabor were used for feature extraction; Laplacian Eigenmap and PCA were used for dimensionality reduction; and binary SVM margins, multiclass SVMs, and ε-SVR models were used for prediction. Both multiclass SVMs and ε-SVR classifiers explicitly trained on intensity ground truth outperformed binary SVM margins for smile intensity estimation. A surprising finding was that multiclass SVMs also outperformed binary SVM margins on binary smile detection. This suggests that training on intensity ground truth is worthwhile even for binary expression detection

Contextual influences on depressed interpersonal behavior

Clinical theories converge in hypothesizing that depression is linked to reduced interpersonal agency, which often manifests in an increase in submissive behavior. There is mounting support for this hypothesis from studies using dispositional measures of interpersonal style. However, numerous questions remain about how depression influences actual interpersonal behavior both within and across real-life situations. In particular, relatively little is known about how situational context influences depressed individuals’ interpersonal behavior. The current studies used a “multi-tiered” approach to address this gap in the literature, combining dispositional, cross-situation (i.e., ambulatory assessment), and within-situation (i.e., observational) measures of interpersonal behavior. The interpersonal dimensions of agency (i.e., dominance–submissiveness) and communion (i.e., affiliation–separation) were examined across all tiers in a large sample of clinical and community participants. Analyses revealed a more nuanced picture of depressed interpersonal behavior than a simple reduction in agency. When dispositional measures were examined, most depressed participants did endorse one of two submissive styles (i.e., submissive affiliation or submissive separation). However, a non-trivial proportion of depressed participants (e.g., those with “Cluster B” or dramatic/erratic personality traits) endorsed more dominant interpersonal styles. Thus, depression is often, but not always, linked to submissive dispositional traits. Mean differences between depressed and non-depressed participants were also subtle when cross-situation and within-situation measures were examined. Depression was associated with more negative affect during interactions and more bias when interpreting romantic partners’ behavior in terms of agency. However, significant effects of depression on participants’ overall agency and communion were not found. Rather, depressed participants were subject to most of the same interpersonal processes as non-depressed participants and differed only subtly in terms of perceptions and reactivity. Depressed or not, participants tended to match with their interaction partners on communion and mismatch on agency. They found their interaction partners’ separative behavior to be unpleasant and tended to respond to partners' negative affect with separative behavior. These results underscore the importance of understanding depressed behavior within its broader interpersonal and affective contexts. Depression may be related to a general decrease in interpersonal agency, but different situations can easily draw out different behaviors

Kinematics in Kapteyn's Selected Area 76: Orbital Motions Within the Highly Substructured Anticenter Stream

We have measured the mean three-dimensional kinematics of stars in Kapteyn's Selected Area (SA) 76 (l=209.3, b=26.4 degrees) that were selected to be Anticenter Stream (ACS) members on the basis of their radial velocities, proper motions, and location in the color-magnitude diagram. From a total of 31 stars ascertained to be ACS members primarily from its main sequence turnoff, a mean ACS radial velocity (derived from spectra obtained with the Hydra multi-object spectrograph on the WIYN 3.5m telescope) of V_helio = 97.0 +/- 2.8 km/s was determined, with an intrinsic velocity dispersion sigma_0 = 12.8 \pm 2.1 km/s. The mean absolute proper motions of these 31 ACS members are mu_alpha cos (delta) = -1.20 +/- 0.34 mas/yr and mu_delta = -0.78 \pm 0.36 mas/yr. At a distance to the ACS of 10 \pm 3 kpc, these measured kinematical quantities produce an orbit that deviates by ~30 degrees from the well-defined swath of stellar overdensity constituting the Anticenter Stream in the western portion of the Sloan Digital Sky Survey footprint. We explore possible explanations for this, and suggest that our data in SA 76 are measuring the motion of a kinematically cold sub-stream among the ACS debris that was likely a fragment of the same infalling structure that created the larger ACS system. The ACS is clearly separated spatially from the majority of claimed Monoceros ring detections in this region of the sky; however, with the data in hand, we are unable to either confirm or rule out an association between the ACS and the poorly-understood Monoceros structure.Comment: Accepted to ApJ. 48 pages, 20 figures, preprint forma

Designing real-time, continuous emotion annotation techniques for 360° VR videos

With the increasing availability of head-mounted displays (HMDs) that show immersive 360° VR content, it is important to understand to what extent these immersive experiences can evoke emotions. Typically to collect emotion ground truth labels, users rate videos through post-experience self-reports that are discrete in nature. However, post-stimuli self-reports are temporally imprecise, especially after watching 360° videos. In this work, we design six continuous emotion annotation techniques for the Oculus Rift HMD aimed at minimizing workload and distraction. Based on a co-design session with six experts, we contribute HaloLight and DotSize, two continuous annotation methods deemed unobtrusive and easy to understand. We discuss the next challenges for evaluating the usability of these techniques, and reliability of continuous annotations

Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis

Emotion is expressed in multiple modalities, yet most research has considered at most one or two. This stems in part from the lack of large, diverse, well-annotated, multimodal databases with which to develop and test algorithms. We present a well-annotated, multimodal, multidimensional spontaneous emotion corpus of 140 participants. Emotion inductions were highly varied. Data were acquired from a variety of sensors of the face that included high-resolution 3D dynamic imaging, high-resolution 2D video, and thermal (infrared) sensing, and contact physiological sensors that included electrical conductivity of the skin, respiration, blood pressure, and heart rate. Facial expression was annotated for both the occurrence and intensity of facial action units from 2D video by experts in the Facial Action Coding System (FACS). The corpus further includes derived features from 3D, 2D, and IR (infrared) sensors and baseline results for facial expression and action unit detection. The entire corpus will be made available to the research community

Kinematics of Stars in Kapteyn Selected Area 71: Sampling the Monoceros and Sagittarius Tidal Streams

We present a 3D kinematical analysis of stars located in Kapteyn Selected Area 71 (l = 167.1, b = -34.7), where previously a stellar excess was found (Dinescu et al. 2002, Newberg et al. 2002). Previous findings indicated that the stellar excess has a cold kinematical signature as inferred from proper motions, and was initially associated with debris from the Sagittarius dwarf galaxy (Sgr) -- namely the southern trailing tail. We have obtained radial velocities using the Hydra multiobject spectrograph on the WIYN 3.5 m telescope. Results for 183 proper-motion selected stars indicate that the dominant population in this stellar excess is not debris from Sgr, but rather a population that kinematically belongs to the ring-like stream that is now known as the Monoceros stream. The orbit determined for this population agrees very well with the predictions for the Monoceros stream from Penarrubia et al. (2005). The radial-velocity dispersion of this population is between 20 and 30 km/s, lower than that of the Galactic field. Also, the shape of the radial-velocity distribution shows a sharp cut-off on one side, which is more in line with model predictions of the disruption of a satellite rather than with the distribution of the Galactic field. Despite the fact that we now believe most of the stars in the stellar excess to be part of Monoceros, about ten stars in this stellar excess have highly negative radial velocities, which is a clear indication of their membership to the Sgr trailing tidal tail.Comment: Accepted for publication in the Astronomical Journal - 26 pages, 8 figures, (Figures 7 and 8 in lower resolution

Proper Motions in Kapteyn Selected Area 103: A Preliminary Orbit for the Virgo Stellar Stream

We present absolute proper motions in Kapteyn Selected Area (SA) 103. This field is located 7 degrees west of the center of the Virgo Stellar Stream (VSS, Duffau et al. 2006), and has a well-defined main sequence representing the stream. In SA 103 we identify one RR Lyrae star as a member of the VSS according to its metallicity, radial velocity and distance. VSS candidate turnoff stars and subgiant stars have proper motions consistent with that of the RR Lyrae star. The 3D velocity data imply an orbit with a pericenter of 11 kpc and an apocenter of ~90 kpc. Thus, the VSS comprises tidal debris found near the pericenter of a highly destructive orbit. Examining the six globular clusters at distances larger than 50 kpc from the Galactic center, and the proposed orbit of the VSS, we find one tentative association, NGC 2419. We speculate that NGC 2419 is possibly the nucleus of a disrupted system of which the VSS is a part.Comment: ApJL accepte

Chemical composition tuning in quaternary p-type Pb-chalcogenides – a promising strategy for enhanced thermoelectric performance

Recently a significant improvement in the thermoelectric performance of p-type ternary PbTe–PbSe and PbTe–PbS systems has been realized through alternating the electronic band structure and introducing nano-scale precipitates to bulk materials respectively. However, the quaternary system of PbTe–PbSe–PbS has received less attention. In the current work, we have excluded phase complexity by fabricating single phase sodium doped PbTe, alloyed with PbS up to its solubility limit which is extended to larger concentrations than in the ternary system of PbTe–PbS due to the presence of PbSe. We have presented a thermoelectric efficiency of approximately 1.6 which is superior to ternary PbTe–PbSe and PbTe–PbS at similar carrier concentrations and the binary PbTe, PbSe and PbS alloys. The quaternary system shows a larger Seebeck coefficient than the ternary PbTe–PbSe alloy, indicative of a wider band gap, valence band energy offset and heavier carriers effective mass. In addition, the existence of PbS in the alloy further reduces the lattice thermal conductivity originated from phonon scattering on solute atoms with high contrast atomic mass. Single phase quaternary PbTe–PbSe–PbS alloys are promising thermoelectric materials that provide high performance through adjusting the electronic band structure by regulating chemical composition