Multi-modal Approach for Affective Computing

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these studies are constrained by the limitations of these modalities such as the absence of physiological biomarkers in the face-video analysis, poor spatial resolution in EEG, poor temporal resolution of the GSR etc. Scant research has been conducted to compare the merits of these modalities and understand how to best use them individually and jointly. Using multi-modal AMIGOS dataset, this study compares the performance of human emotion classification using multiple computational approaches applied to face videos and various bio-sensing modalities. Using a novel method for compensating physiological baseline we show an increase in the classification accuracy of various approaches that we use. Finally, we present a multi-modal emotion-classification approach in the domain of affective computing research.Comment: Published in IEEE 40th International Engineering in Medicine and Biology Conference (EMBC) 201

Finsler geometry on higher order tensor fields and applications to high angular resolution diffusion imaging.

We study 3D-multidirectional images, using Finsler geometry. The application considered here is in medical image analysis, specifically in High Angular Resolution Diffusion Imaging (HARDI) (Tuch et al. in Magn. Reson. Med. 48(6):1358–1372, 2004) of the brain. The goal is to reveal the architecture of the neural fibers in brain white matter. To the variety of existing techniques, we wish to add novel approaches that exploit differential geometry and tensor calculus. In Diffusion Tensor Imaging (DTI), the diffusion of water is modeled by a symmetric positive definite second order tensor, leading naturally to a Riemannian geometric framework. A limitation is that it is based on the assumption that there exists a single dominant direction of fibers restricting the thermal motion of water molecules. Using HARDI data and higher order tensor models, we can extract multiple relevant directions, and Finsler geometry provides the natural geometric generalization appropriate for multi-fiber analysis. In this paper we provide an exact criterion to determine whether a spherical function satisfies the strong convexity criterion essential for a Finsler norm. We also show a novel fiber tracking method in Finsler setting. Our model incorporates a scale parameter, which can be beneficial in view of the noisy nature of the data. We demonstrate our methods on analytic as well as simulated and real HARDI data

Assessing the Significance of Conserved Genomic Aberrations Using High Resolution Genomic Microarrays

Genomic aberrations recurrent in a particular cancer type can be important prognostic markers for tumor progression. Typically in early tumorigenesis, cells incur a breakdown of the DNA replication machinery that results in an accumulation of genomic aberrations in the form of duplications, deletions, translocations, and other genomic alterations. Microarray methods allow for finer mapping of these aberrations than has previously been possible; however, data processing and analysis methods have not taken full advantage of this higher resolution. Attention has primarily been given to analysis on the single sample level, where multiple adjacent probes are necessarily used as replicates for the local region containing their target sequences. However, regions of concordant aberration can be short enough to be detected by only one, or very few, array elements. We describe a method called Multiple Sample Analysis for assessing the significance of concordant genomic aberrations across multiple experiments that does not require a-priori definition of aberration calls for each sample. If there are multiple samples, representing a class, then by exploiting the replication across samples our method can detect concordant aberrations at much higher resolution than can be derived from current single sample approaches. Additionally, this method provides a meaningful approach to addressing population-based questions such as determining important regions for a cancer subtype of interest or determining regions of copy number variation in a population. Multiple Sample Analysis also provides single sample aberration calls in the locations of significant concordance, producing high resolution calls per sample, in concordant regions. The approach is demonstrated on a dataset representing a challenging but important resource: breast tumors that have been formalin-fixed, paraffin-embedded, archived, and subsequently UV-laser capture microdissected and hybridized to two-channel BAC arrays using an amplification protocol. We demonstrate the accurate detection on simulated data, and on real datasets involving known regions of aberration within subtypes of breast cancer at a resolution consistent with that of the array. Similarly, we apply our method to previously published datasets, including a 250K SNP array, and verify known results as well as detect novel regions of concordant aberration. The algorithm has been fully implemented and tested and is freely available as a Java application at http://www.cbil.upenn.edu/MSA

An indoor variance-based localization technique utilizing the UWB estimation of geometrical propagation parameters

A novel localization framework is presented based on ultra-wideband (UWB) channel sounding, employing a triangulation method using the geometrical properties of propagation paths, such as time delay of arrival, angle of departure, angle of arrival, and their estimated variances. In order to extract these parameters from the UWB sounding data, an extension to the high-resolution RiMAX algorithm was developed, facilitating the analysis of these frequency-dependent multipath parameters. This framework was then tested by performing indoor measurements with a vector network analyzer and virtual antenna arrays. The estimated means and variances of these geometrical parameters were utilized to generate multiple sample sets of input values for our localization framework. Next to that, we consider the existence of multiple possible target locations, which were subsequently clustered using a Kim-Parks algorithm, resulting in a more robust estimation of each target node. Measurements reveal that our newly proposed technique achieves an average accuracy of 0.26, 0.28, and 0.90 m in line-of-sight (LoS), obstructed-LoS, and non-LoS scenarios, respectively, and this with only one single beacon node. Moreover, utilizing the estimated variances of the multipath parameters proved to enhance the location estimation significantly compared to only utilizing their estimated mean values

High-Content Imaging to Phenotype Antimicrobial Effects on Individual Bacteria at Scale.

High-content imaging (HCI) is a technique for screening multiple cells in high resolution to detect subtle morphological and phenotypic variation. The method has been commonly deployed on model eukaryotic cellular systems, often for screening new drugs and targets. HCI is not commonly utilized for studying bacterial populations but may be a powerful tool in understanding and combatting antimicrobial resistance. Consequently, we developed a high-throughput method for phenotyping bacteria under antimicrobial exposure at the scale of individual bacterial cells. Imaging conditions were optimized on an Opera Phenix confocal microscope (Perkin Elmer), and novel analysis pipelines were established for both Gram-negative bacilli and Gram-positive cocci. The potential of this approach was illustrated using isolates of Klebsiella pneumoniae, Salmonella enterica serovar Typhimurium, and Staphylococcus aureus HCI enabled the detection and assessment of subtle morphological characteristics, undetectable through conventional phenotypical methods, that could reproducibly distinguish between bacteria exposed to different classes of antimicrobials with distinct modes of action (MOAs). In addition, distinctive responses were observed between susceptible and resistant isolates. By phenotyping single bacterial cells, we observed intrapopulation differences, which may be critical in identifying persistence or emerging resistance during antimicrobial treatment. The work presented here outlines a comprehensive method for investigating morphological changes at scale in bacterial populations under specific perturbation.IMPORTANCE High-content imaging (HCI) is a microscopy technique that permits the screening of multiple cells simultaneously in high resolution to detect subtle morphological and phenotypic variation. The power of this methodology is that it can generate large data sets comprised of multiple parameters taken from individual cells subjected to a range of different conditions. We aimed to develop novel methods for using HCI to study bacterial cells exposed to a range of different antibiotic classes. Using an Opera Phenix confocal microscope (Perkin Elmer) and novel analysis pipelines, we created a method to study the morphological characteristics of Klebsiella pneumoniae, Salmonella enterica serovar Typhimurium, and Staphylococcus aureus when exposed to antibacterial drugs with differing modes of action. By imaging individual bacterial cells at high resolution and scale, we observed intrapopulation differences associated with different antibiotics. The outlined methods are highly relevant for how we begin to better understand and combat antimicrobial resistance