Towards a Classifier to Recognize Emotions Using Voice to Improve Recommendations

[EN] The recognition of emotions in tone voice is currently a tool with a high potential when it comes to making recommendations, since it allows to personalize recommendations using the mood of the users as information. However, recognizing emotions using tone of voice is a complex task since it is necessary to pre-process the signal and subsequently recognize the emotion. Most of the current proposals use recurrent networks based on sequences with a temporal relationship. The disadvantage of these networks is that they have a high runtime, which makes it difficult to use in real-time applications. On the other hand, when defining this type of classifier, culture and language must be taken into account, since the tone of voice for the same emotion can vary depending on these cultural factors. In this work we propose a culturally adapted model for recognizing emotions from the voice tone using convolutional neural networks. This type of network has a relatively short execution time allowing its use in real time applications. The results we have obtained improve the current state of the art, reaching 93.6% success over the validation set.This work is partially supported by the Spanish Government project TIN2017-89156-R, GVA-CEICE project PROMETEO/2018/002, Generalitat Valenciana and European Social Fund FPI grant ACIF/2017/085, Universitat Politecnica de Valencia research grant (PAID-10-19), and by the Spanish Government (RTI2018-095390-B-C31).Fuentes-López, JM.; Taverner-Aparicio, JJ.; Rincón Arango, JA.; Botti Navarro, VJ. (2020). Towards a Classifier to Recognize Emotions Using Voice to Improve Recommendations. Springer. 218-225. https://doi.org/10.1007/978-3-030-51999-5_18S218225Balakrishnan, A., Rege, A.: Reading emotions from speech using deep neural networks. Technical report, Stanford University, Computer Science Department (2017)Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9, 1735–1780 (1997)Kerkeni, L., Serrestou, Y., Mbarki, M., Raoof, K., Mahjoub, M.: Speech emotion recognition: methods and cases study, pp. 175–182 (2018)McCluskey, K.W., Albas, D.C., Niemi, R.R., Cuevas, C., Ferrer, C.: Cross-cultural differences in the perception of the emotional content of speech: a study of the development of sensitivity in Canadian and Mexican children. Dev. Psychol. 11(5), 551 (1975)Paliwal, K.K.: Spectral subband centroid features for speech recognition. In: Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing. ICASSP 1998 (Cat. No. 98CH36181), vol. 2, pp. 617–620. IEEE (1998)Paulmann, S., Uskul, A.K.: Cross-cultural emotional prosody recognition: evidence from Chinese and British listeners. Cogn. Emot. 28(2), 230–244 (2014)Pépiot, E.: Voice, speech and gender: male-female acoustic differences and cross-language variation in English and French speakers. Corela Cogn. Représent. Lang. (HS-16) (2015)Picard, R.W., et al.: Affective computing. Perceptual Computing Section, Media Laboratory, Massachusetts Institute of Technology (1995)Rincon, J., de la Prieta, F., Zanardini, D., Julian, V., Carrascosa, C.: Influencing over people with a social emotional model. Neurocomputing 231, 47–54 (2017)Russell, J.A., Lewicka, M., Niit, T.: A cross-cultural study of a circumplex model of affect. J. Pers. Soc. Psychol. 57(5), 848 (1989)Schuller, B., Rigoll, G., Lang, M.: Hidden Markov model-based speech emotion recognition, vol. 2, pp. 401–404 (2003)Schuller, B., Villar, R., Rigoll, G., Lang, M.: Meta-classifiers in acoustic and linguistic feature fusion-based affect recognition, vol. 1, pp. 325–328 (2005)Thompson, W., Balkwill, L.-L.: Decoding speech prosody in five languages. Semiotica 2006, 407–424 (2006)Tyagi, V., Wellekens, C.: On desensitizing the Mel-cepstrum to spurious spectral components for robust speech recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. ICASSP 2005, vol. 1, pp. I–529. IEEE (2005)Ueda, M., Morishita, Y., Nakamura, T., Takata, N., Nakajima, S.: A recipe recommendation system that considers user’s mood. In: Proceedings of the 18th International Conference on Information Integration and Web-based Applications and Services, pp. 472–476. ACM (2016)Zhang, B., Quan, C., Ren, F.: Study on CNN in the recognition of emotion in audio and images. In: 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), pp. 1–5, June 201

Lessons for non-VA care delivery systems from the U.S. Department of Veterans Affairs Quality Enhancement Research Initiative: QUERI Series

The U.S. Veterans Health Administration (VHA) may have a very different structure and function from the organizations and practices that provide medical care to most Americans, but those organizations and practices could learn a lot from the VHA's Quality Enhancement Research Initiative (QUERI). There are at least six topics of increasing importance for implementation research where QUERI experience should be of value to other non-VHA organizations, both within and external to the United States: 1) Researcher-clinical leader partnerships for care improvement; 2) Attention to culture, capacity, leadership, and a supportive infrastructure; 3) Practical economic evaluation of quality implementation efforts; 4) Human subject protection problems; 5) Sustainability of improvements; and 6) Scale-up and spread of improvements

Modulation of emotional appraisal by false physiological feedback during fMRI

BACKGROUND James and Lange proposed that emotions are the perception of physiological reactions. Two-level theories of emotion extend this model to suggest that cognitive interpretations of physiological changes shape self-reported emotions. Correspondingly false physiological feedback of evoked or tonic bodily responses can alter emotional attributions. Moreover, anxiety states are proposed to arise from detection of mismatch between actual and anticipated states of physiological arousal. However, the neural underpinnings of these phenomena previously have not been examined. METHODOLOGY/PRINCIPAL FINDINGS We undertook a functional brain imaging (fMRI) experiment to investigate how both primary and second-order levels of physiological (viscerosensory) representation impact on the processing of external emotional cues. 12 participants were scanned while judging face stimuli during both exercise and non-exercise conditions in the context of true and false auditory feedback of tonic heart rate. We observed that the perceived emotional intensity/salience of neutral faces was enhanced by false feedback of increased heart rate. Regional changes in neural activity corresponding to this behavioural interaction were observed within included right anterior insula, bilateral mid insula, and amygdala. In addition, right anterior insula activity was enhanced during by asynchronous relative to synchronous cardiac feedback even with no change in perceived or actual heart rate suggesting this region serves as a comparator to detect physiological mismatches. Finally, BOLD activity within right anterior insula and amygdala predicted the corresponding changes in perceived intensity ratings at both a group and an individual level. CONCLUSIONS/SIGNIFICANCE Our findings identify the neural substrates supporting behavioural effects of false physiological feedback, and highlight mechanisms that underlie subjective anxiety states, including the importance of the right anterior insula in guiding second-order "cognitive" representations of bodily arousal state

Modulation of emotional appraisal by false physiological feedback during fMRI

BACKGROUND James and Lange proposed that emotions are the perception of physiological reactions. Two-level theories of emotion extend this model to suggest that cognitive interpretations of physiological changes shape self-reported emotions. Correspondingly false physiological feedback of evoked or tonic bodily responses can alter emotional attributions. Moreover, anxiety states are proposed to arise from detection of mismatch between actual and anticipated states of physiological arousal. However, the neural underpinnings of these phenomena previously have not been examined. METHODOLOGY/PRINCIPAL FINDINGS We undertook a functional brain imaging (fMRI) experiment to investigate how both primary and second-order levels of physiological (viscerosensory) representation impact on the processing of external emotional cues. 12 participants were scanned while judging face stimuli during both exercise and non-exercise conditions in the context of true and false auditory feedback of tonic heart rate. We observed that the perceived emotional intensity/salience of neutral faces was enhanced by false feedback of increased heart rate. Regional changes in neural activity corresponding to this behavioural interaction were observed within included right anterior insula, bilateral mid insula, and amygdala. In addition, right anterior insula activity was enhanced during by asynchronous relative to synchronous cardiac feedback even with no change in perceived or actual heart rate suggesting this region serves as a comparator to detect physiological mismatches. Finally, BOLD activity within right anterior insula and amygdala predicted the corresponding changes in perceived intensity ratings at both a group and an individual level. CONCLUSIONS/SIGNIFICANCE Our findings identify the neural substrates supporting behavioural effects of false physiological feedback, and highlight mechanisms that underlie subjective anxiety states, including the importance of the right anterior insula in guiding second-order "cognitive" representations of bodily arousal state

The effects of the neurotoxin DSP4 on spatial learning and memory in Wistar rats

The aim of the present study was to investigate the effect of DSP4-induced noradrenaline depletion on learning and memory in a spatial memory paradigm (holeboard). Since Harro et al. Brain Res 976:209–216 (2003) have demonstrated that short-term effects of DSP4 administration include both noradrenaline depletion and changes in dopamine and its metabolites—with the latter vanishing within 4 weeks after the neurotoxic lesion—the behavioural effects observed immediately after DSP4 administration cannot solely be related to noradrenaline. In the present study, spatial learning, reference memory and working memory were therefore assessed 5–10 weeks after DSP4 administration. Our results suggest that the administration of DSP4 did not lead to changes in spatial learning and memory when behavioural assessment was performed after a minimum of 5 weeks following DSP4. This lack of changes in spatial behaviour suggests that the role of noradrenaline regarding these functions may be limited. Future studies will therefore have to take into account the time-course of neurotransmitter alterations and behavioural changes following DSP4 administration

Vascular responses of the extremities to transdermal application of vasoactive agents in Caucasian and African descent individuals

This is an accepted manuscript of an article published by Springer in European Journal of Applied Physiology on 04/04/2015, available online: https://doi.org/10.1007/s00421-015-3164-2 The accepted version of the publication may differ from the final published version.© 2015, Springer-Verlag Berlin Heidelberg. Purpose: Individuals of African descent (AFD) are more susceptible to non-freezing cold injury than Caucasians (CAU) which may be due, in part, to differences in the control of skin blood flow. We investigated the skin blood flow responses to transdermal application of vasoactive agents. Methods: Twenty-four young males (12 CAU and 12 AFD) undertook three tests in which iontophoresis was used to apply acetylcholine (ACh 1 w/v %), sodium nitroprusside (SNP 0.01 w/v %) and noradrenaline (NA 0.5 mM) to the skin. The skin sites tested were: volar forearm, non-glabrous finger and toe, and glabrous finger (pad) and toe (pad). Results: In response to SNP on the forearm, AFD had less vasodilatation for a given current application than CAU (P = 0.027–0.004). ACh evoked less vasodilatation in AFD for a given application current in the non-glabrous finger and toe compared with CAU (P = 0.043–0.014) with a lower maximum vasodilatation in the non-glabrous finger (median [interquartile], AFD n = 11, 41[234] %, CAU n = 12, 351[451] %, P = 0.011) and non-glabrous toe (median [interquartile], AFD n = 9, 116[318] %, CAU n = 12, 484[720] %, P = 0.018). ACh and SNP did not elicit vasodilatation in the glabrous skin sites of either group. There were no ethnic differences in response to NA. Conclusion: AFD have an attenuated endothelium-dependent vasodilatation in non-glabrous sites of the fingers and toes compared with CAU. This may contribute to lower skin temperature following cold exposure and the increased risk of cold injuries experienced by AFD.Published versio

Invasive pleural malignant mesothelioma with rib destruction and concurrent osteosarcoma in a dog

A 7-year-old Dachshund was clinically examined because of a 10-day history of lameness in the left hind limb. On the basis of radiological and cytological findings, an osteosarcoma of the left acetabular region was suspected. The dog underwent a hemipelvectomy and osteosarcoma was diagnosed by subsequent histopathological examination. An immovable subcutaneous mass was noted on the left chest wall during the physical examination and non-septic neutrophilic inflammation was diagnosed by cytology. Forty days later, the dog showed signs of respiratory distress with an in-diameter increase of the subcutaneous mass up to 4 cm. Thoracic radiography and ultrasonography revealed pleural effusion and a lytic process in the fourth left rib. Furthermore, ultrasound examination revealed a mixed echogenic mobile structure with a diameter of around 2 cm floating within the pleural fluid of the left hemithorax close to the pericardium. The dog underwent surgery for an en bloc resection of the subcutaneous mass together with the fourth rib and the parietal pleura. Moreover, the left altered lung lobe, corresponding to the mobile structure detected by ultrasound, was removed. Based on cytological, histopathological, and immunohistochemical examinations, an invasive epithelioid pleural malignant mesothelioma was diagnosed

Clustering More than Two Million Biomedical Publications: Comparing the Accuracies of Nine Text-Based Similarity Approaches

We investigate the accuracy of different similarity approaches for clustering over two million biomedical documents. Clustering large sets of text documents is important for a variety of information needs and applications such as collection management and navigation, summary and analysis. The few comparisons of clustering results from different similarity approaches have focused on small literature sets and have given conflicting results. Our study was designed to seek a robust answer to the question of which similarity approach would generate the most coherent clusters of a biomedical literature set of over two million documents.We used a corpus of 2.15 million recent (2004-2008) records from MEDLINE, and generated nine different document-document similarity matrices from information extracted from their bibliographic records, including titles, abstracts and subject headings. The nine approaches were comprised of five different analytical techniques with two data sources. The five analytical techniques are cosine similarity using term frequency-inverse document frequency vectors (tf-idf cosine), latent semantic analysis (LSA), topic modeling, and two Poisson-based language models--BM25 and PMRA (PubMed Related Articles). The two data sources were a) MeSH subject headings, and b) words from titles and abstracts. Each similarity matrix was filtered to keep the top-n highest similarities per document and then clustered using a combination of graph layout and average-link clustering. Cluster results from the nine similarity approaches were compared using (1) within-cluster textual coherence based on the Jensen-Shannon divergence, and (2) two concentration measures based on grant-to-article linkages indexed in MEDLINE.PubMed's own related article approach (PMRA) generated the most coherent and most concentrated cluster solution of the nine text-based similarity approaches tested, followed closely by the BM25 approach using titles and abstracts. Approaches using only MeSH subject headings were not competitive with those based on titles and abstracts

The genesis of cerebellar interneurons and the prevention of neural DNA damage require XRCC1

Defective responses to DNA single strand breaks underlie various neurodegenerative diseases. However, the exact role of this repair pathway during the development and maintenance of the nervous system is unclear. Using murine neural-specific inactivation of Xrcc1, a factor that is critical for the repair of DNA single strand breaks, we found a profound neuropathology that is characterized by the loss of cerebellar interneurons. This cell loss was linked to p53-dependent cell cycle arrest and occurred as interneuron progenitors commenced differentiation. Loss of Xrcc1 also led to the persistence of DNA strand breaks throughout the nervous system and abnormal hippocampal function. Collectively, these data detail the in vivo link between DNA single strand break repair and neurogenesis and highlight the diverse consequences of specific types of genotoxic stress in the nervous system

MFN2 point mutations occur in 3.4% of Charcot-Marie-Tooth families. An investigation of 232 Norwegian CMT families

Background Point mutations in the mitofusin 2 (MFN2) gene has been identified exclusively in Charcot-Marie-Tooth type 2 (CMT2), and in a single family with intermediate CMT. MFN2 point mutations are probably the most common cause of CMT2. Methods Two-hundred and thirty-two consecutive unselected and unrelated CMT families with available DNA from all regions in Norway were included. We screened for point mutations in the MFN2 gene. Results We identified four known and three novel point mutations in 8 unrelated CMT families. The novel point mutations were not found in 100 healthy controls. This corresponds to 3.4% (8/232) of CMT families have point mutations in the MFN2 gene. The phenotypes were compatible with CMT1 in two families, CMT2 in four families, intermediate CMT in one family and distal Hereditary Motor Neuropathy (dHMN) in one family. This corresponds to 2.3% of CMT1, 5.5% of CMT2, 12.5% of intermediate CMT and 6.7% of dHMN families have a point mutation in the MFN2 gene. Point mutations in the MFN2 gene is likely to be the fourth most common cause to CMT after duplication of the peripheral myelin protein 22 (PMP22) gene, and point mutations in the Connexin32 (Cx32) and myelin protein zero (MPZ) genes. Conclusions The identified known and novel point mutations in the MFN2 gene expand the clinical spectrum from CMT2 and intermediate CMT to also include possibly CMT1 and the dHMN phenotypes. Thus, genetic analyses of the MFN2 gene should not be restricted to persons with CMT2