Towards a Classifier to Recognize Emotions Using Voice to Improve Recommendations

[EN] The recognition of emotions in tone voice is currently a tool with a high potential when it comes to making recommendations, since it allows to personalize recommendations using the mood of the users as information. However, recognizing emotions using tone of voice is a complex task since it is necessary to pre-process the signal and subsequently recognize the emotion. Most of the current proposals use recurrent networks based on sequences with a temporal relationship. The disadvantage of these networks is that they have a high runtime, which makes it difficult to use in real-time applications. On the other hand, when defining this type of classifier, culture and language must be taken into account, since the tone of voice for the same emotion can vary depending on these cultural factors. In this work we propose a culturally adapted model for recognizing emotions from the voice tone using convolutional neural networks. This type of network has a relatively short execution time allowing its use in real time applications. The results we have obtained improve the current state of the art, reaching 93.6% success over the validation set.This work is partially supported by the Spanish Government project TIN2017-89156-R, GVA-CEICE project PROMETEO/2018/002, Generalitat Valenciana and European Social Fund FPI grant ACIF/2017/085, Universitat Politecnica de Valencia research grant (PAID-10-19), and by the Spanish Government (RTI2018-095390-B-C31).Fuentes-López, JM.; Taverner-Aparicio, JJ.; Rincón Arango, JA.; Botti Navarro, VJ. (2020). Towards a Classifier to Recognize Emotions Using Voice to Improve Recommendations. Springer. 218-225. https://doi.org/10.1007/978-3-030-51999-5_18S218225Balakrishnan, A., Rege, A.: Reading emotions from speech using deep neural networks. Technical report, Stanford University, Computer Science Department (2017)Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9, 1735–1780 (1997)Kerkeni, L., Serrestou, Y., Mbarki, M., Raoof, K., Mahjoub, M.: Speech emotion recognition: methods and cases study, pp. 175–182 (2018)McCluskey, K.W., Albas, D.C., Niemi, R.R., Cuevas, C., Ferrer, C.: Cross-cultural differences in the perception of the emotional content of speech: a study of the development of sensitivity in Canadian and Mexican children. Dev. Psychol. 11(5), 551 (1975)Paliwal, K.K.: Spectral subband centroid features for speech recognition. In: Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing. ICASSP 1998 (Cat. No. 98CH36181), vol. 2, pp. 617–620. IEEE (1998)Paulmann, S., Uskul, A.K.: Cross-cultural emotional prosody recognition: evidence from Chinese and British listeners. Cogn. Emot. 28(2), 230–244 (2014)Pépiot, E.: Voice, speech and gender: male-female acoustic differences and cross-language variation in English and French speakers. Corela Cogn. Représent. Lang. (HS-16) (2015)Picard, R.W., et al.: Affective computing. Perceptual Computing Section, Media Laboratory, Massachusetts Institute of Technology (1995)Rincon, J., de la Prieta, F., Zanardini, D., Julian, V., Carrascosa, C.: Influencing over people with a social emotional model. Neurocomputing 231, 47–54 (2017)Russell, J.A., Lewicka, M., Niit, T.: A cross-cultural study of a circumplex model of affect. J. Pers. Soc. Psychol. 57(5), 848 (1989)Schuller, B., Rigoll, G., Lang, M.: Hidden Markov model-based speech emotion recognition, vol. 2, pp. 401–404 (2003)Schuller, B., Villar, R., Rigoll, G., Lang, M.: Meta-classifiers in acoustic and linguistic feature fusion-based affect recognition, vol. 1, pp. 325–328 (2005)Thompson, W., Balkwill, L.-L.: Decoding speech prosody in five languages. Semiotica 2006, 407–424 (2006)Tyagi, V., Wellekens, C.: On desensitizing the Mel-cepstrum to spurious spectral components for robust speech recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. ICASSP 2005, vol. 1, pp. I–529. IEEE (2005)Ueda, M., Morishita, Y., Nakamura, T., Takata, N., Nakajima, S.: A recipe recommendation system that considers user’s mood. In: Proceedings of the 18th International Conference on Information Integration and Web-based Applications and Services, pp. 472–476. ACM (2016)Zhang, B., Quan, C., Ren, F.: Study on CNN in the recognition of emotion in audio and images. In: 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), pp. 1–5, June 201

ME3CA - Monitoring environment exercise and emotion by a cognitive assistant

The elderly population has increased dramatically in today’s society. This fact implies the need to propose new policies of attention to this group but without increasing social spending. Currently, there is a need to promote the care of elderly people in their own homes, avoiding being transferred to saturated residences. Bearing this in mind, in recent years numerous approaches have tried to offer solutions in this sense using the continuous advances in new information and communication technologies. In this way, this article proposes the employment of a personal assistant to help the elderly in the development of their daily life activities. The proposed system, called ME3CA, is a cognitive assistant that involves users in rehabilitating exercise, consisting of a sensorization platform and different integrated decision-making mechanisms. The system tries to plan and recommend activities to older people trying to improve their physical activity. In addition, in the decision making process the assistant takes into account the emotions of the user. In this way, the system is more personalized and emotionally intelligent.- (undefined

Assessment of Chemical Inhibitor Addition to Improve the Gas Production from Biowaste

The coexistence of sulphate-reducing bacteria and methanogenic archaea in the reactors during the anaerobic digestion from sulphate-containing waste could favor the accumulation of sulfide on the biogas, and therefore reduce its quality. In this study, the effect of sulphate-reducing bacteria inhibitor (MoO−2 4 ) addition in a two phase system from sulphate-containing municipal solid waste to improve the quality of the biogas has been investigated. The results showed that although SRB and sulphide production decreased, the use of inhibitor was not effective to improve the anaerobic digestion in a two phase system from sulphate-containing waste, since a significant decrease on biogas and organic matter removal were observed. Before MoO−2 4 addition the average values of volatile solid were around 12 g/kg, after 5 days of inhibitor use, those values did exceed to 28 g/kg. Molybdate caused acidification in the reactor and it was according to decrease in the pH values. In relation to microbial consortia, the effect of inhibitor was a decrease in Bacteria (44%; 60% in sulphate-reducing bacteria) and Archaea (38%) population

Toll-like receptor signaling adapter proteins govern spread of neuropathic pain and recovery following nerve injury in male mice.

BackgroundSpinal Toll-like receptors (TLRs) and signaling intermediaries have been implicated in persistent pain states. We examined the roles of two major TLR signaling pathways and selected TLRs in a mononeuropathic allodynia.MethodsL5 spinal nerve ligation (SNL) was performed in wild type (WT, C57BL/6) male and female mice and in male Tlr2-/-Tlr3-/-, Tlr4-/-, Tlr5-/-, Myd88-/-, Triflps2, Myd88/Triflps2, Tnf-/-, and Ifnar1-/- mice. We also examined L5 ligation in Tlr4-/- female mice. We examined tactile allodynia using von Frey hairs. Iba-1 (microglia) and GFAP (astrocytes) were assessed in spinal cords by immunostaining. Tactile thresholds were analyzed by 1- and 2-way ANOVA and the Bonferroni post hoc test was used.ResultsIn WT male and female mice, SNL lesions resulted in a persistent and robust ipsilateral, tactile allodynia. In males with TLR2, 3, 4, or 5 deficiencies, tactile allodynia was significantly, but incompletely, reversed (approximately 50%) as compared to WT. This effect was not seen in female Tlr4-/- mice. Increases in ipsilateral lumbar Iba-1 and GFAP were seen in mutant and WT mice. Mice deficient in MyD88, or MyD88 and TRIF, showed an approximately 50% reduction in withdrawal thresholds and reduced ipsilateral Iba-1. In contrast, TRIF and interferon receptor null mice developed a profound ipsilateral and contralateral tactile allodynia. In lumbar sections of the spinal cords, we observed a greater increase in Iba-1 immunoreactivity in the TRIF-signaling deficient mice as compared to WT, but no significant increase in GFAP. Removing MyD88 abrogated the contralateral allodynia in the TRIF signaling-deficient mice. Conversely, IFNβ, released downstream to TRIF signaling, administered intrathecally, temporarily reversed the tactile allodynia.ConclusionsThese observations suggest a critical role for the MyD88 pathway in initiating neuropathic pain, but a distinct role for the TRIF pathway and interferon in regulating neuropathic pain phenotypes in male mice

Modulating sensitivity to drug-induced apoptosis: the future for chemotherapy?

Drug resistance is a fundamental problem in the treatment of most common human cancers. Our understanding of the cellular mechanisms underlying death and survival has allowed the development of rational approaches to overcoming drug resistance. The mitogen activated protein kinase family of protein serine/threonine kinases has been implicated in this complex web of signalling, with some members acting to enhance death and other members to prevent it. A recent publication by MacKeigan et al is the first to demonstrate an enhancement of drug-induced cell death by simultaneous blockade of MEK-mediated survival signalling, and offers the potential for targeted adjuvant therapy as a means of overcoming drug resistance

Weekly dose-dense chemotherapy in first-line epithelial ovarian, fallopian tube, or primary peritoneal cancer treatment (ICON8): overall survival results from an open-label, randomised, controlled, phase 3 trial

BACKGROUND: Standard-of-care first-line chemotherapy for epithelial ovarian cancer is carboplatin and paclitaxel administered once every 3 weeks. The JGOG 3016 trial reported significant improvement in progression-free and overall survival with dose-dense weekly paclitaxel and 3-weekly (ie, once every 3 weeks) carboplatin. However, this benefit was not observed in the previously reported progression-free survival results of ICON8. Here, we present the final coprimary outcomes of overall survival and updated progression-free survival analyses of ICON8. METHODS: In this open-label, randomised, controlled, phase 3 trial (ICON8), women aged 18 years or older with newly diagnosed stage IC-IV epithelial ovarian, primary peritoneal, or fallopian tube carcinoma (here collectively termed ovarian cancer, as defined by International Federation of Gynecology and Obstetrics [FIGO] 1988 criteria) and an Eastern Cooperative Oncology Group performance status of 0-2 were recruited from 117 hospitals with oncology departments in the UK, Australia and New Zealand, Mexico, South Korea, and Ireland. Patients could enter the trial after immediate primary surgery (IPS) or with planned delayed primary surgery (DPS) during chemotherapy, or could have no planned surgery. Participants were randomly assigned (1:1:1), using the Medical Research Council Clinical Trials Unit at University College London randomisation line with stratification by Gynecologic Cancer Intergroup group, FIGO disease stage, and outcome and timing of surgery, to either 3-weekly carboplatin area under the curve (AUC)5 or AUC6 and 3-weekly paclitaxel 175 mg/m2 (control; group 1), 3-weekly carboplatin AUC5 or AUC6 and weekly paclitaxel 80 mg/m2 (group 2), or weekly carboplatin AUC2 and weekly paclitaxel 80 mg/m2 (group 3), all administered via intravenous infusion for a total of six 21-day cycles. Coprimary outcomes were progression-free survival and overall survival, with comparisons done between group 2 and group 1, and group 3 and group 1, in the intention-to-treat population. Safety was assessed in all patients who started at least one chemotherapy cycle. The trial is registered on ClinicalTrials.gov, NCT01654146, and ISRCTN registry, ISRCTN10356387, and is closed to accrual. FINDINGS: Between June 6, 2011, and Nov 28, 2014, 1566 patients were randomly assigned to group 1 (n=522), group 2 (n=523), or group 3 (n=521). The median age was 62 years (IQR 54-68), 1073 (69%) of 1566 patients had high-grade serous carcinoma, 1119 (71%) had stage IIIC-IV disease, and 745 (48%) had IPS. As of data cutoff (March 31, 2020), with a median follow-up of 69 months (IQR 61-75), no significant difference in overall survival was observed in either comparison: median overall survival of 47·4 months (95% CI 43·1-54·8) in group 1, 54·8 months (46·6-61·6) in group 2, and 53·4 months (49·2-59·6) in group 3 (group 2 vs group 1: hazard ratio 0·87 [97·5% CI 0·73-1·05]; group 3 vs group 1: 0·91 [0·76-1·09]). No significant difference was observed for progression-free survival in either comparison and evidence of non-proportional hazards was seen (p=0·037), with restricted mean survival time of 23·9 months (97·5% CI 22·1-25·6) in group 1, 25·3 months (23·6-27·1) in group 2, and 24·8 months (23·0-26·5) in group 3. The most common grade 3-4 adverse events were reduced neutrophil count (78 [15%] of 511 patients in group 1, 183 [36%] of 514 in group 2, and 154 [30%] of 513 in group 3), reduced white blood cell count (22 [4%] in group 1, 80 [16%] in group 2, and 71 [14%] in group 3), and anaemia (26 [5%] in group 1, 66 [13%] in group 2, and 24 [5%] in group 3). No new serious adverse events were reported. Seven treatment-related deaths were reported (two in group 1, four in group 2, and one in group 3). INTERPRETATION: In our cohort of predominantly European women with epithelial ovarian cancer, we found that first-line weekly dose-dense chemotherapy did not improve overall or progression-free survival compared with standard 3-weekly chemotherapy and should not be used as part of standard multimodality front-line therapy in this patient group. FUNDING: Cancer Research UK, Medical Research Council, Health Research Board in Ireland, Irish Cancer Society, and Cancer Australia

An integration of enhanced social force and crowd control models for high-density crowd simulation

Social force model is one of the well-known approaches that can successfully simulate pedestrians’ movements realistically. However, it is not suitable to simulate high-density crowd movement realistically due to the model having only three basic crowd characteristics which are goal, attraction, and repulsion. Therefore, it does not satisfy the high-density crowd condition which is complex yet unique, due to its capacity, density, and various demographic backgrounds of the agents. Thus, this research proposes a model that improves the social force model by introducing four new characteristics which are gender, walking speed, intention outlook, and grouping to make simulations more realistic. Besides, the high-density crowd introduces irregular behaviours in the crowd flow, which is stopping motion within the crowd. To handle these scenarios, another model has been proposed that controls each agent with two different states: walking and stopping. Furthermore, the stopping behaviour was categorized into a slow stop and sudden stop. Both of these proposed models were integrated to form a high-density crowd simulation framework. The framework has been validated by using the comparison method and fundamental diagram method. Based on the simulation of 45,000 agents, it shows that the proposed framework has a more accurate average walking speed (0.36 m/s) compared to the conventional social force model (0.61 m/s). Both of these results are compared to the real-world data which is 0.3267 m/s. The findings of this research will contribute to the simulation activities of pedestrians in a highly dense population

A Novel DC Therapy with Manipulation of MKK6 Gene on Nickel Allergy in Mice

BACKGROUND: Although the activation of dermal dendritic cells (DCs) or Langerhans cells (LCs) via p38 mitogen-activated protein kinase (MAPK) plays a crucial role in the pathogenesis of metal allergy, the in vivo molecular mechanisms have not been identified and a possible therapeutic strategy using the control of dermal DCs or LCs has not been established. In this study, we focused on dermal DCs to define the in vivo mechanisms of metal allergy pathogenesis in a mouse nickel (Ni) allergy model. The effects of DC therapy on Ni allergic responses were also investigated. METHODS AND FINDING: The activation of dermal DCs via p38 MAPK triggered a T cell-mediated allergic immune response in this model. In the MAPK signaling cascade in DCs, Ni potently phosphorylated MAP kinase kinase 6 (MKK6) following increased DC activation. Ni-stimulated DCs could prime T cell activation to induce Ni allergy. Interestingly, when MKK6 gene-transfected DCs were transferred into the model mice, a more pronounced allergic reaction was observed. In addition, injection of short interfering (si) RNA targeting the MKK6 gene protected against a hypersensitivity reaction after Ni immunization. The cooperative action between T cell activation and MKK6-mediated DC activation by Ni played an important role in the development of Ni allergy. CONCLUSIONS: DC activation by Ni played an important role in the development of Ni allergy. Manipulating the MKK6 gene in DCs may be a good therapeutic strategy for dermal Ni allergy

Electronic structure, linear, nonlinear optical susceptibilities and birefringence of CuInX2 (X = S, Se, Te) chalcopyrite-structure compounds

The electronic structure, linear and nonlinear optical properties have been calculated for CuInX2 (X=S, Se, Te) chalcopyrite-structure single crystals using the state-of-the-art full potential linear augmented plane wave (FP-LAPW) method. We present results for band structure, density of states, and imaginary part of the frequency-dependent linear and nonlinear optical susceptibilities. We find that these crystals are semiconductors with direct band gaps. We have calculated the birefringence of these crystals. The birefringence is negative for CuInS2 and CuInSe2 while it is positive for CuInTe2 in agreement with the experimental data. Calculations are reported for the frequency-dependent complex second-order non-linear optical susceptibilities . The intra-band and inter-band contributions to the second harmonic generation increase when we replace S by Se and decrease when we replace Se by Te. We find that smaller energy band gap compounds have larger values of in agreement with the experimental data and previous theoretical calculations.Comment: 17 pages, 6 figure