Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14]

Methods and techniques for analyzing human factors facets on drivers

Mención Internacional en el título de doctorWith millions of cars moving daily, driving is the most performed activity worldwide. Unfortunately, according to the World Health Organization (WHO), every year, around 1.35 million people worldwide die from road traffic accidents and, in addition, between 20 and 50 million people are injured, placing road traffic accidents as the second leading cause of death among people between the ages of 5 and 29. According to WHO, human errors, such as speeding, driving under the influence of drugs, fatigue, or distractions at the wheel, are the underlying cause of most road accidents. Global reports on road safety such as "Road safety in the European Union. Trends, statistics, and main challenges" prepared by the European Commission in 2018 presented a statistical analysis that related road accident mortality rates and periods segmented by hours and days of the week. This report revealed that the highest incidence of mortality occurs regularly in the afternoons during working days, coinciding with the period when the volume of traffic increases and when any human error is much more likely to cause a traffic accident. Accordingly, mitigating human errors in driving is a challenge, and there is currently a growing trend in the proposal for technological solutions intended to integrate driver information into advanced driving systems to improve driver performance and ergonomics. The study of human factors in the field of driving is a multidisciplinary field in which several areas of knowledge converge, among which stand out psychology, physiology, instrumentation, signal treatment, machine learning, the integration of information and communication technologies (ICTs), and the design of human-machine communication interfaces. The main objective of this thesis is to exploit knowledge related to the different facets of human factors in the field of driving. Specific objectives include identifying tasks related to driving, the detection of unfavorable cognitive states in the driver, such as stress, and, transversely, the proposal for an architecture for the integration and coordination of driver monitoring systems with other active safety systems. It should be noted that the specific objectives address the critical aspects in each of the issues to be addressed. Identifying driving-related tasks is one of the primary aspects of the conceptual framework of driver modeling. Identifying maneuvers that a driver performs requires training beforehand a model with examples of each maneuver to be identified. To this end, a methodology was established to form a data set in which a relationship is established between the handling of the driving controls (steering wheel, pedals, gear lever, and turn indicators) and a series of adequately identified maneuvers. This methodology consisted of designing different driving scenarios in a realistic driving simulator for each type of maneuver, including stop, overtaking, turns, and specific maneuvers such as U-turn and three-point turn. From the perspective of detecting unfavorable cognitive states in the driver, stress can damage cognitive faculties, causing failures in the decision-making process. Physiological signals such as measurements derived from the heart rhythm or the change of electrical properties of the skin are reliable indicators when assessing whether a person is going through an episode of acute stress. However, the detection of stress patterns is still an open problem. Despite advances in sensor design for the non-invasive collection of physiological signals, certain factors prevent reaching models capable of detecting stress patterns in any subject. This thesis addresses two aspects of stress detection: the collection of physiological values during stress elicitation through laboratory techniques such as the Stroop effect and driving tests; and the detection of stress by designing a process flow based on unsupervised learning techniques, delving into the problems associated with the variability of intra- and inter-individual physiological measures that prevent the achievement of generalist models. Finally, in addition to developing models that address the different aspects of monitoring, the orchestration of monitoring systems and active safety systems is a transversal and essential aspect in improving safety, ergonomics, and driving experience. Both from the perspective of integration into test platforms and integration into final systems, the problem of deploying multiple active safety systems lies in the adoption of monolithic models where the system-specific functionality is run in isolation, without considering aspects such as cooperation and interoperability with other safety systems. This thesis addresses the problem of the development of more complex systems where monitoring systems condition the operability of multiple active safety systems. To this end, a mediation architecture is proposed to coordinate the reception and delivery of data flows generated by the various systems involved, including external sensors (lasers, external cameras), cabin sensors (cameras, smartwatches), detection models, deliberative models, delivery systems and machine-human communication interfaces. Ontology-based data modeling plays a crucial role in structuring all this information and consolidating the semantic representation of the driving scene, thus allowing the development of models based on data fusion.I would like to thank the Ministry of Economy and Competitiveness for granting me the predoctoral fellowship BES-2016-078143 corresponding to the project TRA2015-63708-R, which provided me the opportunity of conducting all my Ph. D activities, including completing an international internship.Programa de Doctorado en Ciencia y Tecnología Informática por la Universidad Carlos III de MadridPresidente: José María Armingol Moreno.- Secretario: Felipe Jiménez Alonso.- Vocal: Luis Mart

Enhancing user experience and safety in the context of automated driving through uncertainty communication

Operators of highly automated driving systems may exhibit behaviour characteristic of overtrust issues due to an insufficient awareness of automation fallibility. Consequently, situation awareness in critical situations is reduced and safe driving performance following emergency takeovers is impeded. Previous research has indicated that conveying system uncertainties may alleviate these issues. However, existing approaches require drivers to attend the uncertainty information with focal attention, likely resulting in missed changes when engaged in non-driving-related tasks. This research project expands on existing work regarding uncertainty communication in the context of automated driving. Specifically, it aims to investigate the implications of conveying uncertainties under consideration of non-driving-related tasks and, based on the outcomes, develop and evaluate an uncertainty display that enhances both user experience and driving safety. In a first step, the impact of visually conveying uncertainties was investigated under consideration of workload, trust, monitoring behaviour, non-driving-related tasks, takeover performance, and situation awareness. For this, an anthropomorphic visual uncertainty display located in the instrument cluster was developed. While the hypothesised benefits for trust calibration and situation awareness were confirmed, the results indicate that visually conveying uncertainties leads to an increased perceived effort due to a higher frequency of monitoring glances. Building on these findings, peripheral awareness displays were explored as a means for conveying uncertainties without the need for focused attention to reduce monitoring glances. As a prerequisite for developing such a display, a systematic literature review was conducted to identify evaluation methods and criteria, which were then coerced into a comprehensive framework. Grounded in this framework, a peripheral awareness display for uncertainty communication was developed and subsequently compared with the initially proposed visual anthropomorphic uncertainty display in a driving simulator study. Eye tracking and subjective workload data indicate that the peripheral awareness display reduces the monitoring effort relative to the visual display, while driving performance and trust data highlight that the benefits of uncertainty communication are maintained. Further, this research project addresses the implications of increasing the functional detail of uncertainty information. Results of a driving simulator study indicate that particularly workload should be considered when increasing the functional detail of uncertainty information. Expanding upon this approach, an augmented reality display concept was developed and a set of visual variables was explored in a forced choice sorting task to assess their ordinal characteristics. Particularly changes in colour hue and animation-based variables received high preference ratings and were ordered consistently from low to high uncertainty. This research project has contributed a series of novel insights and ideas to the field of human factors in automated driving. It confirmed that conveying uncertainties improves trust calibration and situation awareness, but highlighted that using a visual display lessens the positive effects. Addressing this shortcoming, a peripheral awareness display was designed applying a dedicated evaluation framework. Compared with the previously employed visual display, it decreased monitoring glances and, consequentially, perceived effort. Further, an augmented reality-based uncertainty display concept was developed to minimise the workload increments associated with increases in the functional detail of uncertainty information.</div

Earth Observation Open Science and Innovation

geospatial analytics; social observatory; big earth data; open data; citizen science; open innovation; earth system science; crowdsourced geospatial data; citizen science; science in society; data scienc

Advances in Autism Research

This book represents one of the most up-to-date collections of articles on clinical practice and research in the field of Autism Spectrum Disorders (ASD). The scholars who contributed to this book are experts in their field, carrying out cutting edge research in prestigious institutes worldwide (e.g., Harvard Medical School, University of California, MIND Institute, King’s College, Karolinska Institute, and many others). The book addressed many topics, including (1) The COVID-19 pandemic; (2) Epidemiology and prevalence; (3) Screening and early behavioral markers; (4) Diagnostic and phenotypic profile; (5) Treatment and intervention; (6) Etiopathogenesis (biomarkers, biology, and genetic, epigenetic, and risk factors); (7) Comorbidity; (8) Adulthood; and (9) Broader Autism Phenotype (BAP). This book testifies to the complexity of performing research in the field of ASD. The published contributions underline areas of progress and ongoing challenges in which more certain data is expected in the coming years. It would be desirable that experts, clinicians, researchers, and trainees could have the opportunity to read this updated text describing the challenging heterogeneity of Autism Spectrum Disorder

Social work with airports passengers

Social work at the airport is in to offer to passengers social services. The main methodological position is that people are under stress, which characterized by a particular set of characteristics in appearance and behavior. In such circumstances passenger attracts in his actions some attention. Only person whom he trusts can help him with the documents or psychologically

Dictionary of World Biography

Jones, Barry Owen (1932– ). Australian politician, writer and lawyer, born in Geelong. Educated at Melbourne University, he was a public servant, high school teacher, television and radio performer, university lecturer and lawyer before serving as a Labor MP in the Victorian Parliament 1972–77 and the Australian House of Representatives 1977–98. He took a leading role in reviving the Australian film industry, abolishing the death penalty in Australia, and was the first politician to raise public awareness of global warming, the ‘post-industrial’ society, the IT revolution, biotechnology, the rise of ‘the Third Age’ and the need to preserve Antarctica as a wilderness. In the Hawke Government, he was Minister for Science 1983–90, Prices and Consumer Affairs 1987, Small Business 1987–90 and Customs 1988–90. He became a member of the Executive Board of UNESCO, Paris 1991–95 and National President of the Australian Labor Party 1992–2000, 2005–06. He was Deputy Chairman of the Constitutional Convention 1998. His books include Decades of Decision 1860– (1965), Joseph II (1968), Age of Apocalypse (1975), and he edited The Penalty is Death (1968). Sleepers, Wake!: Technology and the Future of Work was published by Oxford University Press in 1982, became a bestseller and has been translated into Chinese, Japanese, Korean, Swedish and braille. The fourth edition was published in 1995. Knowledge Courage Leadership, a collection of speeches and essays, appeared in 2016. He received a DSc for his services to science in 1988 and a DLitt in 1993 for his work on information theory. Elected FTSE (1992), FAHA (1993), FAA (1996) and FASSA (2003), he is the only person to have become a Fellow of four of Australia’s five learned Academies. Awarded an AO in 1993, named as one of Australia’s 100 ‘living national treasures’ in 1998, he was elected a Visiting Fellow Commoner of Trinity College, Cambridge in 1999. His autobiography, A Thinking Reed, was published in 2006 and The Shock of Recognition, about music and literature, in 2016. In 2014 he received an AC for services ‘as a leading intellectual in Australian public life

Dictionary of World Biography

Jones, Barry Owen (1932– ). Australian politician, writer and lawyer, born in Geelong. Educated at Melbourne University, he was a public servant, high school teacher, television and radio performer, university lecturer and lawyer before serving as a Labor MP in the Victorian Parliament 1972–77 and the Australian House of Representatives 1977–98. He took a leading role in reviving the Australian film industry, abolishing the death penalty in Australia, and was the first politician to raise public awareness of global warming, the ‘post-industrial’ society, the IT revolution, biotechnology, the rise of ‘the Third Age’ and the need to preserve Antarctica as a wilderness. In the Hawke Government, he was Minister for Science 1983–90, Prices and Consumer Affairs 1987, Small Business 1987–90 and Customs 1988–90. He became a member of the Executive Board of UNESCO, Paris 1991–95 and National President of the Australian Labor Party 1992–2000, 2005–06. He was Deputy Chairman of the Constitutional Convention 1998. His books include Decades of Decision 1860– (1965), Joseph II (1968), Age of Apocalypse (1975), and he edited The Penalty is Death (1968). Sleepers, Wake!: Technology and the Future of Work was published by Oxford University Press in 1982, became a bestseller and has been translated into Chinese, Japanese, Korean, Swedish and braille. The fourth edition was published in 1995. Knowledge Courage Leadership, a collection of speeches and essays, appeared in 2016

Dictionary of World Biography: Fourth edition

Jones, Barry Owen (1932– ). Australian politician, writer and lawyer, born in Geelong. Educated at Melbourne University, he was a public servant, high school teacher, television and radio performer, university lecturer and lawyer before serving as a Labor MP in the Victorian Parliament 1972–77 and the Australian House of Representatives 1977–98. He took a leading role in reviving the Australian film industry, abolishing the death penalty in Australia, and was the first politician to raise public awareness of global warming, the ‘post-industrial’ society, the IT revolution, biotechnology, the rise of ‘the Third Age’ and the need to preserve Antarctica as a wilderness. In the Hawke Government, he was Minister for Science 1983–90, Prices and Consumer Affairs 1987, Small Business 1987–90 and Customs 1988–90. He became a member of the Executive Board of UNESCO, Paris 1991–95 and National President of the Australian Labor Party 1992–2000, 2005–06. He was Deputy Chairman of the Constitutional Convention 1998. His books include Decades of Decision 1860– (1965), Joseph II (1968), Age of Apocalypse (1975), and he edited The Penalty is Death (1968). Sleepers, Wake!: Technology and the Future of Work was published by Oxford University Press in 1982, became a bestseller and has been translated into Chinese, Japanese, Korean, Swedish and braille. The fourth edition was published in 1995. Knowledge Courage Leadership, a collection of speeches and essays, appeared in 2016. He received a DSc for his services to science in 1988 and a DLitt in 1993 for his work on information theory. Elected FTSE (1992), FAHA (1993), FAA (1996) and FASSA (2003), he is the only person to have been elected to all four Australian learned Academies. Awarded an AO in 1993, named as one of Australia’s 100 ‘living national treasures’ in 1998, he was elected a Visiting Fellow Commoner of Trinity College, Cambridge in 1999. His autobiography, A Thinking Reed, was published in 2006 and The Shock of Recognition, about music and literature, in 2016. In 2014 he received an AC for services ‘as a leading intellectual in Australian public life’

Dictionary of World Biography: Third edition

Jones, Barry Owen (1932– ). Australian politician, writer and lawyer, born in Geelong. Educated at Melbourne University, he was a public servant, high school teacher, television and radio performer, university lecturer and lawyer before serving as a Labor MP in the Victorian Parliament 1972-77 and the Australian House of Representatives 1977-98. He took a leading role in reviving the Australian film industry, abolishing the death penalty in Australia, and was the first politician to raise public awareness of global warming, the ‘post-industrial’ society, the IT revolution, biotechnology, the rise of ‘the Third Age’ and the need to preserve Antarctica as a wilderness. In the Hawke Government, he was Minister for Science 1983-90, Prices and Consumer Affairs 1987, Small Business 1987-90 and Customs 1988-90. He became a member of the Executive Board of UNESCO, Paris 1991-95 and National President of the Australian Labor Party 1992-2000, 2005-06. He was Deputy Chairman of the Constitutional Convention 1998. His books include Decades of Decision 1860 (1965), Joseph II(1968), Age of Apocalypse (1975), and he edited The Penalty is Death (1968). Sleepers, Wake!: Technology and the Future of Workwas published by Oxford University Press in 1982, became a bestseller and has been translated into Chinese, Japanese, Korean, Swedish and braille. The fourth edition was published in 1995. He received a DSc for his services to science in 1988 and a DLitt in 1993 for his work on information theory. Elected FTSE (1992), FAHA (1993), FAA(1996) and FASSA (2003), he is the only person to have been elected to all four Australian learned Academies. Awarded an AO in 1993, named as one of Australia’s one hundred ‘living national treasures’ in 1998, he was elected a Visiting Fellow Commoner of Trinity College, Cambridge in 1999. His autobiography, A Thinking Reed, was published in 2006 and The Shock of Recognition, about music and literature, in 2016. In 2014 he received an AC for services ‘as a leading intellectual in Australian public life’