Do people trust their eyes more than their ears? media bias while seeking expert advice

Enabling users to identify trustworthy actors is a key design concern in online systems and expertise is a core dimension of trustworthiness. In this paper, we investigate (1) users' ability to identify expertise in advice and (2) effects of media bias in different representations. In a laboratory study, we presented 160 participants with two advisors-one represented by text-only; the other represented by one of four alternate formats: video, audio, avatar, or photo+text. Unknown to the participants, one was an expert (i.e. trained) and the other was a non-expert (i.e. untrained). We observed participants' advice seeking behavior under financial risk as an indicator of their trust in the advisor. For all rich media representations, participants were able to identify the expert, but we also found a tendency for seeking video and audio advice, irrespective of expertise. Avatar advice, in contrast, was rarely sought, but-like the other rich media representations-was seen as more enjoyable and friendly than text-only advice. In a future step we plan to analyze our data for effects on advice uptake

Rich Media, Poor Judgement? A Study of Media Effects on Users’ Trust in Expertise

In this paper, we investigate how interpersonal cues of expertise affect trust in different media representations. Based on a review of previous research, richer representations could lead either to a positive media bias (P1) or increased sensitivity for cues of expertise (P2). In a laboratory study, we presented 160 participants with two advisors - one represented by text-only; the other represented by one of four alternate formats: video, audio, avatar, orphoto+text. Unknown to the participants, one was an expert (i.e. trained) and the other was a non-expert (i.e. untrained). We observed participants' advice seeking and advice uptake to infer their sensitivity to correct advice in a situation of financial risk. We found that most participants preferred seeking advice from the expert, but we also found a tendency for seeking audio and in particular video advice. Users' self-reports indicate that they believed that video in particular would give them the most detailed insight into expertise. Data for advice uptake, however, showed that all media representation, including text-only, resulted in good sensitivity to correct advice

Decision-Making Amplification Under Uncertainty: An Exploratory Study of Behavioral Similarity and Intelligent Decision Support Systems

Intelligent decision systems have the potential to support and greatly amplify human decision-making across a number of industries and domains. However, despite the rapid improvement in the underlying capabilities of these “intelligent” systems, increasing their acceptance as decision aids in industry has remained a formidable challenge. If intelligent systems are to be successful, and their full impact on decision-making performance realized, a greater understanding of the factors that influence recommendation acceptance from intelligent machines is needed. Through an empirical experiment in the financial services industry, this study investigated the effects of perceived behavioral similarity (similarity state) on the dependent variables of recommendation acceptance, decision performance and decision efficiency under varying conditions of uncertainty (volatility state). It is hypothesized in this study that behavioral similarity as a design element will positively influence the acceptance rate of machine recommendations by human users. The level of uncertainty in the decision context is expected to moderate this relationship. In addition, an increase in recommendation acceptance should positively influence both decision performance and decision efficiency. The quantitative exploration of behavioral similarity as a design element revealed a number of key findings. Most importantly, behavioral similarity was found to positively influence the acceptance rate of machine recommendations. However, uncertainty did not moderate the level of recommendation acceptance as expected. The experiment also revealed that behavioral similarity positively influenced decision performance during periods of elevated uncertainty. This relationship was moderated based on the level of uncertainty in the decision context. The investigation of decision efficiency also revealed a statistically significant result. However, the results for decision efficiency were in the opposite direction of the hypothesized relationship. Interestingly, decisions made with the behaviorally similar decision aid were less efficient, based on length of time to make a decision, compared to decisions made with the low-similarity decision aid. The results of decision efficiency were stable across both levels of uncertainty in the decision context

Design and Architecture of an Ontology-driven Dialogue System for HPV Vaccine Counseling

Speech and conversational technologies are increasingly being used by consumers, with the inevitability that one day they will be integrated in health care. Where this technology could be of service is in patient-provider communication, specifically for communicating the risks and benefits of vaccines. Human papillomavirus (HPV) vaccine, in particular, is a vaccine that inoculates individuals from certain HPV viruses responsible for adulthood cancers - cervical, head and neck cancers, etc. My research focuses on the architecture and development of speech-enabled conversational agent that relies on series of consumer-centric health ontologies and the technology that utilizes these ontologies. Ontologies are computable artifacts that encode and structure domain knowledge that can be utilized by machines to provide high level capabilities, such as reasoning and sharing information. I will focus the agent’s impact on the HPV vaccine domain to observe if users would respond favorably towards conversational agents and the possible impact of the agent on their beliefs of the HPV vaccine. The approach of this study involves a multi-tier structure. The first tier is the domain knowledge base, the second is the application interaction design tier, and the third is the feasibility assessment of the participants. The research in this study proposes the following questions: Can ontologies support the system architecture for a spoken conversational agent for HPV vaccine counseling? How would prospective users’ perception towards an agent and towards the HPV vaccine be impacted after using conversational agent for HPV vaccine education? The outcome of this study is a comprehensive assessment of a system architecture of a conversational agent for patient-centric HPV vaccine counseling. Each layer of the agent architecture is regulated through domain and application ontologies, and supported by the various ontology-driven software components that I developed to compose the agent architecture. Also discussed in this work, I present preliminary evidence of high usability of the agent and improvement of the users’ health beliefs toward the HPV vaccine. All in all, I introduce a comprehensive and feasible model for the design and development of an open-sourced, ontology-driven conversational agent for any health consumer domain, and corroborate the viability of a conversational agent as a health intervention tool

Robots, Cyborgs, and Humans. A Model of Consumer Behavior in Services: A Study in the Healthcare Services Sector

La present tesi es basa en una investigació que proposa un ús futurista de l'robot i el cyborg com cirurgians oculars. El model desenvolupat investiga la intenció de l'consumidor per elegir cada cirurgià (és a dir: cirurgià robot, cirurgià cyborg o cirurgià humà). Les dades es van analitzar utilitzant la tècnica PLS-SEM. Els resultats de la investigació mostren que l'expectativa d'esforç, l'expectativa de rendiment, el risc percebut i la influència social van mostrar un impacte significatiu en la intenció d'utilitzar els serveis de l'robot cirurgià. Els resultats de el model per al cyborg cirurgià van confirmar l'impacte significatiu de l'expectativa d'esforç, l'excitació, l'expectativa de rendiment i la influència social en la intenció d'utilitzar els seus serveis. L'expectativa d'esforç i la influència social van confirmar un impacte significatiu en la intenció d'utilitzar els serveis de l'cirurgià humà. Els resultats mostren que en els tres models les variables influència social i expectativa d'esforç afecten significativament a la intenció d'utilitzar aquests serveis de cirurgia i que amb diferent intensitat entre els models per expectativa de esforç-. L'impacte de la influència social dóna una idea general sobre la naturalesa de el sector de la salut a Jordània, on una part de la societat presta més atenció a les recomanacions dels altres a l'elegir els seus cirurgians. A més, l'impacte de l'expectativa d'esforç contribueix a les expectatives per la simplicitat de l'servei dels pacients, en termes d'ús i interacció amb els cirurgians proposats. L'anàlisi multigrup va confirmar que les variables dels models estan afectant de la mateixa manera a l'comparar la intenció d'usar cyborgs i humans, i a l'comparar cyborgs i robots. No obstant això, sí que hi ha diferències significatives a l'comparar l'elecció entre robots i humans en l'impacte de l'expectativa d'esforç per utilitzar els serveis de cirurgia. D'altra banda, els participants van mostrar la seva preferència pel cirurgià humà sobre els cirurgians cyborg i robot, respectivament. Com a resultat, l'acceptació de les tecnologies de robot i cyborg per part de la societat podria donar una idea sobre la lluita esperada en el futur entre el desenvolupament de robots i la millora de les capacitats humanes.La presente tesis se basa en una investigación que propone un uso futurista del robot y el cyborg como cirujanos oculares. El modelo desarrollado investiga la intención del consumidor para elegir a cada cirujano (es decir: cirujano robot, cirujano cyborg o cirujano humano). Los datos se analizaron utilizando la técnica PLS-SEM. Los resultados de la investigación muestran que la expectativa de esfuerzo, la expectativa de rendimiento, el riesgo percibido y la influencia social mostraron un impacto significativo en la intención de utilizar los servicios del robot cirujano. Los resultados del modelo para el cyborg cirujano confirmaron el impacto significativo de la expectativa de esfuerzo, la excitación, la expectativa de rendimiento y la influencia social en la intención de usar sus servicios. La expectativa de esfuerzo y la influencia social confirmaron un impacto significativo en la intención de utilizar los servicios del cirujano humano. Los resultados muestran que en los tres modelos las variables influencia social y expectativa de esfuerzo afectan significativamente a la intención de usar esos servicios de cirugía –aunque con distinta intensidad entre los modelos para expectativa de esfuerzo-. El impacto de la influencia social da una idea general sobre la naturaleza del sector de la salud en Jordania, donde una parte de la sociedad presta más atención a las recomendaciones de los demás al elegir a sus cirujanos. Además, el impacto de la expectativa de esfuerzo contribuye a las expectativas por la simplicidad del servicio de los pacientes, en términos de uso e interacción con los cirujanos propuestos. El análisis multigrupo confirmó que las variables de los modelos están afectando de la misma manera al comparar la intención de usar cyborgs y humanos, y al comparar cyborgs y robots. Sin embargo, sí que existen diferencias significativas al comparar la elección entre robots y humanos en el impacto de la expectativa de esfuerzo para utilizar los servicios de cirugía. Por otro lado, los participantes mostraron su preferencia por el cirujano humano sobre los cirujanos cyborg y robot, respectivamente. Como resultado, la aceptación de las tecnologías de robot y cyborg por parte de la sociedad podría dar una idea sobre la lucha esperada en el futuro entre el desarrollo de robots y la mejora de las capacidades humanThe research proposes a futuristic use of robot and cyborg as surgeons in an eye surgery. Thereafter, the developed model has been applied to investigate the intention to use each surgeon (i.e. robot surgeon, cyborg surgeon, and human surgeon). The data was analyzed using the PLS-SEM technique. According to the research results, effort expectancy, performance expectancy, perceived risk, and social influence showed a significant impact on intention to use robot services. However, the results of the cyborg service model confirmed the significant impact of effort expectancy, arousal, performance expectancy, and social influence on the intention to use cyborg services. Furthermore, effort expectancy and social influence confirmed their significant impact on the intention to use human services. The results of the three models showed that the variables social influence and effort expectancy significantly affected the intention to use these surgical services, with a different intensity between the models for effort expectancy. The social influence impact gives a general idea about the nature of the healthcare sector in Jordan, where a part of society gives more attention to the recommendation from others while choosing their surgeons. Also, the effort expectancy impact contributes to patients' expectations of simplicity, in terms of use and interaction with the proposed surgeons. The multigroup analysis confirmed that the models' variables are affecting the intention to use cyborg and human service, and cyborg and robots in the same way. However, the differences were confirmed between robot and human cyborgs in terms of the impact of effort expectancy on the intention to use these services. On the other side, the participants showed their preference of the human surgeon over the cyborg and robot surgeons, respectively. As a result, the acceptance of the robot and cyborg technologies by a part of the society could give an idea about the expected struggle in the future among developing robots and enhancing human capabilities

Social cognition and robotics

In our social world we continuously display nonverbal behavior during interaction. Particularly, when meeting for the first time we use these implicit signals to form judgments about each other, which is a cornerstone of cooperation and societal cohesion. The aim of the studies presented here was to examine which gaze patterns as well as other types of nonverbal signals, such as facial expressions, gestures and kinesics are presented during interaction, which signals are preferred, and which signals we base our social judgment on. Furthermore, it was investigated whether cultural context, of German or Japanese culture, influences these interaction and decision making patterns. One part of the following dissertation concerned itself mainly with gaze behavior as it is one of the most important tools humans use to function in the natural world. It allows monitoring the environment as well as signalling towards others. Thus, measuring whether attentional resources are captured by examining potential gaze following in reaction to pointing gestures and gaze shifts of an interaction partner was one of the goals of this dissertation. However, also intercultural differences in gaze reaction towards direct gaze during various types of interaction were examined. For that purpose, a real-world dyadic interaction scenario in combination with a mobile eyetracker was used. Evidence of gaze patterns suggested that independent of culture interactants seem to mostly ignore irrelevant directional cues and instead remain focused on the face of a conversation partner, at least while listening to said partner. This was a pattern also repeated when no displays of directional signals were performed. While speaking, on the other hand, interactants from Japan seem to change their behaviour, in contrast to interactants from Germany, as they avert their gaze away from the face, which may be attributed to cultural norms. As correct assessment of another person is a critical skill for humans to possess the second part of the presented dissertation investigated on which basis humans make these social decisions. Specifically, nonverbal signals of trustworthiness and potential cooperativeness in Germany and in Japan were of interest. Thus, in one study a mobile eyetracker was used to investigate intercultural differences in gaze patterns during the social judgment process of a small number of sequentially presented potential cooperation partner. In another study participants viewed video stimuli of faces, bodies and faces + bodies of potential cooperation partner to examine the basis of social decision making in more detail and also to explore a wider variety of nonverbal behaviours in a more controlled manner. Results indicated that while judging presenters on trustworthiness based on displayed nonverbal cues German participants seem to partly look away from the face and examine the body. This is behavior in contrast to Japanese participants who seem to remain fixated mostly on the face. Furthermore, it was shown that body motion may be of particular importance for social judgment and that body motion of one’s own culture as opposed to a different culture seems to be preferred. Lastly, nonverbal signals as a basis of decision making were explored in more detail by examining the preferred interaction partner’s behaviour presented as video stimuli. In recent years and presumably also in the future, the human social environment has been growing to include new types of interactants, such as robots. To therefore ensure a smooth interaction, robots need to be adjusted according to human social expectation, including their nonverbal behavior. That is one of the reasons why all results presented here were not only put in the context of human interaction and judgment, but also viewed in the context of human-robot interaction

Social cognition and robotics

In our social world we continuously display nonverbal behavior during interaction. Particularly, when meeting for the first time we use these implicit signals to form judgments about each other, which is a cornerstone of cooperation and societal cohesion. The aim of the studies presented here was to examine which gaze patterns as well as other types of nonverbal signals, such as facial expressions, gestures and kinesics are presented during interaction, which signals are preferred, and which signals we base our social judgment on. Furthermore, it was investigated whether cultural context, of German or Japanese culture, influences these interaction and decision making patterns. One part of the following dissertation concerned itself mainly with gaze behavior as it is one of the most important tools humans use to function in the natural world. It allows monitoring the environment as well as signalling towards others. Thus, measuring whether attentional resources are captured by examining potential gaze following in reaction to pointing gestures and gaze shifts of an interaction partner was one of the goals of this dissertation. However, also intercultural differences in gaze reaction towards direct gaze during various types of interaction were examined. For that purpose, a real-world dyadic interaction scenario in combination with a mobile eyetracker was used. Evidence of gaze patterns suggested that independent of culture interactants seem to mostly ignore irrelevant directional cues and instead remain focused on the face of a conversation partner, at least while listening to said partner. This was a pattern also repeated when no displays of directional signals were performed. While speaking, on the other hand, interactants from Japan seem to change their behaviour, in contrast to interactants from Germany, as they avert their gaze away from the face, which may be attributed to cultural norms. As correct assessment of another person is a critical skill for humans to possess the second part of the presented dissertation investigated on which basis humans make these social decisions. Specifically, nonverbal signals of trustworthiness and potential cooperativeness in Germany and in Japan were of interest. Thus, in one study a mobile eyetracker was used to investigate intercultural differences in gaze patterns during the social judgment process of a small number of sequentially presented potential cooperation partner. In another study participants viewed video stimuli of faces, bodies and faces + bodies of potential cooperation partner to examine the basis of social decision making in more detail and also to explore a wider variety of nonverbal behaviours in a more controlled manner. Results indicated that while judging presenters on trustworthiness based on displayed nonverbal cues German participants seem to partly look away from the face and examine the body. This is behavior in contrast to Japanese participants who seem to remain fixated mostly on the face. Furthermore, it was shown that body motion may be of particular importance for social judgment and that body motion of one’s own culture as opposed to a different culture seems to be preferred. Lastly, nonverbal signals as a basis of decision making were explored in more detail by examining the preferred interaction partner’s behaviour presented as video stimuli. In recent years and presumably also in the future, the human social environment has been growing to include new types of interactants, such as robots. To therefore ensure a smooth interaction, robots need to be adjusted according to human social expectation, including their nonverbal behavior. That is one of the reasons why all results presented here were not only put in the context of human interaction and judgment, but also viewed in the context of human-robot interaction