15,026 research outputs found

    Automated Dialogue Generation for Behavior Intervention on Mobile Devices

    Get PDF
    AbstractCommunication in the form of dialogues between a virtual coach and a human patient (coachee) is one of the pillars in an intervention app for smartphones. The virtual coach is considered as a cooperative partner that supports the individual with various exercises for a behavior intervention therapy. To perform its supportive behavior, the coach follows a certain interaction model and its requirements, such as alignment, mutual commitment and adaptation. In this paper, we propose E-Coach MarkUp Language (ECML), a standard XML specification for scripting discourses that define how the virtual coach maintains a dialogue with a coachee following the interaction model. The format of the language allows messages to be tailored at a fine-grained level. Each sentence is synthesized based on the inferred goals of the coaching process and the current beliefs of the user, incorporating everything that has been said previously in the conversation. The design enables inexpensive implementation on mobile devices for a flexible, seamless coaching dialogue. With expert-based evaluations, we validated the language using scenarios on implemented ECML in the field of insomnia therapy

    A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

    Full text link
    We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility

    Conversational Sensing

    Full text link
    Recent developments in sensing technologies, mobile devices and context-aware user interfaces have made it possible to represent information fusion and situational awareness as a conversational process among actors - human and machine agents - at or near the tactical edges of a network. Motivated by use cases in the domain of security, policing and emergency response, this paper presents an approach to information collection, fusion and sense-making based on the use of natural language (NL) and controlled natural language (CNL) to support richer forms of human-machine interaction. The approach uses a conversational protocol to facilitate a flow of collaborative messages from NL to CNL and back again in support of interactions such as: turning eyewitness reports from human observers into actionable information (from both trained and untrained sources); fusing information from humans and physical sensors (with associated quality metadata); and assisting human analysts to make the best use of available sensing assets in an area of interest (governed by management and security policies). CNL is used as a common formal knowledge representation for both machine and human agents to support reasoning, semantic information fusion and generation of rationale for inferences, in ways that remain transparent to human users. Examples are provided of various alternative styles for user feedback, including NL, CNL and graphical feedback. A pilot experiment with human subjects shows that a prototype conversational agent is able to gather usable CNL information from untrained human subjects

    Digital support interventions for the self-management of low back pain: a systematic review

    Get PDF
    Background: Low back pain (LBP) is a common cause of disability and is ranked as the most burdensome health condition globally. Self-management, including components on increased knowledge, monitoring of symptoms, and physical activity, are consistently recommended in clinical guidelines as cost-effective strategies for LBP management and there is increasing interest in the potential role of digital health. Objective: The study aimed to synthesize and critically appraise published evidence concerning the use of interactive digital interventions to support self-management of LBP. The following specific questions were examined: (1) What are the key components of digital self-management interventions for LBP, including theoretical underpinnings? (2) What outcome measures have been used in randomized trials of digital self-management interventions in LBP and what effect, if any, did the intervention have on these? and (3) What specific characteristics or components, if any, of interventions appear to be associated with beneficial outcomes? Methods: Bibliographic databases searched from 2000 to March 2016 included Medline, Embase, CINAHL, PsycINFO, Cochrane Library, DoPHER and TRoPHI, Social Science Citation Index, and Science Citation Index. Reference and citation searching was also undertaken. Search strategy combined the following concepts: (1) back pain, (2) digital intervention, and (3) self-management. Only randomized controlled trial (RCT) protocols or completed RCTs involving adults with LBP published in peer-reviewed journals were included. Two reviewers independently screened titles and abstracts, full-text articles, extracted data, and assessed risk of bias using Cochrane risk of bias tool. An independent third reviewer adjudicated on disagreements. Data were synthesized narratively. Results: Of the total 7014 references identified, 11 were included, describing 9 studies: 6 completed RCTs and 3 protocols for future RCTs. The completed RCTs included a total of 2706 participants (range of 114-1343 participants per study) and varied considerably in the nature and delivery of the interventions, the duration/definition of LBP, the outcomes measured, and the effectiveness of the interventions. Participants were generally white, middle aged, and in 5 of 6 RCT reports, the majority were female and most reported educational level as time at college or higher. Only one study reported between-group differences in favor of the digital intervention. There was considerable variation in the extent of reporting the characteristics, components, and theories underpinning each intervention. None of the studies showed evidence of harm. Conclusions: The literature is extremely heterogeneous, making it difficult to understand what might work best, for whom, and in what circumstances. Participants were predominantly female, white, well educated, and middle aged, and thus the wider applicability of digital self-management interventions remains uncertain. No information on cost-effectiveness was reported. The evidence base for interactive digital interventions to support patient self-management of LBP remains weak

    Conversational agents in healthcare: a systematic review.

    Full text link
    Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917

    LLM for Test Script Generation and Migration: Challenges, Capabilities, and Opportunities

    Full text link
    This paper investigates the application of large language models (LLM) in the domain of mobile application test script generation. Test script generation is a vital component of software testing, enabling efficient and reliable automation of repetitive test tasks. However, existing generation approaches often encounter limitations, such as difficulties in accurately capturing and reproducing test scripts across diverse devices, platforms, and applications. These challenges arise due to differences in screen sizes, input modalities, platform behaviors, API inconsistencies, and application architectures. Overcoming these limitations is crucial for achieving robust and comprehensive test automation. By leveraging the capabilities of LLMs, we aim to address these challenges and explore its potential as a versatile tool for test automation. We investigate how well LLMs can adapt to diverse devices and systems while accurately capturing and generating test scripts. Additionally, we evaluate its cross-platform generation capabilities by assessing its ability to handle operating system variations and platform-specific behaviors. Furthermore, we explore the application of LLMs in cross-app migration, where it generates test scripts across different applications and software environments based on existing scripts. Throughout the investigation, we analyze its adaptability to various user interfaces, app architectures, and interaction patterns, ensuring accurate script generation and compatibility. The findings of this research contribute to the understanding of LLMs' capabilities in test automation. Ultimately, this research aims to enhance software testing practices, empowering app developers to achieve higher levels of software quality and development efficiency.Comment: Accepted by the 23rd IEEE International Conference on Software Quality, Reliability, and Security (QRS 2023
    • …
    corecore