History-based visual mining of semi-structured audio and text

Accessing specific or salient parts of multimedia recordings remains a challenge as there is no obvious way of structuring and representing a mix of space-based and time-based media. A number of approaches have been proposed which usually involve translating the continuous component of the multimedia recording into a space-based representation, such as text from audio through automatic speech recognition and images from video (keyframes). In this paper, we present a novel technique which defines retrieval units in terms of a log of actions performed on space-based artefacts, and exploits timing properties and extended concurrency to construct a visual presentation of text and speech data. This technique can be easily adapted to any mix of space-based artefacts and continuous media

Gathering a corpus of multimodal computer-mediated meetings with focus on text and audio interaction

In this paper we describe the gathering of a corpus of synchronised speech and text interaction over the network. The data collection scenarios characterise audio meetings with a significant textual component. Unlike existing meeting corpora, the corpus described in this paper emphasises temporal relationships between speech and text media streams. This is achieved through detailed logging and time stamping of text editing operations, actions on shared user interface widgets and gesturing, as well as generation of speech activity profiles. A set of tools has been developed specifically for these purposes which can be used as a data collection platform for the development of meeting browsers. The data gathered to data consists of nearly 30 hours of recorded audio and time stamped editing operations and gestures

A Framework for collaborative writing with recording and post-meeting retrieval capabilities

From a HCI perspective, elucidating and supporting the context in which collaboration takes place is key to implementing successful collaborative systems. Synchronous collaborative writing usually takes place in contexts involving a “meeting” of some sort. Collaborative writing meetings can be face-to-face or, increasingly, remote Internet-based meetings. The latter presents software developers with the possibility of incorporating multimedia recording and information retrieval capabilities into the collaborative environment. The collaborative writing that ensues can be seen as an activity encompassing asynchronous as well as synchronous aspects. In order for revisions, information retrieval and other forms of post-meeting, asynchronous work to be effectively supported, the synchronous collaborative editor must be able to appropriately detect and record meeting metadata. This paper presents a collaborative editor that supports recording of user actions and explicit metadata production. Design and technical implications of introducing such capabilities are discussed with respect to document segmentation, consistency control, and awareness mechanisms

A study of clinical and information management processes in the surgical pre-assessment clinic

Establishing day-case surgery as the preferred hospital admission route for all eligible patients requires adequate preoperative assessment of patients in order to quickly distinguish those who will require minimum assessment and are suitable for day-case admission from those who will require more extensive management and will need to be admitted as inpatients. As part of a study to elucidate clinical and information management processes within the patient surgical pathway in NHS Scotland, we conducted a total of 10 in-depth semi-structured interviews during 4 visits to the Dumfries & Galloway Royal Infirmary surgical pre-assessment clinic. We modelled clinical processes using process-mapping techniques and analysed interview data using qualitative methods. We used Normalisation Process Theory as a conceptual framework to interpret the factors which were identified as facilitating or hindering information elucidation tasks and communication within the multi-disciplinary team. The pre-assessment clinic of Dumfries & Galloway Royal Infirmary was opened in 2008 in response to clinical and workflow issues which had been identified with former patient management practices in the surgical pathway. The preoperative clinic now operates under well established processes and protocols. The use of a computerised system for managing preoperative documentation substantially transformed clinical practices and facilitates communication and information-sharing among the multi-disciplinary team.ConclusionSuccessful deployment and normalisation of innovative clinical and information management processes was possible because both local and national strategic priorities were synergistic and the system was developed collaboratively by the POA staff and the health-board IT team, resulting in a highly contextualised operationalisation of clinical and information management processes. Further concerted efforts from a range of stakeholders are required to fully integrate preoperative assessment within the health-board surgical care pathway. A substantial – yet unfulfilled – potential benefit in embedding information technology in routine use within the preoperative clinic would be to improve the reporting of surgical outcomes

RECOLED: A group-aware collaborative text editor for capturing document history

This paper presents a usability analysis of RECOLED, a shared document editor which supports recording of audio communication in remote collaborative writing sessions, and transparent monitoring of interactions, such as editing, gesturing and scrolling. The editor has been designed so that the collaboration results in the production of a multimedia document history which enriches the final product of the writing activity and can serve as a basis for post-meeting information retrieval. A discussion is presented on how post-meeting processing can highlight the usefulness of such histories in terms of tracking information that would be normally lost in usual collaborative editing settings

Alternative and Augmentative Communication Technologies for Supporting Adults With Mild Intellectual Disabilities During Clinical Consultations:Scoping Review

Background: People with intellectual disabilities (IDs) face significant communication barriers when accessing health care services; they find it difficult to identify and describe conditions clearly enough to support practitioners in making an accurate diagnosis. In addition, medical professionals generally have little knowledge and understanding of the needs of people with ID, which may result in the use of consultation techniques that do not cater to their patients' skills. Objective: This review aims to identify and synthesize the literature on alternative and augmentative communication technologies that are used to support adults with mild ID during the exchange of information with medical practitioners. Methods: We performed a scoping review of studies published in English that describe the technologies that are used to promote communication with patients with mild ID during medical consultations. The databases searched were PubMed, ACM Digital Library, and Google Scholar. A qualitative framework-based approach was used to synthesize the data and discern key recurring themes across the identified literature. Results: Of the 1557 articles screened, 15 (0.96%) met our inclusion criteria. The bulk of the communication aids used focused on low-tech solutions, including patient passports, note-based prompts, Talking Mats, health diaries, and easy-read information sheets. Their influence on current practice ranged from advancing medical professionals' knowledge of the health and communication needs of people with ID to increasing interagency collaboration, patient advocacy skills, and health promotion activities. The major barriers to the implementation of low-tech aids were a lack of portability and increased maintenance efforts. Only 3 studies explored the use of mobile apps to promote communication. Their findings indicated that high-tech solutions offer greater customization with regard to the accessibility and health care needs of people with ID. Conclusions: Alternative and augmentative communication technologies have the potential to increase the quality of care provided to patients with mild ID; however, little work has been carried out in this area. Greater emphasis must be placed on (high-tech) two-way communication aids that empower patients to become involved in decisions regarding their care. Quantitative evaluation methods should be used to discern the true benefits of such aids, and researchers should describe their study protocols in depth to promote replication and generalizability

Experts Views on the Use of Mobile Devices to Support Patients with Mild Learning Disabilities During Clinical Consultations

Due to several factors including time and budget constraints, General Practitioners (GPs) are often under-trained on the communication needs of patients with learning disabilities (LDs). As such, they may find it difficult to extract accurate information from these patients. Digital technologies have the potential to alleviate communication barriers, yet their use in this context remains vastly unexplored. Hence, we conducted 2 focus groups with 12 experts in LDs to investigate how tablet applications may be used to promote the information exchange process between GPs and patients with mild LDs. The experts identified an initial set of design criteria for the future implementation of these technologies and were enthusiastic about the potential impact they may have on primary care. In addition, they also discussed a potential model for extracting medical information from this population, which focused on breaking the overall consultation down into smaller, less cognitively challenging segments

Valuing mobile health: an open-ended contingent valuation survey of a national digital health program

Background: Changing population demographics and technology developments have resulted in growing interest in the potential of consumer-facing digital health. In the United Kingdom, a £37 million (US $49 million) national digital health program delivering assisted living lifestyles at scale (dallas) aimed to deploy such technologies at scale. However, little is known about how consumers value such digital health opportunities. Objective: This study explored consumers’ perspectives on the potential value of digital health technologies, particularly mobile health (mHealth), to promote well-being by examining their willingness-to-pay (WTP) for such health solutions. Methods: A contingent valuation study involving a UK-wide survey that asked participants to report open-ended absolute and marginal WTP or willingness-to-accept for the gain or loss of a hypothetical mHealth app, Healthy Connections. Results: A UK-representative cohort (n=1697) and a dallas-like (representative of dallas intervention communities) cohort (n=305) were surveyed. Positive absolute and marginal WTP valuations of the app were identified across both cohorts (absolute WTP: UK-representative cohort £196 or US$258 and dallas-like cohort £162 or US $214; marginal WTP: UK-representative cohort £160 or US$211 and dallas-like cohort £151 or US $199). Among both cohorts, there was a high prevalence of zeros for both the absolute WTP (UK-representative cohort: 467/1697, 27.52$39,642 (0.21, 95% CI 0.14 to 0.4) and increased spending on existing phone and internet services (0.52, 95% CI 0.30 to 0.74). The amount spent on existing health apps was shown to be a positive indicator of WTP across cohorts, although the effect was marginal (UK-representative cohort 0.01, 95% CI 0.01 to 0.01; dallas-like cohort 0.01, 95% CI 0.01 to 0.02). Conclusions: This study demonstrates that consumers value mHealth solutions that promote well-being, social connectivity, and health care control, but it is not universally embraced. For mHealth to achieve its potential, apps need to be tailored to user accessibility and health needs, and more understanding of what hinders frequent users of digital technologies and those with long-term conditions is required. This novel application of WTP in a digital health context demonstrates an economic argument for investing in upskilling the population to promote access and expedite uptake and utilization of such digital health and well-being apps

Implementing a national Scottish digital health & wellbeing service at scale : a qualitative study of stakeholders' views

Digital technologies are being used as part of international efforts to revolutionize healthcare in order to meet increasing demands such as the rising burden of chronic disease and ageing populations. In Scotland there is a government push towards a national service (Living It Up) as a single point of reference where citizens can access information, products and services to support their health and wellbeing. The aim of the study is to examine implementation issues including the challenges or facilitators which can help to sustain this intervention. We gathered data in three ways: a) participant observation to gain an understanding of LiU (N=16); b) in-depth interviews (N=21) with stakeholders involved in the process; and c) analysis of documentary evidence about the progress of the implementation (N=45). Barriers included the need to “work at risk” due to delays in financing, inadequate infrastructure and skill-set deficiencies, whilst facilitators included trusted relationships, champions and a push towards normalisation. The findings suggest that a Scottish ehealth service is achievable but identifies key considerations for future large scale initiatives

Engaging in large-scale digital health technologies and services. What factors hinder recruitment?

Implementing consumer oriented digital health products and services at scale is challenging and a range of barriers to reaching and recruiting users to these types of solutions can be encountered. This paper describes the experience of implementers with the roll-out of the Delivering Assisted Living Lifestyles at Scale (dallas) programme. The findings are based on qualitative analysis of baseline and midpoint interviews and project documentation. Eight main themes emerged as key factors which hindered participation. These include how the ..