Gathering a corpus of multimodal computer-mediated meetings with focus on text and audio interaction

In this paper we describe the gathering of a corpus of synchronised speech and text interaction over the network. The data collection scenarios characterise audio meetings with a significant textual component. Unlike existing meeting corpora, the corpus described in this paper emphasises temporal relationships between speech and text media streams. This is achieved through detailed logging and time stamping of text editing operations, actions on shared user interface widgets and gesturing, as well as generation of speech activity profiles. A set of tools has been developed specifically for these purposes which can be used as a data collection platform for the development of meeting browsers. The data gathered to data consists of nearly 30 hours of recorded audio and time stamped editing operations and gestures

A Framework for collaborative writing with recording and post-meeting retrieval capabilities

From a HCI perspective, elucidating and supporting the context in which collaboration takes place is key to implementing successful collaborative systems. Synchronous collaborative writing usually takes place in contexts involving a “meeting” of some sort. Collaborative writing meetings can be face-to-face or, increasingly, remote Internet-based meetings. The latter presents software developers with the possibility of incorporating multimedia recording and information retrieval capabilities into the collaborative environment. The collaborative writing that ensues can be seen as an activity encompassing asynchronous as well as synchronous aspects. In order for revisions, information retrieval and other forms of post-meeting, asynchronous work to be effectively supported, the synchronous collaborative editor must be able to appropriately detect and record meeting metadata. This paper presents a collaborative editor that supports recording of user actions and explicit metadata production. Design and technical implications of introducing such capabilities are discussed with respect to document segmentation, consistency control, and awareness mechanisms

History-based visual mining of semi-structured audio and text

Accessing specific or salient parts of multimedia recordings remains a challenge as there is no obvious way of structuring and representing a mix of space-based and time-based media. A number of approaches have been proposed which usually involve translating the continuous component of the multimedia recording into a space-based representation, such as text from audio through automatic speech recognition and images from video (keyframes). In this paper, we present a novel technique which defines retrieval units in terms of a log of actions performed on space-based artefacts, and exploits timing properties and extended concurrency to construct a visual presentation of text and speech data. This technique can be easily adapted to any mix of space-based artefacts and continuous media

A study of clinical and information management processes in the surgical pre-assessment clinic

Establishing day-case surgery as the preferred hospital admission route for all eligible patients requires adequate preoperative assessment of patients in order to quickly distinguish those who will require minimum assessment and are suitable for day-case admission from those who will require more extensive management and will need to be admitted as inpatients. As part of a study to elucidate clinical and information management processes within the patient surgical pathway in NHS Scotland, we conducted a total of 10 in-depth semi-structured interviews during 4 visits to the Dumfries & Galloway Royal Infirmary surgical pre-assessment clinic. We modelled clinical processes using process-mapping techniques and analysed interview data using qualitative methods. We used Normalisation Process Theory as a conceptual framework to interpret the factors which were identified as facilitating or hindering information elucidation tasks and communication within the multi-disciplinary team. The pre-assessment clinic of Dumfries & Galloway Royal Infirmary was opened in 2008 in response to clinical and workflow issues which had been identified with former patient management practices in the surgical pathway. The preoperative clinic now operates under well established processes and protocols. The use of a computerised system for managing preoperative documentation substantially transformed clinical practices and facilitates communication and information-sharing among the multi-disciplinary team.ConclusionSuccessful deployment and normalisation of innovative clinical and information management processes was possible because both local and national strategic priorities were synergistic and the system was developed collaboratively by the POA staff and the health-board IT team, resulting in a highly contextualised operationalisation of clinical and information management processes. Further concerted efforts from a range of stakeholders are required to fully integrate preoperative assessment within the health-board surgical care pathway. A substantial – yet unfulfilled – potential benefit in embedding information technology in routine use within the preoperative clinic would be to improve the reporting of surgical outcomes

RECOLED: A group-aware collaborative text editor for capturing document history

This paper presents a usability analysis of RECOLED, a shared document editor which supports recording of audio communication in remote collaborative writing sessions, and transparent monitoring of interactions, such as editing, gesturing and scrolling. The editor has been designed so that the collaboration results in the production of a multimedia document history which enriches the final product of the writing activity and can serve as a basis for post-meeting information retrieval. A discussion is presented on how post-meeting processing can highlight the usefulness of such histories in terms of tracking information that would be normally lost in usual collaborative editing settings

Engaging in large-scale digital health technologies and services. What factors hinder recruitment?

Implementing consumer oriented digital health products and services at scale is challenging and a range of barriers to reaching and recruiting users to these types of solutions can be encountered. This paper describes the experience of implementers with the roll-out of the Delivering Assisted Living Lifestyles at Scale (dallas) programme. The findings are based on qualitative analysis of baseline and midpoint interviews and project documentation. Eight main themes emerged as key factors which hindered participation. These include how the ..

Implementation factors affecting the large-scale deployment of digital health and well-being technologies : a qualitative study of the initial phases of the ‘Living-It-Up’programme

Little is known about the factors which facilitate or impede the large-scale deployment of health and well-being consumer technologies. The Living-It-Up project is a large-scale digital intervention led by NHS 24, aiming to transform health and well-being services delivery throughout Scotland. We conducted a qualitative study of the factors affecting the implementation and deployment of the Living-It-Up services. We collected a range of data during the initial phase of deployment, including semi-structured interviews (N = 6); participant observation sessions (N = 5) and meetings with key stakeholders (N = 3). We used the Normalisation Process Theory as an explanatory framework to interpret the social processes at play during the initial phases of deployment.Initial findings illustrate that it is clear - and perhaps not surprising - that the size and diversity of the Living-It-Up consortium made implementation processes more complex within a 'multi-stakeholder' environment. To overcome these barriers, there is a need to clearly define roles, tasks and responsibilities among the consortium partners. Furthermore, varying levels of expectations and requirements, as well as diverse cultures and ways of working, must be effectively managed. Factors which facilitated implementation included extensive stakeholder engagement, such as co-design activities, which can contribute to an increased 'buy-in' from users in the long term. An important lesson from the Living-It-Up initiative is that attempting to co-design innovative digital services, but at the same time, recruiting large numbers of users is likely to generate conflicting implementation priorities which hinder - or at least substantially slow down - the effective rollout of services at scale.The deployment of Living-It-Up services is ongoing, but our results to date suggest that - in order to be successful - the roll-out of digital health and well-being technologies at scale requires a delicate and pragmatic trade-off between co-design activities, the development of innovative services and the efforts allocated to widespread marketing and recruitment initiatives

A study of information management in the patient surgical pathway in NHSScotland

We conducted a study of information management processes across the patient surgical pathway in NHSScotland. While the majority of general practitioners (GPs) consider electronic medical records systems as an essential and integral part of their work during the patient consultation, many were not fully satisfied with the functionalities of these systems. A majority of GPs considered that the national eReferral system streamlined referral processes. Almost all GPs reported marked variability in the quality of discharge information. Preoperative processes vary significantly across Scotland, with most services using paper-based systems. Insufficient use is made of information provided through the patient electronic referral leading to a considerable duplication of tasks already performed in primary care. Three health-boards have implemented electronic preoperative information systems. These have transformed clinical practices and facilitated communication and information-sharing among the multi-disciplinary team and within the health-boards. Substantial progress has been made towards improving information transfer and sharing within the surgical pathway in recent years. However, there remains scope for further improvements at the interface between services

Alternative and Augmentative Communication Technologies for Supporting Adults With Mild Intellectual Disabilities During Clinical Consultations:Scoping Review

Background: People with intellectual disabilities (IDs) face significant communication barriers when accessing health care services; they find it difficult to identify and describe conditions clearly enough to support practitioners in making an accurate diagnosis. In addition, medical professionals generally have little knowledge and understanding of the needs of people with ID, which may result in the use of consultation techniques that do not cater to their patients' skills. Objective: This review aims to identify and synthesize the literature on alternative and augmentative communication technologies that are used to support adults with mild ID during the exchange of information with medical practitioners. Methods: We performed a scoping review of studies published in English that describe the technologies that are used to promote communication with patients with mild ID during medical consultations. The databases searched were PubMed, ACM Digital Library, and Google Scholar. A qualitative framework-based approach was used to synthesize the data and discern key recurring themes across the identified literature. Results: Of the 1557 articles screened, 15 (0.96%) met our inclusion criteria. The bulk of the communication aids used focused on low-tech solutions, including patient passports, note-based prompts, Talking Mats, health diaries, and easy-read information sheets. Their influence on current practice ranged from advancing medical professionals' knowledge of the health and communication needs of people with ID to increasing interagency collaboration, patient advocacy skills, and health promotion activities. The major barriers to the implementation of low-tech aids were a lack of portability and increased maintenance efforts. Only 3 studies explored the use of mobile apps to promote communication. Their findings indicated that high-tech solutions offer greater customization with regard to the accessibility and health care needs of people with ID. Conclusions: Alternative and augmentative communication technologies have the potential to increase the quality of care provided to patients with mild ID; however, little work has been carried out in this area. Greater emphasis must be placed on (high-tech) two-way communication aids that empower patients to become involved in decisions regarding their care. Quantitative evaluation methods should be used to discern the true benefits of such aids, and researchers should describe their study protocols in depth to promote replication and generalizability

Combining transcranial ultrasound with intelligent communication methods to enhance the remote assessment and management of stroke patients : framework for a technology demonstrator

With over 150,000 strokes in the United Kingdom every year, and more than 1 million living survivors, stroke is the third most common cause of death and the leading cause of severe physical disability among adults. A major challenge in administering timely treatment is determining whether the stroke is due to vascular blockage (ischaemic) or haemorrhage. For patients with ischaemic stroke, thrombolysis (i.e. pharmacological 'clot-busting') can improve outcomes when delivered swiftly after onset, and current National Health Service Quality Improvement Scotland guidelines are for thrombolytic therapy to be provided to at least 80 per cent of eligible patients within 60 min of arrival at hospital. Thrombolysis in haemorrhagic stroke could severely compound the brain damage, so administration of thrombolytic therapy currently requires near-immediate care in a hospital, rapid consultation with a physician and access to imaging services (X-ray computed tomography or magnetic resonance imaging) and intensive care services. This is near impossible in remote and rural areas, and stroke mortality rates in Scotland are 50 per cent higher than in London. We here describe our current project developing a technology demonstrator with ultrasound imaging linked to an intelligent, multi-channel communication device - connecting to multiple 2G/3G/4G networks and/or satellites - in order to stream live ultrasound images, video and two-way audio streams to hospital-based specialists who can guide and advise ambulance clinicians regarding diagnosis. With portable ultrasound machines located in ambulances or general practices, use of such technology is not confined to stroke, although this is our current focus. Ultrasound assessment is useful in many other immediate care situations, suggesting potential wider applicability for this remote support system. Although our research programme is driven by rural need, the ideas are potentially applicable to urban areas where access to imaging and definitive treatment can be restricted by a range of operational factors