Prediction of communication effectiveness during media skills training using commercial automatic non-verbal recognition systems

It is well recognised that social signals play an important role in communication effectiveness. Observation of videos to understand non-verbal behaviour is time-consuming and limits the potential to incorporate detailed and accurate feedback of this behaviour in practical applications such as communication skills training or performance evaluation. The aim of the current research is twofold: (1) to investigate whether off-the-shelf emotion recognition technology can detect social signals in media interviews and (2) to identify which combinations of social signals are most promising for evaluating trainees' performance in a media interview. To investigate this, non-verbal signals were automatically recognised from practice on-camera media interviews conducted within a media training setting with a sample size of 34. Automated non-verbal signal detection consists of multimodal features including facial expression, hand gestures, vocal behaviour and 'honest' signals. The on-camera interviews were categorised into effective and poor communication exemplars based on communication skills ratings provided by trainers and neutral observers which served as a ground truth. A correlation-based feature selection method was used to select signals associated with performance. To assess the accuracy of the selected features, a number of machine learning classification techniques were used. Naive Bayes analysis produced the best results with an F-measure of 0.76 and prediction accuracy of 78%. Results revealed that a combination of body movements, hand movements and facial expression are relevant for establishing communication effectiveness in the context of media interviews. The results of the current study have implications for the automatic evaluation of media interviews with a number of potential application areas including enhancing communication training including current media skills training. [Abstract copyright: Copyright © 2021 Pereira, Meng and Hone.

Towards a practical framework for managing the risks of selecting technology to support independent living

Information and communication technology applications can help increase the independence and quality of life of older people, or people with disabilities who live in their own homes. A risk management framework is proposed to assist in selecting applications that match the needs and wishes of particular individuals. Risk comprises two components: the likelihood of the occurrence of harm and the consequences of that harm. In the home, the social and psychological harms are as important as the physical ones. The importance of the harm (e.g., injury) is conditioned by its consequences (e.g., distress, costly medical treatment). We identify six generic types of harm (including dependency, loneliness, fear and debt) and four generic consequences (including distress and loss of confidence in ability to live independently). The resultant client-centred framework offers a systematic basis for selecting and evaluating technology for independent living

Exploring the factors affecting MOOC retention: a survey study

Massive Open Online Courses (MOOCs) hold the potential to open up educational opportunities to a global audience. However, evidence suggests that only a small proportion of MOOC participants go on to complete their courses and relatively little is understood about the MOOC design and implementation factors that influence retention. This paper reports a survey study of 379 participants enrolled at university in Cairo who were encouraged to take a MOOC of their own choice as part of their development. 122 participants (32.2%) went onto to complete an entire course. There were no significant differences in completion rates by gender, level of study (undergraduate or postgraduate) or MOOC platform. A post-MOOC survey of students’ perceptions found that MOOC Course Content was a significant predictor of MOOC retention, with the relationship mediated by the effect of content on the Perceived Effectiveness of the course. Interaction with the instructor of the MOOC was also found to be significant predictor of MOOC retention. Overall these constructs explained 79% of the variance in MOOC retention

Mixed-methods evaluation of a novel online STI results service.

OBJECTIVES: Evidence on optimal methods for providing STI test results is lacking. We evaluated an online results service, developed as part of an eSexual Health Clinic (eSHC). METHODS: We evaluated the online results service using a mixed-methods approach within large exploratory studies of the eSHC. Participants were chlamydia- positive and negative users of online postal self-sampling services in six National Chlamydia Screening Programme (NCSP) areas and chlamydia-positive patients from two genitourinary medicine (GUM) clinics between 21 July 2014 and 13 March 2015. Participants received a discreetly worded National Health Service 'NHS no-reply' text message (SMS) informing them that their test results were ready and providing a weblink to a secure website. Participants logged in with their date of birth and mobile telephone or clinic number. Chlamydia-positive patients were offered online management. All interactions with the eSHC system were automatically logged and their timing recorded. Post-treatment, a service evaluation survey (n=152) and qualitative interviews (n=36) were conducted by telephone. Chlamydia-negative patients were offered a short online survey (n=274). Data were integrated. RESULTS: 92% (134/146) of NCSP chlamydia-positive patients, 82% (161/197) of GUM chlamydia-positive patients and 89% (1776/1997) of NCSP chlamydia-negative participants accessed test results within 7 days. 91% of chlamydia-positive patients were happy with the results service; 64% of those who had tested previously found the results service better or much better than previous experiences. 90% of chlamydia-negative survey participants agreed they would be happy to receive results this way in the future. Interviewees described accessing results with ease and appreciated the privacy and control the two-step process gave them. CONCLUSION: A discreet SMS to alert users/patients that results are available, followed by provision of results via a secure website, was highly acceptable, irrespective of test result and testing history. The eSHC results service afforded users privacy and control over when they viewed results without compromising access

‘Can you recommend any good STI apps?’ A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections

Objective Seeking sexual health information online is common, and provision of mobile medical applications (apps) for STIs is increasing. Young people, inherently at higher risk of STIs, are avid users of technology, and apps could be appealing sources of information. We undertook a comprehensive review of content and accuracy of apps for people seeking information about STIs. Methods Search of Google Play and iTunes stores using general and specific search terms for apps regarding STIs and genital infections (except HIV), testing, diagnosis and management, 10 September 2014 to 16 September 2014. We assessed eligible apps against (1) 19 modified Health on The Net (HON) Foundation principles; and (2) comprehensiveness and accuracy of information on STIs/genital infections, and their diagnosis and management, compared with corresponding National Health Service STI information webpage content. Results 144/6642 apps were eligible. 57 were excluded after downloading. 87 were analysed. Only 29% of apps met ≥6 HON criteria. Content was highly variable: 34/87 (39%) covered one or two infections; 40 (46%) covered multiple STIs; 5 (6%) focused on accessing STI testing. 13 (15%) were fully, 46 (53%) mostly and 28 (32%) partially accurate. 25 (29%) contained ≥1 piece of potentially harmful information. Apps available on both iOS and Android were more accurate than single-platform apps. Only one app provided fully accurate and comprehensive information on chlamydia. Conclusions Marked variation in content, quality and accuracy of available apps combined with the nearly one-third containing potentially harmful information risks undermining potential benefits of an e-Health approach to sexual health and well-being.The Electronic Self-Testing Instruments for Sexually Transmitted Infection (eSTI2) Consortium is funded under the UKCRC Translational Infection Research (TIR) Initiative supported by the Medical Research Council (Grant Number G0901608) with contributions to the Grant from the Biotechnology and Biological Sciences Research Council, the National Institute for Health Research on behalf of the Department of Health, the Chief Scientist Office of the Scottish Government Health Directorates and the Wellcome Trust

Examining the moderating effect of individual-level cultural values on users’ acceptance of E-learning in developing countries: a structural equation modeling of an extended technology acceptance model

In this study, we examine the effects of individual-level culture on the adoption and acceptance of e-learning tools by students in Lebanon using a theoretical framework based on the Technology Acceptance Model (TAM). To overcome possible limitations of using TAM in developing countries, we extend TAM to include subjective norms (SN) and quality of work life constructs as additional constructs and a number of cultural variables as moderators. The four cultural dimensions of masculinity/femininity (MF), individualism/collectivism, power distance and uncertainty avoidance were measured at the individual level to enable them to be integrated into the extended TAM as moderators and a research model was developed based on previous literature. To test the hypothesised model, data were collected from 569 undergraduate and postgraduate students using e-learning tools in Lebanon via questionnaire. The collected data were analysed using the structural equation modelling technique in conjunction with multi-group analysis. As hypothesised, the results of the study revealed perceived usefulness (PU), perceived ease of use (PEOU), SN and quality of work life to be significant determinants of students’ behavioural intention (BI) towards e-learning. The empirical results also demonstrated that the relationship between SN and BI was particularly sensitive to differences in individual-cultural values, with significant moderating effects observed for all four of the cultural dimensions studied. Some moderating effects of culture were also found for both PU and PEOU, however, contrary to expectations the effect of quality of work life was not found to be moderated by MF as some previous authors have predicted. The implications of these results to both theory and practice are explored in the paper

The eClinical Care Pathway Framework: A novel structure for creation of online complex clinical care pathways and its application in the management of sexually transmitted infections.

Despite considerable international eHealth impetus, there is no guidance on the development of online clinical care pathways. Advances in diagnostics now enable self-testing with home diagnosis, to which comprehensive online clinical care could be linked, facilitating completely self-directed, remote care. We describe a new framework for developing complex online clinical care pathways and its application to clinical management of people with genital chlamydia infection, the commonest sexually transmitted infection (STI) in England.Using the existing evidence-base, guidelines and examples from contemporary clinical practice, we developed the eClinical Care Pathway Framework, a nine-step iterative process. Step 1: define the aims of the online pathway; Step 2: define the functional units; Step 3: draft the clinical consultation; Step 4: expert review; Step 5: cognitive testing; Step 6: user-centred interface testing; Step 7: specification development; Step 8: software testing, usability testing and further comprehension testing; Step 9: piloting. We then applied the Framework to create a chlamydia online clinical care pathway (Online Chlamydia Pathway).Use of the Framework elucidated content and structure of the care pathway and identified the need for significant changes in sequences of care (Traditional: history, diagnosis, information versus Online: diagnosis, information, history) and prescribing safety assessment. The Framework met the needs of complex STI management and enabled development of a multi-faceted, fully-automated consultation.The Framework provides a comprehensive structure on which complex online care pathways such as those needed for STI management, which involve clinical services, public health surveillance functions and third party (sexual partner) management, can be developed to meet national clinical and public health standards. The Online Chlamydia Pathway's standardised method of collecting data on demographics and sexual behaviour, with potential for interoperability with surveillance systems, could be a powerful tool for public health and clinical management.UKCRC Translational Infection Research (TIR) Initiative supported by the Medical Research Council, eSTI2 Consortium (Grant Number G0901608)

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe