Comparison of self-administered survey questionnaire responses collected using mobile apps versus other methods

Background: Self-administered survey questionnaires are an important data collection tool in clinical practice, public health research and epidemiology. They are ideal for achieving a wide geographic coverage of the target population, dealing with sensitive topics and are less resource intensive than other data collection methods. These survey questionnaires can be delivered electronically, which can maximise the scalability and speed of data collection while reducing cost. In recent years, the use of apps running on consumer smart devices (i.e., smartphones and tablets) for this purpose has received considerable attention. However, variation in the mode of delivering a survey questionnaire could affect the quality of the responses collected. Objectives: To assess the impact that smartphone and tablet apps as a delivery mode have on the quality of survey questionnaire responses compared to any other alternative delivery mode: paper, laptop computer, tablet computer (manufactured before 2007), short message service (SMS) and plastic objects. Search methods: We searched MEDLINE, EMBASE, PsycINFO, IEEEXplore, Web of Science, CABI: CAB Abstracts, Current Contents Connect, ACM Digital, ERIC, Sociological Abstracts, Health Management Information Consortium, the Campbell Library and CENTRAL. We also searched registers of current and ongoing clinical trials such as ClinicalTrials.gov and the World Health Organization (WHO)International Clinical Trials Registry Platform. We also searched the grey literature in OpenGrey, Mobile Active and ProQuest Dissertation & Theses. Lastly, we searched Google Scholar and the reference lists of included studies and relevant systematic reviews. We performed all searches up to 12 and 13 April 2015. Selection criteria: We included parallel randomised controlled trials (RCTs), crossover trials and paired repeated measures studies that compared the electronic delivery of self-administered survey questionnaires via a smartphone or tablet app with any other delivery mode. We included data obtained from participants completing health-related self-administered survey questionnaire, both validated and non-validated. We also included data offered by both healthy volunteers and by those with any clinical diagnosis. We included studies that reported any of the following outcomes: data equivalence; data accuracy; data completeness; response rates; differences in the time taken to complete a survey questionnaire; differences in respondent’s adherence to the original sampling protocol; and acceptability to respondents of the delivery mode. We included studies that were published in 2007 or after, as devices that became available during this time are compatible with the mobile operating system (OS) framework that focuses on apps. Data collection and analysis: Two review authors independently extracted data from the included studies using a standardised form created for this systematic review in REDCap. They then compared their forms to reach consensus. Through an initial systematic mapping on the included studies, we identified two settings in which survey completion took place: controlled and uncontrolled. These settings differed in terms of (i) the location where surveys were completed, (ii) the frequency and intensity of sampling protocols, and (iii) the level of control over potential confounders (e.g., type of technology, level of help offered to respondents).We conducted a narrative synthesis of the evidence because a meta-analysis was not appropriate due to high levels of clinical and methodological diversity. We reported our findings for each outcome according to the setting in which the studies were conducted. Main results: We included 14 studies (15 records) with a total of 2275 participants; although we included only 2272 participants in the final analyses as there were missing data for three participants from one included study. Regarding data equivalence, in both controlled and uncontrolled settings, the included studies found no significant differences in the mean overall scores between apps and other delivery modes, and that all correlation coefficients exceeded the recommended thresholds for data equivalence. Concerning the time taken to complete a survey questionnaire in a controlled setting, one study found that an app was faster than paper, whereas the other study did not find a significant difference between the two delivery modes. In an uncontrolled setting, one study found that an app was faster than SMS. Data completeness and adherence to sampling protocols were only reported in uncontrolled settings. Regarding the former, an app was found to result in more complete records than paper, and in significantly more data entries than an SMS-based survey questionnaire. Regarding adherence to the sampling protocol, apps may be better than paper but no different from SMS. We identified multiple definitions of acceptability to respondents, with inconclusive results: preference; ease of use; willingness to use a delivery mode; satisfaction; effectiveness of the system informativeness; perceived time taken to complete the survey questionnaire; perceived benefit of a delivery mode; perceived usefulness of a delivery mode; perceived ability to complete a survey questionnaire; maximum length of time that participants would be willing to use a delivery mode; and reactivity to the delivery mode and its successful integration into respondents’ daily routine. Finally, regardless of the study setting, none of the included studies reported data accuracy or response rates. Authors’ conclusions: Our results, based on a narrative synthesis of the evidence, suggest that apps might not affect data equivalence as long as the intended clinical application of the survey questionnaire, its intended frequency of administration and the setting in which it was validated remain unchanged. There were no data on data accuracy or response rates, and findings on the time taken to complete a self-administered survey questionnaire were contradictory. Furthermore, although apps might improve data completeness, there is not enough evidence to assess their impact on adherence to sampling protocols. None of the included studies assessed how elements of user interaction design, survey questionnaire design and intervention design might influence mode effects. Those conducting research in public health and epidemiology should not assume that mode effects relevant to other delivery modes apply to apps running on consumer smart devices. Those conducting methodological research might wish to explore the issues highlighted by this systematic review

Implementation of depression screening in antenatal clinics through tablet computers: results of a feasibility study.

BACKGROUND: Mobile devices may facilitate depression screening in the waiting area of antenatal clinics. This can present implementation challenges, of which we focused on survey layout and technology deployment. METHODS: We assessed the feasibility of using tablet computers to administer a socio-demographic survey, the Whooley questions and the Edinburgh Postnatal Depression Scale (EPDS) to 530 pregnant women attending National Health Service (NHS) antenatal clinics across England. We randomised participants to one of two layout versions of these surveys: (i) a scrolling layout where each survey was presented on a single screen; or (ii) a paging layout where only one question appeared on the screen at any given time. RESULTS: Overall, 85.10% of eligible pregnant women agreed to take part. Of these, 90.95% completed the study procedures. Approximately 23% of participants answered Yes to at least one Whooley question, and approximately 13% of them scored 10 points of more on the EPDS. We observed no association between survey layout and the responses given to the Whooley questions, the median EPDS scores, the number of participants at increased risk of self-harm, and the number of participants asking for technical assistance. However, we observed a difference in the number of participants at each EPDS scoring interval (p = 0.008), which provide an indication of a woman's risk of depression. A scrolling layout resulted in faster completion times (median = 4 min 46 s) than a paging layout (median = 5 min 33 s) (p = 0.024). However, the clinical significance of this difference (47.5 s) is yet to be determined. CONCLUSIONS: Tablet computers can be used for depression screening in the waiting area of antenatal clinics. This requires the careful consideration of clinical workflows, and technology-related issues such as connectivity and security. An association between survey layout and EPDS scoring intervals needs to be explored further to determine if it corresponds to a survey layout effect. Future research needs to evaluate the effect of this type of antenatal depression screening on clinical outcomes and clinic workflows. TRIAL REGISTRATION: This study was registered in ClinicalTrials.gov under the identifier NCT02516982 on 20 July 2015

Systematic Literature Review and Meta-analysis of Venous Thromboembolism Events in Systemic Lupus Erythematosus

The objective of this work was to conduct a systematic literature review (SLR) and meta-analysis (MA) to evaluate the relative risk (RR) of venous thromboembolism (VTE) events, including deep vein thrombosis (DVT) and pulmonary embolism (PE), in patients with systemic lupus erythematosus (SLE) compared with patients without SLE, as well as the absolute risk (AR) (measured by incidence proportion) and incidence rate (IR) of VTE events in patients with SLE. The SLR was conducted using Embase, MEDLINE, and MEDLINE In-Process to identify observational studies evaluating the risk of VTE, DVT, and PE events in adult patients with SLE compared with the general population, published January 2000 to September 2020. Random-effects models were used as the primary approach in the MA. Heterogeneity was assessed on the basis of the I2 value. Sensitivity analyses were performed to assess the robustness of results to various conditions, and subgroup analysis was performed for the AR of VTE by antiphospholipid status (aPLs) and antiphospholipid syndrome (APS). Of the 50 publications included for data extraction, 44 contained data for consideration in the MA of any one of the measures of interest (RR, AR, or IR) for VTE, DVT, or PE. The pooled RR indicates statistically significantly higher risk of VTE (RR 4.38, 95% confidence interval 2.63-7.29) in patients with SLE compared with the general population. Considerable heterogeneity was present in nearly all MA (I2 = 75-100%). Moreover, a higher pooled AR of VTE was estimated in patients with SLE with aPLs (n/N = 0.13) and APS (n/N = 0.63) compared with patients with SLE without aPLs/APS (n/N = 0.07). Overall, there was evidence of an increased risk of VTE, DVT, and PE in patients with SLE compared with the general population

A bespoke mobile application for the longitudinal assessment of depression and mood during pregnancy: protocol of a feasibility study.

INTRODUCTION: Depression is a common mental health disorder during pregnancy, with important consequences for mothers and their children. Despite this, it goes undiagnosed and untreated in many women attending antenatal care. Smartphones could help support the prompt identification of antenatal depression in this setting. In addition, these devices enable the implementation of ecological momentary assessment techniques, which could be used to assess how mood is experienced during pregnancy. With this study, we will assess the feasibility of using a bespoke mobile application (app) running on participants' own handsets for the longitudinal (6 months) monitoring of antenatal mood and screening of depression. METHODS AND ANALYSIS: We will use a randomised controlled study design to compare two types of assessment strategies: retrospective + momentary (consisting of the Edinburgh Postnatal Depression Scale plus five momentary and two contextual questions), and retrospective (consisting of the Edinburgh Postnatal Depression Scale only). We will assess the impact that these strategies have on participant adherence to a prespecified sampling protocol, dropout rates and timeliness of data completion. We will evaluate differences in acceptance of the technology through a short quantitative survey and open-ended questions. We will also assess the potential effect that momentary assessments could have on retrospective data. We will attempt to identify any patterns in app usage through the analysis of log data. ETHICS AND DISSEMINATION: This study has been reviewed and approved by the National Research Ethics Service Committee South East Coast-Surrey on 15 April 2016 as a notice of substantial amendment to the original submission (9 July 2015) under the Research Ethics Committee (REC) reference 15/LO/0977. This study is being sponsored by Imperial College London under the reference number 15IC2687 and has been included in the UK Clinical Research Network Study Portfolio under the Central Portfolio Management System number 19280. The findings of this study will be disseminated through academic peer-reviewed publications, poster presentations and abstracts at academic and professional conferences, discussion with peers, and social media. The findings of this study will also inform the PhD theses of JSMB and KD

Mobile phone and tablet apps to support young people’s management of their physical long-term conditions: a systematic review protocol

Background: The prevalence of long-term or chronic conditions that limit activity and reduce quality of life in young people aged 10-24 years is rising. This group has distinct health care needs and requires tailored support strategies to facilitate increasing personal responsibility for the management of their condition wherever possible, as they mature. Mobile phone and tablet mobile technologies featuring software program apps are already well used by young people for social networking or gaming. They have also been utilized in health care to support personal condition management, using condition-specific and patient-tailored software. Such apps have much potential, and there is an emerging body of literature on their use in a health context making this review timely. Objective: The objective of this paper is to develop a systematic review protocol focused on identifying and assessing the effectiveness of mobile phone and tablet apps that support young people’s management of their chronic conditions. Methods: The search strategy will include a combination of standardized indexed search terms and free-text terms related to the key concepts of young people; long-term conditions and mobile technology. Peer-reviewed journal articles published from 2003 that meet the inclusion and exclusion criteria will be identified through searching the generated hits from 5 bibliographical databases. Two independent reviewers will screen the titles and abstracts to determine which articles focus on testing interventions identified as a mobile phone or tablet apps, and that have been designed and delivered to support the management of long-term conditions in young people aged 10-24 years. Data extraction and quality assessment tools will be used to facilitate consistent analysis and synthesis. It is anticipated that several studies will meet the selection criteria but that these are likely to be heterogeneous in terms of study design, reported outcomes, follow-up times, participants’ age, and health condition. Sub-group analyses will be undertaken and where possible meta-analyses will take place.Results: This review will synthesize available knowledge surrounding tablet and mobile phone apps that support management of long term physical health conditions in young people. The findings will be synthesized to determine which elements of the technologies were most effective for this population. Conclusions: This systematic review aims to synthesize existing literature in order to generate findings that will facilitate the development of an app intervention. The review will form the first phase of development and evaluation of a complex intervention as recommended by the United Kingdom Medical Research Council. The knowledge gained from the review will be verified in subsequent phases, which will include primary qualitative work with health professionals and young people with long term conditions as research participants. Young people living with long-term conditions will be involved as co-researchers and consumer advisors in all subsequent phases to develop and evaluate an app to support the management of long-term physical health conditions

Evolutionary history of the SARS-CoV-2 Gamma variant of concern (P.1): a perfect storm

Our goal was to describe in more detail the evolutionary history of Gamma and two derived lineages (P.1.1 and P.1.2), which are part of the arms race that SARS-CoV-2 wages with its host. A total of 4,977 sequences of the Gamma strain of SARS-CoV-2 from Brazil were analyzed. We detected 194 sites under positive selection in 12 genes/ORFs: Spike, N, M, E, ORF1a, ORF1b, ORF3, ORF6, ORF7a, ORF7b, ORF8, and ORF10. Some diagnostic sites for Gamma lacked a signature of positive selection in our study, but these were not fixed, apparently escaping the action of purifying selection. Our network analyses revealed branches leading to expanding haplotypes with sites under selection only detected when P.1.1 and P.1.2 were considered. The P.1.2 exclusive haplotype H_5 originated from a non-synonymous mutational step (H3509Y) in H_1 of ORF1a. The selected allele, 3509Y, represents an adaptive novelty involving ORF1a of P.1. Finally, we discuss how phenomena such as epistasis and antagonistic pleiotropy could limit the emergence of new alleles (and combinations thereof) in SARS-COV-2 lineages, maintaining infectivity in humans, while providing rapid response capabilities to face the arms race triggered by host immuneresponses

Offline eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction

Background: The world is short of 7.2 million health–care workers and this figure is growing. The shortage of teachers is even greater, which limits traditional education modes. eLearning may help overcome this training need. Offline eLearning is useful in remote and resource–limited settings with poor internet access. To inform investments in offline eLearning, we need to establish its effectiveness in terms of gaining knowledge and skills, students’ satisfaction and attitudes towards eLearning. Methods: We conducted a systematic review of offline eLearning for students enrolled in undergraduate, health–related university degrees. We included randomised controlled trials that compared offline eLearning to traditional learning or an alternative eLearning method. We searched the major bibliographic databases in August 2013 to identify articles that focused primarily on students’ knowledge, skills, satisfaction and attitudes toward eLearning, and health economic information and adverse effects as secondary outcomes. We also searched reference lists of relevant studies. Two reviewers independently extracted data from the included studies. We synthesized the findings using a thematic summary approach. Findings: Forty–nine studies, including 4955 students enrolled in undergraduate medical, dentistry, nursing, psychology, or physical therapy studies, met the inclusion criteria. Eleven of the 33 studies testing knowledge gains found significantly higher gains in the eLearning intervention groups compared to traditional learning, whereas 21 did not detect significant differences or found mixed results. One study did not test for differences. Eight studies detected significantly higher skill gains in the eLearning intervention groups, whilst the other 5 testing skill gains did not detect differences between groups. No study found offline eLearning as inferior. Generally no differences in attitudes or preference of eLearning over traditional learning were observed. No clear trends were found in the comparison of different modes of eLearning. Most of the studies were small and subject to several biases. Conclusions: Our results suggest that offline eLearning is equivalent and possibly superior to traditional learning regarding knowledge, skills, attitudes and satisfaction. Although a robust conclusion cannot be drawn due to variable quality of the evidence, these results justify further investment into offline eLearning to address the global health care workforce shortage