Using Electronic Technology to Improve Clinical Care -- Results from a Before-after Cluster Trial to Evaluate Assessment and Classification of Sick Children According to Integrated Management of Childhood Illness (IMCI) Protocol in Tanzania.

Poor adherence to the Integrated Management of Childhood Illness (IMCI) protocol reduces the potential impact on under-five morbidity and mortality. Electronic technology could improve adherence; however there are few studies demonstrating the benefits of such technology in a resource-poor settings. This study estimates the impact of electronic technology on adherence to the IMCI protocols as compared to the current paper-based protocols in Tanzania. In four districts in Tanzania, 18 clinics were randomly selected for inclusion. At each site, observers documented critical parts of the clinical assessment of children aged 2 months to 5 years. The first set of observations occurred during examination of children using paper-based IMCI (pIMCI) and the next set of observations occurred during examination using the electronic IMCI (eIMCI). Children were re-examined by an IMCI expert and the diagnoses were compared. A total of 1221 children (671 paper, 550 electronic) were observed. For all ten critical IMCI items included in both systems, adherence to the protocol was greater for eIMCI than for pIMCI. The proportion assessed under pIMCI ranged from 61% to 98% compared to 92% to 100% under eIMCI (p < 0.05 for each of the ten assessment items). Use of electronic systems improved the completeness of assessment of children with acute illness in Tanzania. With the before-after nature of the design, potential for temporal confounding is the primary limitation. However, the data collection for both phases occurred over a short period (one month) and so temporal confounding was expected to be minimal. The results suggest that the use of electronic IMCI protocols can improve the completeness and consistency of clinical assessments and future studies will examine the long-term health and health systems impact of eIMCI

Evaluating mobile solutions of integrated Community Case Management (iCCM): Making the final connection

No Abstrac

Implementation of a cloud-based electronic medical record for maternal and child health in rural Kenya

Background Complete and timely health information is essential to inform public health decision-making for maternal and child health, but is often lacking in resource-constrained settings. Electronic medical record (EMR) systems are increasingly being adopted to support the delivery of health care, and are particularly amenable to maternal and child health services. An EMR system could enable the mother and child to be tracked and monitored throughout maternity shared care, improve quality and completeness of data collected and enhance sharing of health information between outpatient clinic and the hospital, and between clinical and public health services to inform decision-making. Methods This study implemented a novel cloud-based electronic medical record system in a maternal and child health outpatient setting in Western Kenya between April and June 2013 and evaluated its impact on improving completeness of data collected by clinical and public health services. The impact of the system was assessed using a two-sample test of proportions pre- and post-implementation of EMR-based data verification. Results Significant improvements in completeness of the antenatal record were recorded through implementation of EMR-based data verification. A difference of 42.9% in missing data (including screening for hypertension, tuberculosis, malaria, HIV status or ART status of HIV positive women) was recorded pre- and post- implementation. Despite significant impact of EMR-based data verification on data completeness, overall screening rates in antenatal care were low. Conclusion This study has shown that EMR-based data verification can improve the completeness of data collected in the patient record for maternal and child health. A number of issues, including data management and patient confidentiality, must be considered but significant improvements in data quality are recorded through implementation of this EMR model

Sustainability of ‘mHealth’ interventions in sub-Saharan Africa: a stakeholder analysis of an electronic community case management project in Malawi

BackgroundThe global health community and funding agencies are currently engaged in ensuring that worthwhile research-based programmes are sustainable. Despite its importance, few studies have analysed the sustainability of global health interventions. In this paper, we aim to explore barriers and facilitators for the wider implementation and sustainability of a mobile health (mHealth) intervention (Supporting LIFE Community Case Management programme) in Malawi, Africa.MethodsBetween January and March 2017, a qualitative approach was used to carry out and analyse 13 in-depth semi-structured interviews with key stakeholders across all levels of healthcare provision in Malawi to explore their perceptions with regards to the implementation and sustainability of the mHealth programme. Data were analysed thematically by two reviewers. ResultsOverall, our analysis found that the programme was successful in achieving its goals. However, there are many challenges to the wider implementation and sustainability of this programme, including the absence of monetary resources, limited visibility outside the healthcare sector, the lack of integration with community-based and nationwide programmes, services and information and communication technologies, and the limited local capacity in relation to the maintenance, further development, and management.ConclusionsFuture developments should be aligned with the strategic goals and interests of the Ministry of Health and engage with national and international stakeholders to develop shared goals and strategies for nationwide scale-up. These developments should also focus on building local capacity by educating trainers and ensuring that training methods and guidelines are appropriately accredited based on national policies. Our findings provide a framework for a variety of stakeholders who are engaged in sustaining mHealth programmes in resource-poor settings and can be used to develop an evidence-based policy for the utilization of technology for healthcare delivery across developing countries

Perceptions of a mobile health intervention for Community Case Management in Malawi: Opportunities and challenges for Health Surveillance Assistants in a community setting

AbstractBackground Improved availability of mobile phones in low- and middle-income countries (LMICs) offer an opportunity to improve delivery of Community Case Management (CCM). Despite enthusiasm for introducing mHealth into healthcare across LMICs, end-user attitudes towards mHealth solutions for CCM are limited. We aimed to explore Health Surveillance Assistants’ (HSAs) perceptions of the Supporting LIFE electronic CCM Application (SL eCCM App) and their experiences incorporating it as part of their clinical practice. Methods This exploratory qualitative study was part of a mixed methods feasibility study investigating whether children under-5 presenting to village clinics could be followed-up to collect patient outcome data. The convenience sample of 12 HSAs enrolled into the feasibility study participated in semi-structured interviews, which were conducted at village clinics after HSAs had field-tested the SL eCCM App over a 10-day period. Interviews explored HSAs perceptions of the SL eCCM App and their experiences in using the App in addition to paper CCM to assess and treat acutely unwell children. Open coding was used to label emerging concepts, which were iteratively defined and developed into six key themes. Results HSAs’ perceived enhanced clinical decision-making, quality of CCM delivery, and work efficiency as opportunities associated with using the SL eCCM App. HSAs believed the inability to retrieve patient records,, cumbersome duplicate assessments/data entry study procedures, and inconsistencies between the SL eCCM App and paper-based CCM guidelines as challenges to implementation. Adding features to the App, such as, permitting communication between colleagues/supervisors, drug stock-out reporting, and community assessments, were identified as potentially supporting HSAs’ many roles in the community. Conclusion This study identified opportunities and challenges associated with using the SL eCCM App in Malawi. This information can be used to inform future development and evaluation of the SL eCCM App, and similar mHealth solutions for CCM in Malawi and other developing countries.

Electronic clinical decision support algorithms incorporating point-of-care diagnostic tests in low-resource settings: a target product profile

Health workers in low-resource settings often lack the support and tools to follow evidence-based clinical recommendations for diagnosing, treating and managing sick patients. Digital technologies, by combining patient health information and point-of-care diagnostics with evidence-based clinical protocols, can help improve the quality of care and the rational use of resources, and save patient lives. A growing number of electronic clinical decision support algorithms (CDSAs) on mobile devices are being developed and piloted without evidence of safety or impact. Here, we present a target product profile (TPP) for CDSAs aimed at guiding preventive or curative consultations in low-resource settings. This document will help align developer and implementer processes and product specifications with the needs of end users, in terms of quality, safety, performance and operational functionality. To identify the characteristics of CDSAs, a multidisciplinary group of experts (academia, industry and policy makers) with expertise in diagnostic and CDSA development and implementation in low-income and middle-income countries were convened to discuss a draft TPP. The TPP was finalised through a Delphi process to facilitate consensus building. An agreement greater than 75% was reached for all 40 TPP characteristics. In general, experts were in overwhelming agreement that, given that CDSAs provide patient management recommendations, the underlying clinical algorithms should be human-interpretable and evidence-based. Whenever possible, the algorithm's patient management output should take into account pretest disease probabilities and likelihood ratios of clinical and diagnostic predictors. In addition, validation processes should at a minimum show that CDSAs are implementing faithfully the evidence they are based on, and ideally the impact on patient health outcomes. In terms of operational needs, CDSAs should be designed to fit within clinic workflows and function in connectivity-challenged and high-volume settings. Data collected through the tool should conform to local patient privacy regulations and international data standards

Long and short Integrated Management of Childhood Illness (IMCI) training courses in Afghanistan: a cross- sectional cohort comparison of post-course knowledge and performance

Background: In 2003 the Afghan Ministry of Public Health (MoPH) adopted the Integrated Management of Childhood Illness (IMCI) for delivering child health services in primary care facilities. Key problems were subsequently identified: high cost of training, frequent health worker turnover and poor quality of IMCI implementation by those trained – specifically in the use of job aids and protocols for assessment, classification, treatment and counselling. The high financial, human resources and opportunity costs of implementing IMCI spurred the MoPH to prioritize developing a shortened IMCI course of comparable quality to the 11-Day training. Methods: This cross-sectional evaluation compared knowledge before and after training, and health worker performance in assessment, classification and treatment of sick children in two similar cohorts, eight months post-training. Results: The mean increase in knowledge scores of the thirty 7-Day course trainees was 29 [95% Confidence Interval (CI): 24, 34] compared to 23 (95% CI: 18, 28) in the 31 trained in the 11-Day course. During assessment visits, mean scores in the 7-Day course trainees and the 11-Day course trainees were 93% (95% CI: 91, 95) versus 94% (95% CI: 91, 96) in assessment; 95% (95% CI: 89, 100) versus 96% (95% CI: 91, 100) in classification; 95% (95% CI: 92, 100) versus 97% (95% CI: 95, 100) in treatment; and 81% (95% CI: 76, 86) versus 80% (95% CI: 75, 85) in counselling. The 7-Day course was 36% less expensive than the 11-Day course. For each course opportunity costs, measured as numbers of children who potentially received poorer care than usual during trainee absence, were 3,160 for the 11-Day course and 2,016 for the 7-Day course. This measure was chosen because trainee absence commonly resulted in higher patient volumes per remaining provider or complete closure of a health facility with one single health worker. Conclusion: Given similar performance and knowledge of health workers trained in both courses, potential cost savings, the possibility of training more health workers and the relative ease with which health workers in remote settings might participate in a shorter course, it seems prudent to standardize the 7-Day course in Afghanistan where child mortality rates remain unacceptably high

Reducing Under-five Childhood Mortality using IMCI/e-IMCI: Implementation Approaches in Nigeria

To address the global issue of healthcare disparity and access to care, particularly in children under-five years of age, Integrated Management of Childhood Illness (IMCI) was put in place by WHO and UNICEF. To address poor adherence to IMCI that affects Under-five Mortality Rates (U5MRs), e-IMCI was introduced 1. With its three components: improvement of case management skills of health-care staff, overall health systems, and family and community health practices, IMCI/e-IMCI targets under-five children’s health with a holistic approach 2. While IMCI/e-IMCI helps to provide quality care, save cost and potentially time, inadequate healthcare providers’ training remains a primary challenge to the quality of implementation at the global level especially in lower-middle income countries like Nigeria. This paper presents the barriers to IMCI/e-IMCI from the policy makers, health workers and patient standpoint in Nigeria. Also, the paper elaborates on various implementation approaches to address these barriers in the context of the Nigerian health care system.Master of Public Healt

Training community healthcare workers on the use of information and communication technologies: a randomised controlled trial of traditional versus blended learning in Malawi, Africa

Background: Despite the increasing uptake of information and communication technologies (ICT) within healthcare services across developing countries, community healthcare workers (CHWs) have limited knowledge to fully utilise computerised clinical systems and mobile apps. The ‘Introduction to Information and Communication Technology and eHealth’ course was developed with the aim to provide CHWs in Malawi, Africa, with basic knowledge and computer skills to use digital solutions in healthcare delivery. The course was delivered using a traditional and a blended learning approach. Methods: Two questionnaires were developed and tested for face validity and reliability in a pilot course with 20 CHWs. Those were designed to measure CHWs’ knowledge of and attitudes towards the use of ICT, before and after each course, as well as their satisfaction with each learning approach. Following validation, a randomised controlled trial was conducted to assess the effectiveness of the two learning approaches. A total of 40 CHWs were recruited, stratified by position, gender and computer experience, and allocated to the traditional or blended learning group using block randomisation. Participants completed the baseline and follow-up questionnaires before and after each course to assess the impact of each learning approach on their knowledge, attitudes, and satisfaction. Per-item, pre-post and between-group, mean differences for each approach were calculated using paired and unpaired t-tests, respectively. Per-item, between-group, satisfaction scores were compared using unpaired t-tests. Results: Scores across all scales improved after attending the traditional and blended learning courses. Self-rated ICT knowledge was significantly improved in both groups with significant differences between groups in seven domains. However, actual ICT knowledge scores were similar across groups. There were no significant differences between groups in attitudinal gains. Satisfaction with the course was generally high in both groups. However, participants in the blended learning group found it more difficult to follow the content of the course. Conclusions: This study shows that there is no difference between blended and traditional learning in the acquisition of actual ICT knowledge among community healthcare workers in developing countries. Given the human resource constraints in remote resource-poor areas, the blended learning approach may present an advantageous alternative to traditional learning