Usability and acceptability of a mobile app for behavior change and to improve immunization coverage among children in Pakistan: A mixed-methods study

Background: Pakistan\u27s immunization uptake rates are still significantly lower than anticipated despite several initiatives. Lack of awareness, forgetting about vaccination schedule, and vaccine misconception/misinformation are a few of the major drivers that mitigate the rates of immunization. The current COVID-19 pandemic emphasizes the importance of immunization. The significant reductions in regular childhood vaccination during pandemic have increased the risk of outbreaks of vaccine-preventable diseases. Concerns among parents over possibly exposing their children to COVID-19 during child visits may have contributed to the reported declines. Innovative and cost-effective mHealth interventions must be implemented in order to address the problem of inadequate immunization rates. In addition, it is also critical to understand the end user needs in order to reflect on the highly relevant essence of the customized healthcare experience.Objective: The aim of this study was to learn about caregivers\u27 attitudes toward the usability and acceptability of behavior-change smartphone applications (mobile phones) for improving immunization coverage in Pakistan.Methods: A mixed-method design was employed for this study. The study was conducted at Aga Khan University, Hospital. Parents visiting the Community Health Center for 6-week vaccination of their children were recruited. The study was conducted in two stages. Stage 1 consisted of qualitative interviews that grasped the parent\u27s attitudes and challenges to immunization, as well as their acceptability and accessibility of the smartphone-based behavior-change application to increase vaccine uptake. Stage 1 was followed by stage 2, in which data were collected through a questionnaire designed by using data from qualitative interviews.Results: The majority of participants agreed that immunization serves an important role in protecting their child from illnesses that cause morbidity and mortality. Almost all of them emphasized the importance of using a pre-appointment method at vaccination center in order to reduce the waiting time. Furthermore, participants were also interested in AI-based behavior modification applications related to immunization. They also wanted to have applications in their native language for better understanding and communication of related information. In our study, approximately 95.2 percent of participants agreed to accept SMS immunization updates, which was also reasonably high. Lastly, the majority of them identified forgetfulness as a significant contributor to regular immunization.Conclusion: To enhance the uptake of childhood vaccines, overall vaccination rates, and overcome barriers related to vaccination coverage, cost-effective and user-friendly mHealth AI-based smart phone applications are required to raise awareness regarding the continuation of vaccination service and the importance of timely vaccination. Parents\u27 experiences and attitudes must be considered while designing and evaluating the efficacy of mHealth-based interventions

Current challenges of digital health interventions in Pakistan: Mixed methods analysis

Background: Digital health is well-positioned in low and middle-income countries (LMICs) to revolutionize health care due, in part, to increasing mobile phone access and internet connectivity. This paper evaluates the underlying factors that can potentially facilitate or hinder the progress of digital health in Pakistan.Objective: The objective of this study is to identify the current digital health projects and studies being carried out in Pakistan, as well as the key stakeholders involved in these initiatives. We aim to follow a mixed-methods strategy and to evaluate these projects and studies through a strengths, weaknesses, opportunities, and threats (SWOT) analysis to identify the internal and external factors that can potentially facilitate or hinder the progress of digital health in Pakistan.Methods: This study aims to evaluate digital health projects carried out in the last 5 years in Pakistan with mixed methods. The qualitative and quantitative data obtained from field surveys were categorized according to the World Health Organization\u27s (WHO) recommended building blocks for health systems research, and the data were analyzed using a SWOT analysis strategy.Results: Of the digital health projects carried out in the last 5 years in Pakistan, 51 are studied. Of these projects, 46% (23/51) used technology for conducting research, 30% (15/51) used technology for implementation, and 12% (6/51) used technology for app development. The health domains targeted were general health (23/51, 46%), immunization (13/51, 26%), and diagnostics (5/51, 10%). Smartphones and devices were used in 55% (28/51) of the interventions, and 59% (30/51) of projects included plans for scaling up. Artificial intelligence (AI) or machine learning (ML) was used in 31% (16/51) of projects, and 74% (38/51) of interventions were being evaluated. The barriers faced by developers during the implementation phase included the populations\u27 inability to use the technology or mobile phones in 21% (11/51) of projects, costs in 16% (8/51) of projects, and privacy concerns in 12% (6/51) of projects.Conclusions: We conclude that while digital health has a promising future in Pakistan, it is still in its infancy at the time of this study. However, due to the coronavirus disease 2019 (COVID-19) pandemic, there is an increase in demand for digital health and implementation of health outcomes following global social distancing protocols, especially in LMICs. Hence, there is a need for active involvement by public and private organizations to regulate, mobilize, and expand the digital health sector for the improvement of health care systems in countries

Improving Routine Immunization Coverage Through Optimally Designed Predictive Models

Routine immunization (RI) of children is the most effective and timely public health intervention for decreasing child mortality rates around the globe. Pakistan being a low-and-middle-income-country (LMIC) has one of the highest child mortality rates in the world occurring mainly due to vaccine-preventable diseases (VPDs). For improving RI coverage, a critical need is to establish potential RI defaulters at an early stage, so that appropriate interventions can be targeted towards such population who are identified to be at risk of missing on their scheduled vaccine uptakes. In this paper, a machine learning (ML) based predictive model has been proposed to predict defaulting and non-defaulting children on upcoming immunization visits and examine the effect of its underlying contributing factors. The predictive model uses data obtained from Paigham-e-Sehat study having immunization records of 3,113 children. The design of predictive model is based on obtaining optimal results across accuracy, specificity, and sensitivity, to ensure model outcomes remain practically relevant to the problem addressed. Further optimization of predictive model is obtained through selection of significant features and removing data bias. Nine machine learning algorithms were applied for prediction of defaulting children for the next immunization visit. The results showed that the random forest model achieves the optimal accuracy of 81.9% with 83.6% sensitivity and 80.3% specificity. The main determinants of vaccination coverage were found to be vaccine coverage at birth, parental education, and socio-economic conditions of the defaulting group. This information can assist relevant policy makers to take proactive and effective measures for developing evidence based targeted and timely interventions for defaulting children

Usability and Acceptability of a Mobile App for Behavior Change and to Improve Immunization Coverage among Children in Pakistan: A Mixed-Methods Study

Background: Pakistan’s immunization uptake rates are still significantly lower than anticipated despite several initiatives. Lack of awareness, forgetting about vaccination schedule, and vaccine misconception/misinformation are a few of the major drivers that mitigate the rates of immunization. The current COVID-19 pandemic emphasizes the importance of immunization. The significant reductions in regular childhood vaccination during pandemic have increased the risk of outbreaks of vaccine-preventable diseases. Concerns among parents over possibly exposing their children to COVID-19 during child visits may have contributed to the reported declines. Innovative and cost-effective mHealth interventions must be implemented in order to address the problem of inadequate immunization rates. In addition, it is also critical to understand the end user needs in order to reflect on the highly relevant essence of the customized healthcare experience. Objective: The aim of this study was to learn about caregivers’ attitudes toward the usability and acceptability of behavior-change smartphone applications (mobile phones) for improving immunization coverage in Pakistan. Methods: A mixed-method design was employed for this study. The study was conducted at Aga Khan University, Hospital. Parents visiting the Community Health Center for 6-week vaccination of their children were recruited. The study was conducted in two stages. Stage 1 consisted of qualitative interviews that grasped the parent’s attitudes and challenges to immunization, as well as their acceptability and accessibility of the smartphone-based behavior-change application to increase vaccine uptake. Stage 1 was followed by stage 2, in which data were collected through a questionnaire designed by using data from qualitative interviews. Results: The majority of participants agreed that immunization serves an important role in protecting their child from illnesses that cause morbidity and mortality. Almost all of them emphasized the importance of using a pre-appointment method at vaccination center in order to reduce the waiting time. Furthermore, participants were also interested in AI-based behavior modification applications related to immunization. They also wanted to have applications in their native language for better understanding and communication of related information. In our study, approximately 95.2 percent of participants agreed to accept SMS immunization updates, which was also reasonably high. Lastly, the majority of them identified forgetfulness as a significant contributor to regular immunization. Conclusion: To enhance the uptake of childhood vaccines, overall vaccination rates, and overcome barriers related to vaccination coverage, cost-effective and user-friendly mHealth AI-based smart phone applications are required to raise awareness regarding the continuation of vaccination service and the importance of timely vaccination. Parents’ experiences and attitudes must be considered while designing and evaluating the efficacy of mHealth-based interventions

An Artificial Intelligence–Based, Personalized Smartphone App to Improve Childhood Immunization Coverage and Timelines Among Children in Pakistan: Protocol for a Randomized Controlled Trial

Background: The immunization uptake rates in Pakistan are much lower than desired. Major reasons include lack of awareness, parental forgetfulness regarding schedules, and misinformation regarding vaccines. In light of the COVID-19 pandemic and distancing measures, routine childhood immunization (RCI) coverage has been adversely affected, as caregivers avoid tertiary care hospitals or primary health centers. Innovative and cost-effective measures must be taken to understand and deal with the issue of low immunization rates. However, only a few smartphone-based interventions have been carried out in low- and middle-income countries (LMICs) to improve RCI. Objective: The primary objectives of this study are to evaluate whether a personalized mobile app can improve children’s on-time visits at 10 and 14 weeks of age for RCI as compared with standard care and to determine whether an artificial intelligence model can be incorporated into the app. Secondary objectives are to determine the perceptions and attitudes of caregivers regarding childhood vaccinations and to understand the factors that might influence the effect of a mobile phone–based app on vaccination improvement. Methods: A mixed methods randomized controlled trial was designed with intervention and control arms. The study will be conducted at the Aga Khan University Hospital vaccination center. Caregivers of newborns or infants visiting the center for their children’s 6-week vaccination will be recruited. The intervention arm will have access to a smartphone app with text, voice, video, and pictorial messages regarding RCI. This app will be developed based on the findings of the pretrial qualitative component of the study, in addition to no-show study findings, which will explore caregivers’ perceptions about RCI and a mobile phone–based app in improving RCI coverage. Results: Pretrial qualitative in-depth interviews were conducted in February 2020. Enrollment of study participants for the randomized controlled trial is in process. Study exit interviews will be conducted at the 14-week immunization visits, provided the caregivers visit the immunization facility at that time, or over the phone when the children are 18 weeks of age. Conclusions: This study will generate useful insights into the feasibility, acceptability, and usability of an Android-based smartphone app for improving RCI in Pakistan and in LMICs

Current Challenges of Digital Health Interventions in Pakistan: Mixed Methods Analysis

Background: Digital health is well-positioned in low and middle-income countries (LMICs) to revolutionize health care due, in part, to increasing mobile phone access and internet connectivity. This paper evaluates the underlying factors that can potentially facilitate or hinder the progress of digital health in Pakistan. Objective: The objective of this study is to identify the current digital health projects and studies being carried out in Pakistan, as well as the key stakeholders involved in these initiatives. We aim to follow a mixed-methods strategy and to evaluate these projects and studies through a strengths, weaknesses, opportunities, and threats (SWOT) analysis to identify the internal and external factors that can potentially facilitate or hinder the progress of digital health in Pakistan. Methods: This study aims to evaluate digital health projects carried out in the last 5 years in Pakistan with mixed methods. The qualitative and quantitative data obtained from field surveys were categorized according to the World Health Organization’s (WHO) recommended building blocks for health systems research, and the data were analyzed using a SWOT analysis strategy. Results: Of the digital health projects carried out in the last 5 years in Pakistan, 51 are studied. Of these projects, 46% (23/51) used technology for conducting research, 30% (15/51) used technology for implementation, and 12% (6/51) used technology for app development. The health domains targeted were general health (23/51, 46%), immunization (13/51, 26%), and diagnostics (5/51, 10%). Smartphones and devices were used in 55% (28/51) of the interventions, and 59% (30/51) of projects included plans for scaling up. Artificial intelligence (AI) or machine learning (ML) was used in 31% (16/51) of projects, and 74% (38/51) of interventions were being evaluated. The barriers faced by developers during the implementation phase included the populations’ inability to use the technology or mobile phones in 21% (11/51) of projects, costs in 16% (8/51) of projects, and privacy concerns in 12% (6/51) of projects