Background: Traditionally, health intervention evaluations provide long-term evidence of efficacy and safety via validated protocols, following a positivist paradigm, or approach, to research. However, modern mobile health (mHealth) technologies develop too quickly and outside of medical regulation, making it challenging for health research to keep pace.
Objective: This thesis explored and tested how research can incorporate mHealth approaches and resources to evaluate mHealth interventions comprehensively, which follows the pragmatism paradigm. The works described herein were part of a larger project that designed, developed, and tested a data-sharing system between patients and their healthcare providers (HCPs) during diabetes consultations.
Methods: The pragmatism paradigm underpins the mixed-methods, multi-phase design approach to exploring this overall objective. The following methods were performed using a sequential exploratory strategy. First, co-design workshops invited individuals with diabetes and HCPs to design an mHealth data-sharing system. Next, a scoping literature review identified research practices for evaluating mHealth interventions to-date. Then, app usage-logs, collected from a previous longitudinal study, were analyzed to explore how much additional information they could provide about patients’ self-management. Finally, a mixed-method study was designed to test the feasibility of combining both traditional and mHealth approaches and resources to evaluate an intervention.
Results: Using the pragmatist paradigm as a scaffolding, these works provide evidence of how research can provide more comprehensive knowledge about mHealth interventions for diabetes care and self-management. Nine individuals with diabetes and six HCPs participated in the co-design workshops. Feedback included how a data-sharing system should work between patients and providers. The literature review identified how both traditional and mHealth-based approaches (n=15 methods, n=21 measures) were used together to evaluate mHealth interventions. Usage-log analysis revealed that changes in Glycosylated haemoglobin (HbA1c) differed between groups organized by usage patterns and duration of use of mHealth. The mixed-method study demonstrated how to collect comprehensive and complementary information when combining traditional and mHealth-centered approaches and resources.
Conclusion: Traditional positivist approaches and resources are not adequate, on their own, to comprehensively understand the impact of mHealth interventions. The presented studies demonstrate that it is both feasible and prudent to combine traditional research with mHealth approaches, such as analyzing usage-logs, arranging co-design workshops, and other patient-centered methods in a pragmatist approach to produce comprehensive evidence of mHealth’s impacts on both patients and HCPs