VAST: a practical validation framework for e-assessment solutions

The influx of technology in education has made it increasingly difficult to assess the validity of educational assessments. The field of information systems often ignores the social dimension during validation, whereas educational research neglects the technical dimensions of designed instruments. The inseparability of social and technical elements forms the bedrock of socio-technical systems. Therefore, the current lack of validation approaches that address both dimensions is a significant gap. We address this gap by introducing VAST: a validation framework for e-assessment solutions. Examples of such solutions are technology-enhanced learning systems and e-health applications. Using multi-grounded action research as our methodology, we investigate how we can synthesise existing knowledge from information systems and educational measurement to construct our validation framework. We develop an extensive user guideline complementing our framework and find through expert interviews that VAST facilitates a comprehensive, practical approach to validating e-assessment solutions.Horizon 2020 (H2020)883588Prevention, Population and Disease management (PrePoD)Public Health and primary car

CD4 trajectory adjusting for dropout among HIV-positive patients receiving combination antiretroviral therapy in an East African HIV care centre

Objective: Estimates of CD4 response to antiretroviral therapy (ART) obtained by averaging data from patients in care, overestimate population CD4 response and treatment program effectiveness because they do not consider data from patients who are deceased or not in care. We use mathematical methods to assess and adjust for this bias based on patient characteristics. Design: We examined data from 25,261 HIV-positive patients from the East Africa IeDEA Consortium. Methods: We used inverse probability of censoring weighting (IPCW) to represent patients not in care by patients in care with similar characteristics. We address two questions: What would the median CD4 be “had everyone starting ART remained on observation?” and “were everyone starting ART maintained on treatment?” Results: Routine CD4 count estimates were higher than adjusted estimates even under the best-case scenario of maintaining all patients on treatment. Two years after starting ART, differences between estimates diverged from 30 cells/µL, assuming similar mortality and treatment access among dropouts as patients in care, to over 100 cells/µL assuming 20% lower survival and 50% lower treatment access among dropouts. When considering only patients in care, the proportion of patients with CD4 above 350 cells/µL was 50% adjusted to below 30% when accounting for patients not in care. One-year mortality diverged 6–14% from the naïve estimates depending on assumptions about access to care among lost patients. Conclusions: Ignoring mortality and loss to care results in over-estimation of ART response for patients starting treatment and exaggerates the efficacy of treatment programs administering it

Time to First-Line ART Failure and Time to Second-Line ART Switch in the IeDEA Pediatric Cohort

BACKGROUND: Globally, 49% of the estimated 1.8 million children living with HIV are accessing antiretroviral therapy (ART). There are limited data concerning long-term durability of first-line ART regimens and time to transition to second-line. METHODS: Children initiating their first ART regimen between 2 and 14 years of age and enrolled in one of 208 sites in 30 Asia-Pacific and African countries participating in the Pediatric International Epidemiology Databases to Evaluate AIDS consortium were included in this analysis. Outcomes of interest were: first-line ART failure (clinical, immunologic, or virologic), change to second-line, and attrition (death or loss to program ). Cumulative incidence was computed for first-line failure and second-line initiation, with attrition as a competing event. RESULTS: In 27,031 children, median age at ART initiation was 6.7 years. Median baseline CD4% for children ≤5 years of age was 13.2% and CD4 count for those >5 years was 258 cells per microliter. Almost all (94.4%) initiated a nonnucleoside reverse transcriptase inhibitor; 5.3% a protease inhibitor, and 0.3% a triple nucleoside reverse transcriptase inhibitor-based regimen. At 1 year, 7.7% had failed and 14.4% had experienced attrition; by 5 years, the cumulative incidence was 25.9% and 29.4%, respectively. At 1 year after ART failure, 13.7% had transitioned to second-line and 11.2% had experienced attrition; by 5 years, the cumulative incidence was 31.6% and 25.9%, respectively. CONCLUSIONS: High rates of first-line failure and attrition were identified in children within 5 years after ART initiation. Of children meeting failure criteria, only one-third were transitioned to second-line ART within 5 years

Qualitative exploration of perceived benefits of care and barriers influencing HIV care in trans Nzoia, Kenya

Background: Substantial efforts have been made to ensure people living with HIV (PLHIV) are linked to and retained in care but many challenges deter care utilization. We report perceived benefits of seeking HIV care and barriers to HIV care that were identified through a formative assessment conducted to advise the development of an alternative care model to deliver antiretroviral treatment therapy (ART) in Trans Nzoia County, Kenya. Methods: Data were collected in 2015 through key informant interviews (KIIs), in-depth interviews (IDIs), and focus group discussions (FGDs). The study involved 55 participants of whom 53% were female. Ten KIIs provided community contextual information and viewpoints on the HIV epidemic in Trans Nzoia County while 20 PLHIV (10 male and 10 female) participated in IDIs. Twenty-five individuals living with HIV participated in four FGDs - two groups for men and two for women. Key informants were purposively selected, while every third patient above 18 years at the Kitale HIV Clinic was invited to share their HIV care experience through IDIs or FGDs. Trained research assistants moderated all sessions and audio recordings were transcribed and analyzed thematically. Results: Findings showed that PLHIV in Trans Nzoia County used both conventional and complementary alternative care for HIV; however, public health facilities were preferred. Popular perceived benefits of adopting care were relief from symptoms and the chance to live longer. Benefits of care uptake included weight gain, renewed energy, and positive behavior change. Individual-level barriers to HIV care included lack of money and food, use of alternative care, negative side effects of ART, denial, and disclosure difficulties. At the community level, stigma, limited social support for conventional HIV treatment, and poor means of transport were reported. The health system barriers were limited supplies and staff, long distance to conventional HIV care, and unprofessional providers. Conclusions: Diverse individual, community and health system barriers continue to affect HIV care-seeking efforts in Kenya. Appreciation of context and lived experiences allows for development of realistic care models

Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program: A Case Study of the Targeted Learning Roadmap

In conducting studies on an exposure of interest, a systematic roadmap should be applied for translating causal questions into statistical analyses and interpreting the results. In this paper we describe an application of one such roadmap applied to estimating the joint effect of both time to availability of a nurse-based triage system (low risk express care (LREC)) and individual enrollment in the program among HIV patients in East Africa. Our study population is comprised of 16;513 subjects found eligible for this task-shifting program within 15 clinics in Kenya between 2006 and 2009, with each clinic starting the LREC program between 2007 and 2008. After discretizing followup into 90-day time intervals, we targeted the population mean counterfactual outcome (i.e. counterfactual probability of either dying or being lost to follow up) at up to 450 days after initial LREC eligibility under three fixed treatment interventions. These were (i) under no program availability during the entire follow-up, (ii) under immediate program availability at initial eligibility, but non-enrollment during the entire follow-up, and (iii) under immediate program availability and enrollment at initial eligibility. We further estimated the controlled direct effect of immediate program availability compared to no program availability, under a hypothetical intervention to prevent individualenrollment in the program. Targeted minimum loss-based estimation was used to estimate the mean outcome, while Super Learning was implemented to estimate the required nuisance parameters. Analyses were conducted with the ltmle R package; analysis code is available at an online repository as an R package. Results showed that at 450 days, the probability of in-care survival for subjects with immediate availability and enrollment was 0:93 (95% CI: 0.91, 0.95) and 0:87 (95% CI: 0.86, 0.87) for subjects with immediate availability never enrolling. For subjects without LREC availability, it was 0:91 (95% CI: 0.90, 0.92). Immediate program availability without individualenrollment, compared to no program availability, was estimated to slightly albeit significantly decrease survival by 4% (95% CI 0.03,0.06, p\u3c 0:01). Immediately availability and enrollment resulted in a 7% higher in-care survival compared to immediate availability with non-enrollment after 450 days (95% CI -0.08,-0.05, p\u3c 0:01). The results are consistent with a fairly small impact of both availability and enrollment in the LREC program on in-care survival

Awareness and willingness to use HIV pre-exposure prophylaxis amongst gay and bisexual men in Scotland: implications for biomedical HIV prevention

Objectives:<p></p> To investigate the awareness of, and willingness to use, HIV Pre-Exposure Prophylaxis (PrEP), and willingness to take part in a PrEP study among gay and bisexual men in Scotland.<p></p> Methods:<p></p> Cross-sectional survey of 17 gay commercial venues in Glasgow and Edinburgh in May 2011 (N = 1515, 65.2% response rate); 1393 are included in the analyses.<p></p> Results:<p></p> Just under one-third of participants had heard of PrEP (n = 434; 31.2%), with awareness associated with being aged older than 35 years, talking to UAI partners about HIV, and with having had an HIV or STI test in the previous 12 months. Around half were willing to take part in a PrEP study (n = 695; 49.9%) or to take PrEP on a daily basis (n = 756; 54.3%). In multivariate analysis, willingness to take PrEP was associated with lower levels of education, regular gay scene attendance, ‘high-risk’ unprotected anal intercourse (UAI) and testing for HIV or STI in the previous 12 months. Reasons for not wanting to participate in a PrEP study or take PrEP included perceptions of low personal risk of HIV and concerns with using medication as an HIV prevention method.<p></p> Conclusions:<p></p> There is a willingness to engage in new forms of HIV prevention and research amongst a significant number of gay and bisexual men in Scotland. Future biomedical HIV interventions need to consider the links between sexual risk behaviour, testing, and potential PrEP use

Renal impairment in a rural African antiretroviral programme

Background: There is little knowledge regarding the prevalence and nature of renal impairment in African populations initiating antiretroviral treatment, nor evidence to inform the most cost effective methods of screening for renal impairment. With the increasing availability of the potentially nephrotixic drug, tenofovir, such information is important for the planning of antiretroviral programmes Methods: (i) Retrospective review of the prevalence and risk factors for impaired renal function in 2189 individuals initiating antiretroviral treatment in a rural African setting between 2004 and 2007 (ii) A prospective study of 149 consecutive patients initiating antiretrovirals to assess the utility of urine analysis for the detection of impaired renal function. Severe renal and moderately impaired renal function were defined as an estimated GFR of ≤ 30 mls/min/1.73 m2 and 30–60 mls/min/1.73 m2 respectively. Logistic regression was used to determine odds ratio (OR) of significantly impaired renal function (combining severe and moderate impairment). Co-variates for analysis were age, sex and CD4 count at initiation. Results: (i) There was a low prevalence of severe renal impairment (29/2189, 1.3% 95% C.I. 0.8–1.8) whereas moderate renal impairment was more frequent (287/2189, 13.1% 95% C.I. 11.6–14.5) with many patients having advanced immunosuppression at treatment initiation (median CD4 120 cells/μl). In multivariable logistic regression age over 40 (aOR 4.65, 95% C.I. 3.54–6.1), male gender (aOR 1.89, 95% C.I. 1.39–2.56) and CD4<100 cells/ul (aOR 1.4, 95% C.I. 1.07–1.82) were associated with risk of significant renal impairment (ii) In 149 consecutive patients, urine analysis had poor sensitivity and specificity for detecting impaired renal function. Conclusion: In this rural African setting, significant renal impairment is uncommon in patients initiating antiretrovirals. Urine analysis alone may be inadequate for identification of those with impaired renal function where resources for biochemistry are limited

Adherence to antiretroviral therapy in a clinical cohort of HIV-infected children in East Africa

Objective To describe antiretroviral therapy (ART) adherence and associated factors for a large HIVinfected pediatric cohort followed by sites of the East Africa International Epidemiologic Databases to Evaluate AIDS (IeDEA) consortium. Methods This study utilized prospectively collected clinical data from HIV-infected children less than 13 years of age who initiated ART within 4 clinical care programs (with 26 clinical sites) in Kenya, Uganda, and Tanzania and were followed for up to 6 years. Programs used one of 3 adherence measures, including 7-day quantitative recall, 7-day categorical recall, and clinician pill assessments. We fit a hierarchical, three-level, logistic-regression model to examine adherence, with observations nested within patient, and patients within the 26 sites providing pediatric HIV data to this analysis. Results In East Africa, 3,304 children, 52.0% male, were enrolled in care and were subsequently observed for a median of 92 weeks (inter-quartile range [IQR] 50.3±145.0 weeks). Median age at ART initiation was 5.5 years ([IQR] 3.0±8.5 years). ªGoodº adherence, as reported by each clinic\u27s measures, was extremely high, remaining on average above 90% throughout all years of follow-up. Longer time on ART was associated with higher adherence (adjusted Odds Ratio±aOR±per log-transformed week on ART: 1.095, 95% Confidence Interval±CI± [1.052±1.150].) Patients enrolled in higher-volume programs exhibited higher rates of clinician- assessed adherence (aOR per log-500 patients: 1.174, 95% CI [1.108±1.245]).Significant site-level variability in reported adherence was observed (0.28), with even higher variability among patients (0.71). In a sub-analysis, being an orphan at the start of ART was strongly associated with lower ART adherence rates (aOR: 0.919, 95% CI [0.864±0.976]). Conclusions Self-reported adherence remained high over a median of 1.8 years in HIV care, but varied according to patient-level and site-level factors. Consistent adherence monitoring with validated measures and attention to vulnerable groups is recommended

Frequency and impact of suboptimal immune recovery on first-line antiretroviral therapy within the International Epidemiologic Databases to Evaluate AIDS in East Africa

OBJECTIVE: To describe patterns of suboptimal immune recovery (SO-IR) and associated HIV-related-illnesses during the first 5 years following first-line antiretroviral therapy (ART) initiation across seven ART sites in East Africa. DESIGN: Retrospective analysis of data from seven ART clinical sites (three Uganda, two Kenya and two Tanzania). METHODS: SO-IR was described by proportions of ART-treated adults with CD4 cell counts less than 200, less than 350 and less than 500 cells/μl. Kaplan-Meier survival analysis techniques were used to assess predictors of SO-IR, and incident rates of HIV-related illnesses at CD4 cell counts less than 200, 200-350, 351-499, and >500 cells/μl, respectively. RESULTS: Overall 80 843 adults initiated non-nucleoside reverse transcriptase inhibitor-based first-line ART; 65% were women and median CD4 cell count was 126 [interquartile range (IQR), 52-202] cells/μl. Cumulative probability of SO-IR <200 cells/μl, <350 cells/μl and <500 cells/μl, after 5 years, was 11, 38 and 63%, respectively. Incidence of HIV-related illnesses was higher among those with CD4 cell counts less than 200 and 200-350 cells/μl, than those who achieved CD4 counts above these thresholds. The most common events, at CD4 < 200 cells/μl, were pulmonary tuberculosis [incident rate 15.98 (15.47-16.51)/100 person-years at risk (PYAR), oral candidiasis [incident rate 12.5 (12.03-12.94)] and herpes zoster [incident rate 6.30 (5.99-6.64)] events/100 PYAR. With attainment of a CD4 cell count level 200-350 cells/μl, there was a substantial reduction in events/100 PYAR - by 91% to 1.45 (1.29-1.63) for TB, by 94% to 0.75 (0.64-0.89) for oral candidiasis, by 84% to 0.99 (0.86-1.14) for Herpes Zoster, and by 78% to 1.22 (1.07-1.39) for chronic diarrhea. The incidence of all events decreased further with CD4 counts above these thresholds. CONCLUSION: Around 40% of adults initiated on ART have suboptimal immune recovery with CD4 counts <350 cells/μl after five years. Such patients will require closer monitoring for both HIV-related and non-HIV-related clinical events