Mixed Methods Designs

Methodology Bits is a series of flyers produced by the CRICH Survey Research Unit. It’s intended to be a helpful resource for researchers and students who want to refresh or update their knowledge about research methodology and operations.Mixed methods designs can be defined as: the combined utilization of quantitative and qualitative data collection methods in a research and/or evaluation project, making possible a greater understanding of the phenomenon being studied than what could be offered by separate quantitative and qualitative designs. This type of design gives the investigator the opportunity to utilize the strengths of both quantitative and qualitative data collection methods, at the same time that it compensates for some of their weaknesses

Housing First the conversation: discourse, policy and the limits of the possible

Researchers, policy-makers, and political leaders in Canada and the US are championing the ‘Housing First’ (HF) intervention as a solution to homelessness. HF supplies people experiencing both homelessness and challenges around mental health with housing and a range of supports that can include case-coordination, psychiatry, and primary care. While HF’s impact on the housing status of individual participants has received considerable scientific and public consideration, less attention has been paid to its effects on societal conversations related to housing, public services, and social justice. We explore some of the impacts, not of HF the intervention, but of HF the conversation – the way public documents related to HF interact with broader discourses. Specifically, we examine the potential for this conversation to undermine the ultimate goal of ending homelessness in Canada. We conclude that positioning program interventions – no matter how important in the current context – as singular solutions to issues like homelessness or preventable chronic disease risks obscuring distal causes and marginalizing systemic responses

The impact of a Housing First randomized controlled trial on substance use problems among homeless individuals with mental illness

Background: There is strong evidence that Housing First interventions are effective in improving housing stability and quality of life among homeless people with mental illness and addictions. However, there is very little evidence on the effectiveness of Housing First in improving substance use-related outcomes in this population. This study uses a randomized control design to examine the effects of scatter-site Housing First on substance use outcomes in a large urban centre. Methods: Substance use outcomes were compared between a Housing First intervention and treatment as usual group in a sample of 575 individuals experiencing homelessness and mental illness, with or without a co-occurring substance use problem, in the At Home/Chez Soi trial in Toronto, Canada. Generalized linear models were used to compare study arms with respect to change in substance use outcomes over time (baseline, 6, 12, 18 and 24 month). Results: At 24 months, participants in the Housing First intervention had significantly greater reductions in number of days experiencing alcohol problems and amount of money spent on alcohol than participants in the Treatment as Usual group. No differences between the study arms in illicit drug outcomes were found at 24 months. Conclusions: These findings show that a Housing First intervention can contribute to reductions in alcohol problems over time. However, the lack of effect of the intervention on illicit drug problems suggests that individuals experiencing homelessness, mental illness and drug problems may need additional supports to reduce use. Trial Registration: Current controlled trials ISRCTN42520374

Provision of contraceptive services to homeless women: results of a survey of health care for the homeless providers

Homeless women have both a higher rate of pregnancy and a higher proportion of unintended pregnancies than other American women. The authors sought to learn about contraception services offered by providers of health care to homeless women and barriers to provision of long-acting, reversible contraception in these settings. A survey of the 31 member organizations in the national Health Care for the Homeless Practice-Based Research Network was conducted, inquiring about services provided and barriers to service provision. Among the 20 responding organizations (65% response rate), 17 directly provided contraceptive services; two referred patients elsewhere, and one provided no contraceptive services. All 17 that provided such services provided condoms; 15 provided oral contraceptives; 14 provided injectable contraception; 6 provided intrauterine devices, and 2 provided contraceptive implants. Barriers to providing the last two methods included lack of provider training, lack of resources for placement, costs, and concerns about complications. The present survey results suggested very limited access for homeless women across the country to the two most effective means of long-acting, reversible contraception. Modest investments of resources could reduce a number of barriers to providing these services

Different faces of discrimination: perceived discrimination among homeless adults with mental illness in healthcare settings

Abstract Background Research on discrimination in healthcare settings has primarily focused on health implications of race-based discrimination among ethno-racial minority groups. Little is known about discrimination experiences of other marginalized populations, particularly groups facing multiple disadvantages who may be subjected to other/multiple forms of discrimination. Objectives: (1) To examine the prevalence of perceived discrimination due to homelessness/poverty, mental illness/alcohol/drug related problems, and race/ethnicity/skin color while seeking healthcare in the past year among racially diverse homeless adults with mental illness; (2) To identify whether perceiving certain types of discrimination is associated with increased likelihood of perceiving other kinds of discrimination; and (3) To examine association of these perceived discrimination experiences with socio-demographic characteristics, self-reported measures of psychiatric symptomatology and substance use, and Emergency Department utilization. Methods We used baseline data from the Toronto site of the At Home/Chez Soi randomized controlled trial of Housing First for homeless adults with mental illness (n = 550). Bivariate statistics and multivariable logistic regression models were used for the analysis. Results Perceived discrimination related to homelessness/poverty (30.4%) and mental illness/alcohol/substance use (32.5%) is prevalent among ethnically diverse homeless adults with mental illness in healthcare settings. Only 15% of the total participants reported discrimination due to race/ethnicity/skin color. After controlling for relevant confounders and presence of psychosis, all types of discrimination in healthcare settings were associated with more frequent ED use, a greater - 3 - severity of lifetime substance abuse, and mental health problems. Perceiving discrimination of one type was associated with increased likelihood of perceiving other kinds of discrimination. Conclusions Understanding the experience of discrimination in healthcare settings and associated healthcare utilization is the first step towards designing policies and interventions to address health disparities among vulnerable populations. This study contributes to the knowledge base in this important area. Trial registration number This study has been registered with the International Standard Randomized Control Trial Number Register and assigned ISRCTN42520374

Shrinking the language accessibility gap: a mixed methods evaluation of telephone interpretation services in a large, diverse urban health care system

Abstract Introduction Language interpretation services for patients who are not proficient in a country’s official language(s) are essential for improving health equity across diverse populations, and achieving clinical safety and quality for both patients and providers. Nevertheless, overall use of these services remains low, regardless of how they are delivered. In Toronto, Ontario, one of the most ethnically diverse urban centres, the regional local health integration network which oversees the highest concentration of health care organizations servicing 1.2 million residents, partnered with key stakeholders to make Over-the-Phone (OPI) interpretation services broadly and economically available in 170 different languages to its diverse network of health care organizations. This evaluation aimed to assess patients’ and providers’ experiences with OPI in these varied settings and the impact (if any) on alternative interpretation services and on health service delivery access and quality. Methods This study used a two-phased sequential exploratory mixed-methods approach to evaluate the initiative. Phase I was comprised of semi-structured interviews with representatives from the program stakeholders; these findings were applied to identify appropriate survey questions and response categories, and provided context and depth of understanding to Phase II results. Phase II included web-based and self-administered surveys for both providers and patients engaging with OPI. Results Both providers and patients identified a broad range of positive impacts OPI had on health care service delivery quality and access, and high levels of satisfaction with OPI, in a variety of health care settings. Providers also revealed a marked decrease in the use of ad-hoc, nonprofessional strategies for interpretation after the implementation of OPI, and noted it had either no impact on their workload or had decreased it overall. Conclusions OPI is clearly not the sole answer to the complex array of health care needs and access gaps that exist for persons without proficiency in their country’s official language. Nevertheless, this evaluation provides compelling evidence that OPI is a valuable component, and that it may contribute to a broader range of positive impacts, and within a broader range of health care settings, than previously explored

Dynamic Sustainability: Practitioners Perspectives on Housing First Implementation Challenges and Model Fidelity Over Time

Objectives: Although Housing First (HF) is a popular evidence-based intervention for persons experiencing homelessness and mental illness, research exploring its sustainability over time is scant. This mixed methods study captures practitioners' perspectives on key shifts in implementation of Housing First in a large urban center, and factors affecting fidelity to the model over time. Methods: This study uses fidelity assessments, at baseline and 18-months later, completed as part of the largest field trial of Housing First to date, and qualitative data from 28 front-line service providers and their managers. Results: Our findings reveal how the shifting landscape of implementation morphed some early troublespots into persistent challenges and exposed key factors facilitating fidelity to the model in a dynamic context. Conclusions: This study supports the importance of gathering provider perspectives over time to optimize the fit between the model and its changing local contexts and ensure maximal benefit of the intervention

The role and meaning of interim housing in housing first programs for people experiencing homelessness and mental illness

The housing first (HF) model for individuals experiencing homelessness and mental illness differs by design from traditional models that require consumers to achieve "housing readiness" by meeting program or treatment prerequisites in transitional housing settings prior to permanent housing placement. Given a growing body of evidence for its favorable outcomes and cost effectiveness, HF is increasingly seen as an alternative to and argument against these traditional programs. As such, it is important that the elements and implementation challenges of the HF model be clearly understood and articulated. This qualitative study explored a largely unexamined aspect of the HF model-the need for and meaning of temporary residential settings (interim housing), a place to stay while waiting to secure permanent housing-using interviews and focus groups with service providers and consumers who experienced interim housing during implementation of HF in a large urban center. Although interim housing may not be necessary for all programs implementing the model, our study revealed numerous reasons and demands for safe, flexible interim housing options, and illustrated how they influence the effectiveness of consumer recovery, continuous service engagement, and housing stability

Shrinking the language accessibility gap: a mixed methods evaluation of telephone interpretation services in a large, diverse urban health care system

Introduction: Language interpretation services for patients who are not proficient in a country’s official language(s) are essential for improving health equity across diverse populations, and achieving clinical safety and quality for both patients and providers. Nevertheless, overall use of these services remains low, regardless of how they are delivered. In Toronto, Ontario, one of the most ethnically diverse urban centres, the regional local health integration network which oversees the highest concentration of health care organizations servicing 1.2 million residents, partnered with key stakeholders to make Over-the-Phone (OPI) interpretation services broadly and economically available in 170 different languages to its diverse network of health care organizations. This evaluation aimed to assess patients’ and providers’ experiences with OPI in these varied settings and the impact (if any) on alternative interpretation services and on health service delivery access and quality. Methods: This study used a two-phased sequential exploratory mixed-methods approach to evaluate the initiative. Phase I was comprised of semi-structured interviews with representatives from the program stakeholders; these findings were applied to identify appropriate survey questions and response categories, and provided context and depth of understanding to Phase II results. Phase II included web-based and self-administered surveys for both providers and patients engaging with OPI. Results: Both providers and patients identified a broad range of positive impacts OPI had on health care service delivery quality and access, and high levels of satisfaction with OPI, in a variety of health care settings. Providers also revealed a marked decrease in the use of ad-hoc, nonprofessional strategies for interpretation after the implementation of OPI, and noted it had either no impact on their workload or had decreased it overall. Conclusions: OPI is clearly not the sole answer to the complex array of health care needs and access gaps that exist for persons without proficiency in their country’s official language. Nevertheless, this evaluation provides compelling evidence that OPI is a valuable component, and that it may contribute to a broader range of positive impacts, and within a broader range of health care settings, than previously explored.Toronto Central Local Health Integration Network (TC LHIN