Combining quantitative and qualitative survey work. Methodological framework, practical issues, and case studies

This document is an output of the DFID funded research project R7033 "Methodological Framework for Integrating Qualitative and Quantitative Approaches for Socio-Economic Survey Work". The project's main objective was to improve survey methodologies used in the natural resources sector, leading in turn to improved quality of information required for decision-making at the various stages of natural resources programmes and projects. The project, which was jointly implemented by the Natural Resources Institute and the Statistical Services Centre, attempted to bridge the gap between informal I qualitative methods on the one hand and formal I quantitative ones on the other. The document is presented in the form of a manual, allowing the user to read each of its parts and sections independently of each other. Nevertheless, cross references indicate links to other parts of the document where appropriate. Part I provides a methodological framework, which will also be available as a Best-Practice Guideline published by the Natural Resources Systems Programme of DFID. Part 11, which contains six theme papers, looks into a number of practical issues encountered when combining quantitative and qualitative survey techniques. And finally, in Part III case studies are used to demonstrate how the two approaches can be integrated in survey work and experiments related to the natural resources sector. The framework document, theme papers and case studies have been produced between 1998 and 2000

Issues in the construction of wealth indices for the measurement of socio-economic position in low-income countries

BACKGROUND: Epidemiological studies often require measures of socio-economic position (SEP). The application of principal components analysis (PCA) to data on asset-ownership is one popular approach to household SEP measurement. Proponents suggest that the approach provides a rational method for weighting asset data in a single indicator, captures the most important aspect of SEP for health studies, and is based on data that are readily available and/or simple to collect. However, the use of PCA on asset data may not be the best approach to SEP measurement. There remains concern that this approach can obscure the meaning of the final index and is statistically inappropriate for use with discrete data. In addition, the choice of assets to include and the level of agreement between wealth indices and more conventional measures of SEP such as consumption expenditure remain unclear. We discuss these issues, illustrating our examples with data from the Malawi Integrated Household Survey 2004-5. METHODS: Wealth indices were constructed using the assets on which data are collected within Demographic and Health Surveys. Indices were constructed using five weighting methods: PCA, PCA using dichotomised versions of categorical variables, equal weights, weights equal to the inverse of the proportion of households owning the item, and Multiple Correspondence Analysis. Agreement between indices was assessed. Indices were compared with per capita consumption expenditure, and the difference in agreement assessed when different methods were used to adjust consumption expenditure for household size and composition. RESULTS: All indices demonstrated similarly modest agreement with consumption expenditure. The indices constructed using dichotomised data showed strong agreement with each other, as did the indices constructed using categorical data. Agreement was lower between indices using data coded in different ways. The level of agreement between wealth indices and consumption expenditure did not differ when different consumption equivalence scales were applied. CONCLUSION: This study questions the appropriateness of wealth indices as proxies for consumption expenditure. The choice of data included had a greater influence on the wealth index than the method used to weight the data. Despite the limitations of PCA, alternative methods also all had disadvantages

A meta-analysis of long-term effects of conservation agriculture on maize grain yield under rain-fed conditions

Conservation agriculture involves reduced tillage, permanent soil cover and crop rotations to enhance soil fertility and to supply food from a dwindling land resource. Recently, conservation agriculture has been promoted in Southern Africa, mainly for maize-based farming systems. However, maize yields under rain-fed conditions are often variable. There is therefore a need to identify factors that influence crop yield under conservation agriculture and rain-fed conditions. Here, we studied maize grain yield data from experiments lasting 5 years and more under rain-fed conditions. We assessed the effect of long-term tillage and residue retention on maize grain yield under contrasting soil textures, nitrogen input and climate. Yield variability was measured by stability analysis. Our results show an increase in maize yield over time with conservation agriculture practices that include rotation and high input use in low rainfall areas. But we observed no difference in system stability under those conditions. We observed a strong relationship between maize grain yield and annual rainfall. Our meta-analysis gave the following findings: (1) 92% of the data show that mulch cover in high rainfall areas leads to lower yields due to waterlogging; (2) 85% of data show that soil texture is important in the temporal development of conservation agriculture effects, improved yields are likely on well-drained soils; (3) 73% of the data show that conservation agriculture practices require high inputs especially N for improved yield; (4) 63% of data show that increased yields are obtained with rotation but calculations often do not include the variations in rainfall within and between seasons; (5) 56% of the data show that reduced tillage with no mulch cover leads to lower yields in semi-arid areas; and (6) when adequate fertiliser is available, rainfall is the most important determinant of yield in southern Africa. It is clear from our results that conservation agriculture needs to be targeted and adapted to specific biophysical conditions for improved impact

Injury morbidity in an urban and a rural area in Tanzania: an epidemiological survey

BACKGROUND: Injuries are becoming a major health problem in developing countries. Few population based studies have been carried out in African countries. We examined the pattern of nonfatal injuries and associated risk factors in an urban and rural setting of Tanzania. METHODS: A population-based household survey was conducted in 2002. Participants were selected by cluster sampling. A total of 8,188 urban and 7,035 rural residents of all ages participated in the survey. All injuries reported among all household members in the year preceding the interview and resulting in one or more days of restricted activity were included in the analyis. RESULTS: A total of 206 (2.5%) and 303 (4.3%) persons reported to have been injured in the urban and rural area respectively. Although the overall incidence was higher in the rural area, the incidence of major injuries (≥ 30 disability days) was similar in both areas. Males were at a higher risk of having an injury than females. Rural residents were more likely to experience injuries due to falls (OR = 1.6; 95% CI = 1.1 – 2.3) and cuts (OR = 4.3; 95% CI = 3.0 – 6.2) but had a lower risk of transport injuries. The most common causes of injury in the urban area were transport injuries and falls. In the rural area, cuts and stabs, of which two thirds were related to agriculture, formed the most common cause. Age was an important risk factor for certain types of injuries. Poverty levels were not significantly associated with experiencing a nonfatal injury. CONCLUSION: The patterns of injury differ in urban and rural areas partly as a reflection of livelihoods and infrastructure. Rural residents are at a higher overall injury risk than urban residents. This may be important in the development of injury prevention strategies

Effectiveness of participatory planning for community management of fisheries in Bangladesh

Globally there is a lack of evidence to quantify benefits from participation. This research applies statistical analysis of sites, providing evidence that Participatory Action Plan Development resulted in more effective and prompter institutional development, compared with similar sites without such structured participatory planning

Methodological rigour in assessing participatory development

Reports the application of an analytical method that uses outputs from focus groups and qualitative information to test statistically a set of hypotheses regarding the impacts and effectiveness of participatory planning methods using with/without comparisons controlling for other factors