Meta-evaluations in government and government institutions: A case study example from the Australian Centre for International Agricultural Research

In this paper we draw on impact assessment work of the Australian Centre for International Agricultural Research (ACIAR) to present an example of meta-evaluation – an evaluation of evaluations – in an agricultural research, development and extension setting. We explore quality issues relating to evaluation studies in the context of government institutions. Program evaluation standards (PES) are divided into categories of utility, feasibility, propriety and accuracy to provide a framework for the meta-evaluation. The PES are presented as a universal measure of evaluation study quality. The intent of using them here is to judge the adequacy of PES as a universal quality measure or meta-evaluation base and to extract useful insights from ACIAR program evaluation activities when developing a meta-evaluation model for the Limpopo Department of Agriculture (LDA). Our meta-evaluation is undertaken of 63 impact assessment reports. First, the literature guiding the conduct of a meta-evaluation is reviewed. Second, an assessment (the meta-evaluation) of the evaluation studies is carried out for 19 sampled reports from a population of relevant reports fitting the dimension of the analysis, and results are presented and discussed. Also, lessons learned are presented, using the framework provided by the meta-evaluation criteria. Third, taking into account the lessons learned, implications are drawn for a proposed systematic meta-evaluation of the LDA. Finally, we conclude that all the PES cannot be equally emphasized in a meta-evaluation model. At ACIAR, 70% of the standards were at least partially addressed. Therefore, we succeeded in using the PES in judging the ACIAR evaluation quality. As such, they can be an important base when developing an evaluation model but should be applied in a contextualized manner.Meta-evaluation, Evaluation Quality, Program Evaluation Standards, Evaluation Model, Australian Centre for International Agricultural Research, Limpopo Department of Agriculture (South Africa), International Development,

Estimation of body weight in Nguni-type cattle under communal management conditions

(South African J of Animal Science, 2000, 30, Supplement 1: 97-98

The chemical composition, energy and amino acid digestibility of cowpeas used in poultry nutrition

The aim of this study was to determine the chemical composition and digestibility of cowpeas for use in poultry diets. Three cowpea cultivars, Glenda, Agrinawa and Indigenous were evaluated. The cultivars showed a relatively narrow range of protein concentrations (253.5 to 264.3 g/kg). The concentrations of amino acids (AA) varied among the cultivars. Dietary crude fibre levels varied from 51.5 to 58.1 g/kg. The cultivars were almost devoid of lipid and calcium, but were relatively high in phosphorus. The apparent and true metabolisable energy (AMEn and TMEn) values ranged from 9.88 to 10.02 and 10.29 to 10.78 MJ/kg DM, respectively. The mean digestibilities of the AA's ranged from 72.8 to 81.0%, with methionine having the highest digestibility and lysine the lowest. Cowpeas appear to be suitable for use in poultry feeds, their composition being equivalent to plant protein sources such as lupins and field peas, but lower in most nutrients compared with soybeans and canola

Edible Plate Wastage Study: An assessment of the percentage of consumed food at ward level in selected South African hospitals

Most of the patients admitted to hospitals are malnourished and unable to meet their nutritional requirements during hospitalisation due to low nutrient intake. Consequences thereof being delayed recovery process, prolonged hospital stays, and high cost. With the aim to identify factors related to low levels of food consumption, this study assessed the percentage of  edible plate waste and determined reasons for not consuming all the food provided by the hospital without cost calculations. Data were collected using a visual tick sheet with an interview schedule attached on it, from six South African provinces, thirty two hospitals and 168 plates of patients admitted in medical and surgical wards. Ninety six (57%) patients consumed all the food provided for them by hospitals, eight (5%) consumed 80% of the food provided, 10 (6%) consumed 60%, 10 (6%) consumed 40 8 (5%) consumed 20% and 35 (21%) did not consume any food provided for them by the hospital. In elaborating on the reasons for unacceptable food consumption levels, patients indicated dissatisfaction with the aspects related to the quality of meals, the eating environment, physical and/or medical conditions, appetite, and some were absent during meal service. While more than half of the patients 96 (57%) consumed all the food provided for them by the hospital, there were still concerns with 72 (43%) of the patients who did not consume all the food provided by the hospital. This poses serious consequences and negatively impacts on the nutritional and health status of patients.Keywords: Plate wastage, assessment, food consumption, public hospital

Nutrient composition of planned adult patients’ normal diet menus in selected public hospitals in Gauteng Province, South Africa

Nutritional quality has been a major food and beverage service consideration in planning and reviewing menus to meet patients’ nutritional needs. Failure to provide sufficient and nutritionally adequate hospital meals results in adverse consequences in a patients’ nutritional, health status and the national economy. The intent of this study was to provide useful information and direction for government agencies, hospital administrators and foodservice leaders whose mandate includes making improvements in the quality of hospital menus. A quantitative, descriptive and analytical approach was applied to assess the nutritional content of planned menus in selected public hospitals in Gauteng province. Samples of adult regular diet menus including breakfast, lunch, supper and all snacks were collected from eight hospitals and analysed using the South African based Food Finder 3 software. The recommended South African total energy RDI (Recommended Daily Intake) range is 6300-8400 kJ. Of the 8 hospitals, only two hospital menus met the requirements with a 6743 kJ and a 7978 kJ, respectively. Four hospital menus were below the RDI with the following data: 5751 kJ, 3239 kJ, 3239 kJ and 6105 kJ. Two hospital menus exceeded the RDI, i.e. 12892 kJ and 9073 kJ. While two hospitals met the RDI requirements for total energy, there are still concerns about hospitals with planned menus falling below and above the RDI as this could affect the patients’ nutritional and health status negatively. Therefore, the assessment of nutritional composition of menus could be helpful to provide information on the adequacy of hospital menus, and guide food providers to make informed decisions in improving in-patient menus.Keywords: Nutrient content, normal diet menu, adult patients, public hospital

Fortification of maize meal improved the nutritional status of 1-3-year-old African children

Objective: To evaluate the effectiveness of a vitamin-fortified maize meal to improve the nutritional status of 1–3-year-old malnourished African children.Design: A randomised parallel intervention study was used in which 21 experimental children and their families received maize meal fortified with vitamin A, thiamine, riboflavin and pyridoxine, while 23 control children and their families received unfortified maize meal. The maize meal was provided for 12 months to replace the maize meal habitually consumed by these households.Methods: Sixty undernourished African children with height-for-age or weight-for-age below the 5th percentile of the National Center for Health Statistics' criteria and aged 1–3 years were randomly assigned to an experimental or control group. Baseline measurements included demographic, socio-economic and dietary data, as well as height, weight, haemoglobin, haematocrit, serum retinol and retinol-binding protein (RBP). Anthropometric, blood and serum variables were measured again after 12 months of intervention. Complete baseline measurements were available for 44 children and end data for only 36. Changes in these variables from baseline to end within and between groups were assessed for significance with paired t-tests, t-tests and analysis of variances using the SPSS program, controlling for expected weight gain in this age group over 12 months. Relationships between changes in variables were examined by calculating correlation coefficients.Results: The children in the experimental group had a significantly (P0.05) higher increase in body weight than control children (4.6 kg vs. 2.0 kg) and both groups had significant (P0.05) but similar increases in height. The children in the experimental group showed non-significant increases in haemoglobin and serum retinol, while the control children had a significant (P=0.007) decrease in RBP. The change in serum retinol showed a significant correlation with baseline retinol (P=0.014), RBP (P=0.007) and weight (P=0.029), as well as with changes in haemoglobin (P=0.029).Conclusion: Despite a small sample size, this study showed positive effects of a vitamin-fortified maize meal on weight gain and some variables of vitamin A status in 1–3-year-old African children. The study confirmed the relationship between vitamin A and iron status. The results suggest that fortification of maize meal would be an effective strategy to address micronutrient deficiencies in small children in South Africa

The impact of government intervention on small scale irrigation schemes in Sekhukhune district : a case study of Tswelopele scheme

Paper presented at the South African Society for Agricultural Extension Conference 4 - 7 May 2010 "The Impact of Climate Change on Extension Delivery in South Africa", Langebaan, Western Cape, South Africa.This paper was transferred from the original CD Compiled and produced by Beta Products cc. The material on the CD ROM was published using Adobe Acrobat technology

Meta-evaluations in government and government institutions: A case study example from the Australian Centre for International Agricultural Research

In this paper we draw on impact assessment work of the Australian Centre for International Agricultural Research (ACIAR) to present an example of meta-evaluation – an evaluation of evaluations – in an agricultural research, development and extension setting. We explore quality issues relating to evaluation studies in the context of government institutions. Program evaluation standards (PES) are divided into categories of utility, feasibility, propriety and accuracy to provide a framework for the meta-evaluation. The PES are presented as a universal measure of evaluation study quality. The intent of using them here is to judge the adequacy of PES as a universal quality measure or meta-evaluation base and to extract useful insights from ACIAR program evaluation activities when developing a meta-evaluation model for the Limpopo Department of Agriculture (LDA). Our meta-evaluation is undertaken of 63 impact assessment reports. First, the literature guiding the conduct of a meta-evaluation is reviewed. Second, an assessment (the meta-evaluation) of the evaluation studies is carried out for 19 sampled reports from a population of relevant reports fitting the dimension of the analysis, and results are presented and discussed. Also, lessons learned are presented, using the framework provided by the meta-evaluation criteria. Third, taking into account the lessons learned, implications are drawn for a proposed systematic meta-evaluation of the LDA. Finally, we conclude that all the PES cannot be equally emphasized in a meta-evaluation model. At ACIAR, 70% of the standards were at least partially addressed. Therefore, we succeeded in using the PES in judging the ACIAR evaluation quality. As such, they can be an important base when developing an evaluation model but should be applied in a contextualized manner