An activity theory study of data, knowledge, and power in the design of an international development NGO impact evaluation

International development is now a data-, information-, and knowledge-intensive industry, which some have characterised as “development 2.0.” Power relations are rarely foregrounded in this landscape, even though they shape what data and knowledge is constructed or discarded. Impact evaluation is one example of this intensive work, yet evaluation models seldom make power relations explicit or actionable. Furthermore, implicit models of data and knowledge on which impact evaluation processes rely also neglect power and social practice. The resulting problem is that power remains silent in development impact evaluation practice. In response, this article articulates an alternative, using Cultural Historical Activity Theory (CHAT) to analyse impact evaluation activities conducted by a UK-based philanthropic donor and their grantee in India, a small non-government organisation (NGO) doing rural development work. The analysis uses CHAT to illustrate how impact data, knowledge, and power are simultaneously generated during professional evaluation activities. The study broadens our view of impact and offers two contributions. Firstly, for researchers in information and communications technology for development (ICT4D) and knowledge management for development (KM4D), it contributes the application of a perspective on social practice, CHAT, to development evaluation. A novel extension to CHAT, the concept of “temporal activity chains,” is put forward to complement the established activity system frame. Secondly, the article demonstrates a practice-based view of development impact evaluation for researchers and practitioners who wish to acknowledge and respond to the generation of unequal power dynamics during evaluation processes

Measuring social capital and innovation in poor agricultural communities: The case of Cháparra, Peru

In the last decades substantive advance has been made in the measurement and understanding of frontier innovation in highly industrialized settings. However, little research focused on the process of learning and the introduction of novelties in smallholder farming of poor agricultural communities. Considering that 1.5 billion people in developing countries live in such smallholder households this is an essential shortcoming. In addressing three crucial questions about the measurement and promotion of endogenous local development this paper contributes to close this research gap. The three questions are: a) how can we measure social capital and innovation in poor agricultural communities, b) what is the impact of external agents on local structures and c) what are the relations between the social capital and the innovative performance of the farmer. In a first step a comprehensive questionnaire with 89 questions on diverse dimensions of social capital and innovation has been elaborated and applied to the agricultural valley of Cháparra in the South of Peru. The results allow for an indepth analysis of the capabilities, network position and innovative behavior of the farmers. In a second step, we apply social network analysis techniques to analyze the role and position of the relevant actors in the local as well as in the external technical information networks with a special focus on the influence of an external NGO. The analysis reveals a deep structural impact of the NGO and significant correlations between the network position of the farmers and their innovative performance. Three crucial issues for research on smallholder innovation are identified. First, diverse dimensions of social capital and innovation have to be differentiated when studying endogenous development. Second, it has to be assessed to which degree the modification of the existing social structures by external agents can be harmful or beneficial. Third, social network analysis can help us to gain a better understanding of the complex relations between social capital and innovation and how these can contribute to foster sustainable development projects. --social capital,innovation,smallholders,Cháparra,Peru,network analysis

Accountability in International Development Aid

Contemporary movements for the reform of global institutions advocate greater transparency, greater democracy, and greater accountability. Of these three, accountability is the master value. Transparency is valuable as means to accountability: more transparent institutions reveal whether officials have performed their duties. Democracy is valuable as a mechanism of accountability: elections enable the people peacefully to remove officials who have not done what it is their responsibility to do. “Accountability,” it has been said, “is the central issue of our time.” The focus of this paper is accountability in international development aid: that range of efforts sponsored by the world’s rich aimed at permanently bettering the conditions of the world’s poor. We begin by surveying some of the difficulties in international development work that have raised concerns that development agencies are not accountable enough for producing positive results in alleviating poverty. We then examine the concept of accountability, and survey the general state of accountability in development agencies. A high-altitude map of the main proposals for greater accountability in international development follows, and the paper concludes by exploring one specific proposal for increasing accountability in development aid

Scaling Success: Lessons from Adaptation Pilots in the Rainfed Regions of India

"Scaling Success" examines how agricultural communities are adapting to the challenges posed by climate change through the lens of India's rainfed agriculture regions. Rainfed agriculture currently occupies 58 percent of India's cultivated land and accounts for up to 40 percent of its total food production. However, these regions face potential production losses of more than $200 billion USD in rice, wheat, and maize by 2050 due to the effects of climate change. Unless action is taken soon at a large scale, farmers will see sharp decreases in revenue and yields.Rainfed regions across the globe have been an important focus for the first generation of adaptation projects, but to date, few have achieved a scale that can be truly transformational. Drawing on lessons learnt from 21 case studies of rainfed agriculture interventions, the report provides guidance on how to design, fund and support adaptation projects that can achieve scale

ACCESS: An Inception Report

Imagine a world in which all groups of citizens coming together to realize some public benefit measure and communicate the character and consequences of their work. Imagine further that all those groups have adopted a common reporting system that enables their individual reports to be compared, thus creating powerful descriptions of the relative and collective performance of citizen association for public benefit. Imagine, too, that this common measuring and reporting carries across to all forms of public-private partnership and corporate social responsibility. This is the world envisioned by ACCESS.For the past 18 months a growing number of concerned actors have been meeting, studying, and testing opinion around one of the great structural weaknesses in the world's institutional infrastructure -- inefficient and weak social investment markets. This inception report sets out the results of this enquiry in the form of a proposal to establish a reporting standard for nonprofit organizations seeking to produce social, environmental and, increasingly, financial returns. The ACCESS Reporting standard is one important contribution to redressing a major global system weakness, but it is certainly not the only one. Nor is it one that can operate in isolation from other initiatives. Accordingly, the ACCESS proposed plan of work involves convening a global dialogue on NGO transparency, accountability and performance with the objective of promoting ACCESS and other practical solutions to the challenges of social investment and civil society accountability.This report sets out the background and rationale for these proposals. You will meet the ACCESS sponsors and pilot project partners. Parts of the report are descriptive and analytical but other parts are necessarily theoretical and technical in nature. We make no apology for this. Part of the reason that in 2003 the world does not yet have a reporting standard for social actors is that the theory and technique have not been mastered. For those with a strong orientation toward strategy and action, however, these aspects are presented as well

Listen to the Voices of Maasai Women in Kenya: Ensuring the Well-Being of their Families through Collective Actions

This is an ethnographic study that provides insight into grassroots activities managed by Maasai women leaders in the Narok area of Kenya. Four women’s narratives were used as a basis of analysis to demonstrate their roles in facilitating grassroots activities to improve village women’s well-being despite gender discrimination and multidimensional constraints. The women’s group leaders commented that low literacy had a negative influence on Maasai women’s development; however, the issue of illiteracy could be overcome through cooperative learning during women group activities in their village. The results showed that the women’s group leaders played a facilitative role in improving women’s situations and everyday lives through knowledge sharing and collective social actions. An analysis of the narratives of four women demonstrated that: each woman has a unique experience of grassroots development activities that should be valued; and village women promote women’s empowerment and develop forms of resistance to gender inequality by accommodating men’s self-pride and different gender roles to ensure a harmonious society

User-driven design of decision support systems for polycentric environmental resources management

Open and decentralized technologies such as the Internet provide increasing opportunities to create knowledge and deliver computer-based decision support for multiple types of users across scales. However, environmental decision support systems/tools (henceforth EDSS) are often strongly science-driven and assuming single types of decision makers, and hence poorly suited for more decentralized and polycentric decision making contexts. In such contexts, EDSS need to be tailored to meet diverse user requirements to ensure that it provides useful (relevant), usable (intuitive), and exchangeable (institutionally unobstructed) information for decision support for different types of actors. To address these issues, we present a participatory framework for designing EDSS that emphasizes a more complete understanding of the decision making structures and iterative design of the user interface. We illustrate the application of the framework through a case study within the context of water-stressed upstream/downstream communities in Lima, Peru

Early Learning Innovation Fund Evaluation Final Report

This is a formative evaluation of the Hewlett Foundation's Early Learning Innovation Fund that began in 2011 as part of the Quality Education in Developing Countries (QEDC) initiative.  The Fund has four overarching objectives, which are to: promote promising approaches to improve children's learning; strengthen the capacity of organizations implementing those approaches; strengthen those organizations' networks and ownership; and grow 20 percent of implementing organizations into significant players in the education sector. The Fund's original design was to create a "pipeline" of innovative approaches to improve learning outcomes, with the assumption that donors and partners would adopt the most successful ones. A defining feature of the Fund was that it delivered assistance through two intermediary support organizations (ISOs), rather than providing funds directly to implementing organizations. Through an open solicitation process, the Hewlett Foundation selected Firelight Foundation and TrustAfrica to manage the Fund. Firelight Foundation, based in California, was founded in 1999 with a mission to channel resources to community-based organizations (CBOs) working to improve the lives of vulnerable children and families in Africa. It supports 12 implementing organizations in Tanzania for the Fund. TrustAfrica, based in Dakar, Senegal, is a convener that seeks to strengthen African-led initiatives addressing some of the continent's most difficult challenges. The Fund was its first experience working specifically with early learning and childhood development organizations. Under the Fund, it supported 16 such organizations: one in Mali and five each in Senegal, Uganda and Kenya. At the end of 2014, the Hewlett Foundation commissioned Management Systems International (MSI) to conduct a mid-term evaluation assessing the implementation of the Fund exploring the extent to which it achieved intended outcomes and any factors that had limited or enabled its achievements. It analyzed the support that the ISOs provided to their implementing organizations, with specific focus on monitoring and evaluation (M&E). The evaluation included an audit of the implementing organizations' M&E systems and a review of the feasibility of compiling data collected to support an impact evaluation. Finally, the Foundation and the ISOs hoped that this evaluation would reveal the most promising innovations and inform planning for Phase II of the Fund. The evaluation findings sought to inform the Hewlett Foundation and other donors interested in supporting intermediary grant-makers, early learning innovations and the expansion of innovations. TrustAfrica and Firelight Foundation provided input to the evaluation's scope of work. Mid-term evaluation reports for each ISO provided findings about their management of the Fund's Phase I and recommendations for Phase II. This final evaluation report will inform donors, ISOs and other implementing organizations about the best approaches to support promising early learning innovations and their expansion. The full report outlines findings common across both ISOs' experience and includes recommendations in four key areas: adequate time; appropriate capacity building; advocacy and scaling up; and evaluating and documenting innovations. Overall, both Firelight Foundation and TrustAfrica supported a number of effective innovations working through committed and largely competent implementing organizations. The program's open-ended nature avoided being prescriptive in its approach, but based on the lessons learned in this evaluation and the broader literature, the Hewlett Foundation and other donors could have offered more guidance to ISOs to avoid the need to continually relearn some lessons. For example, over the evaluation period, it became increasingly evident that the current context demands more focused advance planning to measure impact on beneficiaries and other stakeholders and a more concrete approach to promoting and resourcing potential scale-up. The main findings from the evaluation and recommendations are summarized here