Evans School Policy Analysis & Research Group (EPAR)

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors. 

Introducing technology that is designed to be physically appropriate and valuable to women farmers can increase yields and raise income. But gender issues for agricultural technology projects in Sub-Saharan Africa (SSA) are extremely complex. The EPAR series on Gender and Cropping in SSA offers examples of how these issues can affect crop production and adoption of agricultural technologies at each point in the crop cycle for eight crops (cassava, cotton, maize, millet, rice, sorghum, wheat, and yam). This executive summary highlights innovative opportunities for interventions that consider these dimensions of gender. We encourage readers to consult the crop specific briefs for more details. We find that involving both men and women in the development, testing, and dissemination of agricultural technology has been shown to be successful in helping both benefit. Nevertheless, a consistent finding throughout the Gender and Cropping in SSA series is that maximum benefits from technological innovations cannot be realized when upstream factors like education, power, and land tenure heavily influence outcomes. Addressing these more basic upstream causes of gender inequality may be even more important in helping households increase productivity and maximize the benefits of technological interventions. 

A widely quoted estimate is that women produce 70 to 80 percent of Sub-Saharan Africa’s (SSA) food. Increasing farmer productivity in SSA therefore requires understanding how these women make planting, harvesting, and other decisions that affect the production, consumption, and marketing of their crops. This brief provides an overview of the gender cropping series highlighting similar themes from the various crops studied, presenting an overarching summary of the findings and conclusion of the individual literature reviews. The studies reviewed suggest that differential preferences and access to assets by men and women can affect adoption levels and the benefits that accrue to men and women. Findings show that women have less secure access to credit, land, inputs, extension, and markets. Similarly, women’s multi-faceted role in household management gives rise to preferences that may very well be different from those of men. Participatory Breeding and Participatory Varietal Selection are two methods shown to be successful in developing technology that is more appropriate and more likely to avoid unintended consequences. Regularly collecting gender-disaggregated statistics can also result in a greater understanding of how technology has affected both men and women. Agricultural technology has the potential to enhance both men’s and women’s welfare and productivity, but unless gender is sufficiently integrated into every step of the development and dissemination process, efforts will only achieve a fraction of their total possible benefit.