Evans School Policy Analysis & Research Group (EPAR)

Labor is one of the most productive assets for many rural households in developing countries. Despite the importance of labor—and time use more generally—little research has empirically examined the quality of time-use data in household surveys. Many household surveys rely on respondent recall, the reliability of which may decrease as recall length increases. In addition, respondents often report on time allocation for the entire household, which they may not know or recall as clearly as their own time allocation. Finally, simultaneous activities such as tending children while preparing dinner, may lead to the systematic underestimation of certain activities, particularly those that tend to be performed by women. This paper examines whether the identity of the survey respondent affects estimates of time allocation within the household. Drawing on the Ugandan LSMS-ISA household survey, we find that individuals responding for themselves report higher levels of time use over the previous week than when responding for other household members. Moreover, male respondents tend to underreport time allocation for females over the age of 15 as compared to female respondents, especially time spent on domestic activities. In addition, an analysis of the effects of two economics shocks—having a baby and floods or droughts—suggests that the identity of the respondent can affect substantive conclusions about the effects of shocks on household time use.

This brief summarizes the evidence base for various types of commonly-used time use measurements, lists categories of time use as identified by major organizations and reports, and identifies studies finding significant impacts of interventions designed to reduce specific time constraints. The various approaches to time use measurement method each have different limitations (cost, timing, seasonality, susceptibility to recall bias, etc.), which may have implications for data analysis. The choice of how to measure time use may be particularly important for analyzing women’s time use. For example, limiting respondents to one activity per time slot when measuring daily time allocation may underestimate women's productivity or time allocations, as they are more likely than men to conduct simultaneous activities, such as childcare along with other activities.

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors.