Selected evaluation projects and reports
Team Leader, independent evaluation of TradeMark East Africa (DFID and other donors). 2018-2019.
OPM: Culver, Keri; Cook, Andrew; Spilsbury, John; Rasulova, Saltanat; and Akkurt, Ozlem. 2019. Independent Evaluation of TradeMark East Africa Deliverable 3B: Performance Evaluation. https://devtracker.dfid.gov.uk/projects/GB-1-203307/documents The files are titled Evaluation report publish (1) for the report and Evaluation report publish (11) for the annexes.
OPM: Allison, Christine; Culver, Keri; Silva-Leander, Sebastian. 2019. Independent Evaluation of TradeMark East Africa Deliverable 5B: Poverty and Gender Impact Study. https://devtracker.dfid.gov.uk/projects/GB-1-203307/documents The files are titled Evaluation report publish (2) for the report and Evaluation report publish (12) for the annexes.
Evaluation Manager. Mid-term impact evaluation of the Consolidation and Enhanced Livelihoods Initiative (CELI) in Colombia: All reports and annexes.
Evaluation Manager, and technical team, component 3. For the Victims’ Unit, Government of Colombia. Evaluation of integral reparations in Colombia. With Harvard University Kennedy School of Government, Carr Center for Human Rights Policy and the Harvard Humanitarian Initiative. Executive Summary in English; Full Report in Spanish
Team lead/ Senior evaluator. For USAID/Afghanistan. Rule of Law Stabilization – Informal Component; Impact Evaluation Report. Report on evaluation research of informal justice capacity building program.
Team lead/Senior evaluator. For the United States Department of Agriculture and the U.S. Congress. USDA Local and Regional Food Aid Procurement Pilot Project – Independent Evaluation Report. Report presented to U.S. Congress and to USDA’s Foreign Agricultural Service, Office of Capacity Building, Food Assistance Division on 2011 research evaluating time and costs of procurement, market impact, and food quality of local and regional versus in-kind food aid.
Team lead/ Senior evaluator. For UNICEF Southern Sudan and the Government of Southern Sudan. Evaluation of the Go to School Initiative. Report on evaluation research.
Evaluations by Sector
Food aid, food security and social welfare
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Social cash transfer schemes | Zambia | Experimental design impact evaluation | UNICEF and DFID |
| Local and regional procurement of food aid pilot program | Twenty country study; I worked in Cambodia, Uganda, Zimbabwe, Zambia, Kenya and South Africa | Transactional comparative design; mixed methods | U.S. Department of Agriculture |
Gender and ethnicity
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Empowering Afro-Colombian women in conflict resolution and land titling | Colombia | Mixed methods with highly participatory design | USAID |
| Public Policy Reform across sectors; cross-cutting attention to gender | Colombia | Mixed methods | USAID |
| Women’s use of security sector services in tribal areas | Pakistan | Quasi-experimental design with mixed methods | DFID |
Impact evaluation
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Informal rule of law, or traditional dispute resolution | Afghanistan | Quasi-experimental differences in differences (DD) design with mixed methods | USAID |
| Social cash transfer schemes | Zambia | Experimental DD RCT design plus mixed methods | DFID, UNICEF |
| Women’s use of security sector services in tribal areas | Pakistan | Quasi-experimental design, matched pairs clusters, interrupted time series plus mixed methods | DFID |
| Urban job training, rural value chains, land titling and municipal govt for Afro-Colombian and Indigenous groups | Colombia | Quasi-experimental DD design plus mixed methods | USAID |
| Alternative development, social capital, value chains and associativity | Colombia | Quasi-experimental DD design with list experiment; mixed methods | USAID |
Security sector reform
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Informal rule of law, or traditional dispute resolution | Afghanistan | Quasi-experimental design with mixed methods | USAID |
| Broad-based security sector reform in tribal areas | Pakistan | Quasi-experimental design with mixed methods | DFID |
Primary, secondary and tertiary education
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| The Go to School Initiative; broad-based education reform | South Sudan (then Southern Sudan) | Mixed methods | UNICEF |
| Higher Education for Development partnerships project | Multiple | Mixed methods | USAID |
| The Africa Education Presidential Initiative; textbooks, teacher training, et al. | 40 countries in Africa; I worked in Ethiopia, Kenya and Zambia | Mixed methods | USAID |
| Needs assessment of girls’ educational opportunities in post-conflict areas | Liberia | Mixed methods needs assessment | USAID |
| Teacher training in continuous assessment | Zambia | Quasi-experimental design and mixed methods | USAID |
| Teacher training in basic literacy, child-centered learning (Spanish report) | Jamaica, Nicaragua, El Salvador, Ecuador, Guatemala, Peru, Dominican Republic, Bolivia, Honduras and Mexico | Quasi-experimental design and mixed methods | USAID |
| Youth financial literacy and entrepreneurship training programs | Varied studies; 20+ countries. I worked in Costa Rica, Poland, El Salvador, Mexico, Colombia, USA | Quasi-experimental design; mixed methods; evaluability assessment | Junior Achievement Worldwide |
| Multiple studies in multiple countries; I worked in Bosnia and Russia | Multiple studies in multiple countries; I worked in Bosnia and Russia | Mixed methods | U.S. Department of State |
Conflict-affected countries
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Victims’ reparations programming (Spanish report) | Colombia | Mixed methods | USAID; Government of Colombia; Harvard University |
| Informal rule of law, or traditional dispute resolution | Afghanistan | Quasi-experimental design with mixed methods | USAID |
| Security sector services and peace-building in tribal areas | Pakistan | Quasi-experimental design with mixed methods | DFID |
| Urban job training, rural value chains, land titling and municipal govt for Afro-Colombian and Indigenous groups | Colombia | Quasi-experimental design with mixed methods | USAID |
| Social capital, value chains, associativity and access to local government | Colombia | Quasi-experimental DD design with list experiment and mixed methods | USAID |
| Land mines survivors programming, including livelihoods and rehabilitation | Colombia | Mixed methods | USAID |
Sustainable livelihoods: urban and rural
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Alternative development, social infrastructure, value chains, access to finance | Colombia | Post-hoc mixed methods | USAID |
| Sustainable development, social capital, value chains and access to finance | Colombia | Quasi-experimental DD design with list experiment and mixed methods | USAID |
| Urban job training, rural value chains, land titling and municipal govt for Afro-Colombian and Indigenous groups | Colombia | Quasi-experimental design with mixed methods | USAID |
| Quality assurance for forestry and environment sector evaluations | Indonesia | Mixed methods | USAID |
| Labor market study on youth employment | El Salvador | Mixed methods | USAID |
Monitoring and indicator work
| Interventions | Country/ies | Design | Client |
|---|---|---|---|
| Security sector reform in tribal areas | Pakistan | Indicator design and collaboration with implementing team; also value-for-money framework and developing a research agenda | DFID |
| Multi-sector M&E including democracy and governance, and human and institutional capacity development | Pakistan | Performance monitoring planning and indicator development | USAID |
| Government strengthening programming | Georgia | Performance monitoring planning and indicator development | USAID |
| Rule of law, administration of justice programming | Kosovo | Performance monitoring planning and indicator development | USAID |
| Rule of law/ administration of justice; Human and institutional capacity development | Mexico | Performance monitoring planning and indicator development | USAID |
| Data Quality Audit across client portfolio | Ecuador | External periodic assessment of the quality of monitoring data | USAID |
| Database created for an education project | Central and South America and the Caribbean | Developed indicators and consensus; full beta testing and training in system use | USAID |
Training/capacity development
| Interventions | Country/ies | Content | Client |
|---|---|---|---|
| Trained 25 mid-level evaluators | Pakistan | 80 hours’ intensive Masters’-level evaluation theory and practicum over three months’ time | USAID |
| Trained 30 mid-level evaluators | Colombia | Semester-long, Masters’-level evaluation theory and practicum | USAID |
| Trained evaluation managers in evaluation policy and management | United States | Week-long intensive on use of tools to manage evaluations while complying with USAID policy | USAID, Social Impact |
| Trained monitoring team | Pakistan | Ongoing training to work with implementation team, gather and quality assure monitoring data | DFID |
| Trained teams of data collectors | El Salvador, Liberia, Guatemala, Zambia, Honduras, Nicaragua, DR, Ethiopia, Zambia, Zimbabwe, Pakistan, Afghanistan, Mexico, Cambodia, Ecuador, Bolivia, Colombia, S. Sudan | Field methods, ethics, tablets and pencil-and-paper surveys, in-depth interviewing, focus groups, list experiment, security, observation data. | Multiple projects and donors |
| Trained Ministry personnel | Zambia | Precepts of evaluation prior to impact evaluation to promote ownership | DFID and UNICEF |
| Trained multiple NGO teams in use of multi-project indicator database | Multiple countries, Central and South America and the Caribbean | Database of indicators across education portfolio and across LAC region | USAID |
Proposal writing
| Interventions | Country/ies | Client | Outcome |
|---|---|---|---|
| Aid transparency and research programming | Worldwide | Hewlett Foundation | To be determined |
| Indefinite quantity contract for monitoring, evaluation and learning services | Worldwide | USAID | To be determined |
| Advanced data monitoring system for multisectoral programming | Colombia | USAID/Olgoonik | Successful |
| Monitoring and evaluation programs | Guatemala, Colombia, Tanzania and others | USAID and MSI | Multiple wins, one bid unsuccessful |
| Evaluation of local and regional food aid procurement pilot | Twenty countries worldwide | U.S. Department of Agriculture, U.S. Congress | Successful |
| Youth financial literacy and entrepreneurship programming | Multiple worldwide | Junior Achievement Worldwide | Successful and years-long relationship with additional work |