From October 2016 to June 2017, Manuel Acevedo and I conducted the evaluation of the Open Data for Development program, a USD 15 million initiative (direct plus indirect funding) led by IDRC, the Government of Canada, The World Bank and DFID / UK Aid.
This has been a terrific experience on many levels. The most important one was acknowledging how advanced the field is and, even more important, how deep the sensation is that a point of no return has been crossed in terms of open data, open government, transparency, accountability, open development, etc. Some important outcomes will, of course, still take some time to take place, but the path is been paved and the trend is gaining momentum quickly, adding up critical mass at each stage.
The collaboration and excellent attitude of all the actors involved in the project (we interviewed 41 people and read more than 150 working documents and 128 bibliographic references) was another aspect of the work that is worth highlighting. Special gratitude goes to Fernando Perini, Erika Malich, Katie Clancy and Tricia Wind at IDRC. It is not every day that one finds people so willing to have their work thoroughly scrutinized, to explain things without making excuses, to expect the evaluation to be an opportunity to learn and to improve. Same goes for the team at the World Bank and the Government of Canada (especially Amparo Ballivian and Yohanna Loucheur, respectively).
This impression of people taking seriously their work, including third parties’ evaluation and insights is confirmed not only by the publication of the report with the evaluation of the Open Data for Development program, but also the publication of the response of the Management of the program to our evaluation, providing both context and commitment to the recommendations made by the evaluators.
Below can be downloaded the three documents generated by the evaluation: the full final report, the executive report and the management’s response.
If I am allowed to, I would like to state that both Manuel and I are quite proud of the recommendations we made at the final section of our evaluation. Of course, the recommendations come from the many and richest inputs that everyone we talked to or read about kindly gave us. These recommendations are as follows.
- OD4D: greater emphasis on the right side of the OD4D equation (i.e. “for development”)
- Reticulating OD4D: towards an expanded network vision for OD4D
- Build capacity for gender-purposeful programming
- Invest in strategic partnerships
- Greater engagement with the D4D community
- Support OD intermediaries
- Place knowledge management at the core of OD4D implementation processes
We hope the evaluation and, especially, the recommendations are useful not only for the program but for the whole open data and open data for development community. We remain at the disposal of anyone in need of more information, doubts or suggestions.
The evaluation focuses on both accountability and learning. The primary intention of the evaluation is to provide accountability to the program’s management and organizational governance structures for program results. In addition, it reflects upon OD4D’s implementation in order to inform future programming on open data for development themes. The process was guided by five evaluative questions, on (1) Results, (2) Design, (3) Management, (4) Policy and (5) Gender. The evaluation report addresses these five topics, and also refers to some cross-cutting issues which were identified during the process. The analysis is completed with a final section with key recommendations for the upcoming new phase of the program.
Acevedo, M. & Peña-López, I. (2017). Evaluation of the Open Data for Development program. Final report. Ottawa: IDRC.
Acevedo, M. & Peña-López, I. (2017). Evaluation of the Open Data for Development program. Executive report. Ottawa: IDRC.
International Development Research Center (2017). Management’s response to the independent evaluation of the OD4D program. Ottawa: IDRC.