Rolling Five-Year Development Evaluation Work Plan 2014-2015 - 2018-2019
Table of Contents
- List of Abbreviations
- Executive Summary
- Planned Evaluation Work - FY 2014-201
- 1.0 Background
- 2.0 DFATD's Development Evaluation Function
- 3.0 Developing the Work Plan
- 4.0 Planned Evaluations for FY 2014-2015
- 5.0 Additional Development Evaluation Division Activities for FY 2014-2015
- 5.1 Support to Branch-led Evaluations
- 5.2 Review of Country Program Evaluation Methodology
- 5.3 Commitments in Treasury Board Submissions
- 5.4 Optimizing the Use and Learning / Knowledge Benefits from Evaluations
- 5.5 Neutral Assessment of DFATD evaluation functions
- 5.6 Corporate Engagement
- 5.7 Strategic Alliances and Country Capacity
- 6.0 Program Branches' Evaluation Plans for FY 2014-2015
- 7.0 Budget
- Table 1 - On-going Program of Grants and Contributions
- Table 2 - Five-year Evaluation Schedule
- Table 3 - Resources Dedicated to the Evaluation Function
- Table 4 - Evaluation Commitments to TBS
- Table 5 - Establishing the Evaluation Universe
List of Abbreviations
- Country Development Programming Framework
- Network on Development Evaluation of the Development Assistance Committee (of the OECD)
- Department of Foreign Affairs, Trade and Development
- Financial Administration Act
- Global Issues and Development Branch
- Multilateral Organizations Performance Assessment Network
- Development Assistance Committee of the Organization for Economic Development and Cooperation
- Partnerships for Development Innovation
- Treasury Board
- Treasury Board Secretariat
The present Rolling Five-Year Development Evaluation Work Plan (hereafter, the Plan) identifies corporate evaluations scheduled for FY 2014-2015 to FY 2018-2019, with a focus on FY 2014-2015. The Plan also includes, for information, a list of Branch-led evaluations planned for FY 2014-2015.
In 2013, the Development Evaluation Division conducted an in-depth review of DFATD's development evaluation universe Footnote 1 with the intention of ensuring full evaluation coverage of the Department's direct program spending over 5 years and this plan has been developed to achieve that requirement.
Planned Evaluation Work - FY 2014-2015
In FY 2014-2015, the Development Evaluation Division will initiate and/or complete the following evaluations:
- Countries of concentration and regional programs: Country Program Evaluations of Mozambique and Tanzania; Ethiopia and Ghana; Indonesia; Bangladesh, as well as a program evaluation of the Canada Investment Fund for Africa.
- Countries of Modest Presence: An evaluation of programming in 8 countries with modest Canadian development assistance programs in the Americas, Asia and the Middle East.Footnote 2
- Fragile States: Country Program Evaluations of West Bank and Gaza, Afghanistan, Haiti and possibly South Sudan.
- Global Issues and Development (MFM): Review of the development effectiveness of the Inter-American Development Bank, the International Fund for Agricultural Development, the United Nations Population Fund and the International Organisation of la Francophonie.
- Partnerships for Development Innovation (PDI): An evaluation of the Partners for Development Program.
- Corporate evaluations: A meta-evaluationFootnote 3 of Branch-led evaluations.
- Horizontal Evaluations: A formative evaluation of Canada's contribution to the Maternal, Newborn and Child Health Initiative.
Equally important, the Development Evaluation Division will:
- Finalise the review and update of the current methodology for Country Program Evaluations, including the development of necessary tools and guides;
- Participate in the Multilateral Performance Assessment Network (MOPAN) Technical Working Group and Steering Committee and continue to provide technical inputs to both the MOPAN and DAC EvalNet networks on a potential amalgamation of their approaches to assessing of multilateral organisations;
- Produce a report on the state of performance measurement;
- Produce the second Report on Lessons from Development Evaluations;
- Jointly with the former DFAIT Evaluation Division commission a neutral assessment of the evaluation function, as required by the 2009 Treasury Board Evaluation Policy;
- Complete the Development Evaluation Quality Assurance Tools and Guides Suite intended to facilitate the execution of Branch-led evaluations by DFATD staff;
- Support Branch-led evaluation strategic planning and knowledge management;
- Provide technical advice on evaluation matters to the Open Agency Programming Process (APP) implementation and accompanying e-RoadMap;
- Serve as Secretariat for DFATD's Development Evaluation Committee.
If fully executed, this work plan would require an operations and management (O&M) budget of $2.7 million for FY 2014-2015, and a salary budget of $1.8 million for 19 full-time equivalents (FTEs).
This work plan puts forward the completion of 18 corporate evaluations in 2014-2015, 8 of which were initiated in 2013-2014.
Experience indicates that slippage will occur in an evaluation work plan executed in diverse low income and fragile states, due to a combination of unpredictable security and scheduling constraints, and contracting delays. For this reason, the practice instituted in 2013-14 of over-planning the number of evaluations to mitigate slippage and ensure full execution of allocated budget will be continued this year.
The scope and content of this Plan is consistent with the requirements of the 2006 Financial Administration Act (FAA) and the 2009 Treasury Board (TB) Policy on Evaluation. The Plan proposes an approach that will position DFATD's Development Evaluation Division to achieve 100% evaluation coverage of development grants and contributions and direct program spending as required by the FAA and the 2009 TB Policy on Evaluation, while contributing to the Department's learning and decision making needs. Footnote 4
There is strong demand, from both expert constituencies and the general public, for credible assessment of the results of international aid expenditure. Responding to this fundamental accountability requirement will remain a central purpose of the development evaluation function.
At the same time, there is an increasing commitment to innovation in DFATD's development programming - a purposeful effort to design, pilot and scale up the most effective and cost efficient ways of pursuing poverty reduction. In this environment, program planners and managers need timely feedback on what works well, in what circumstances and why. Providing such learning is the second and increasingly important aim of both corporate and Branch-led development evaluation at DFATD.
The Speech from the Throne in October 2013 highlighted the Government's commitment to helping the world's neediest by partnering with the private sector to create economic growth in the developing world. It also emphasized the achievement of concrete results and ensuring that foreign aid continues to be "focused, effective and accountable". Canada's leadership in the Commission on Information and Accountability for Women's and Children's Health is an example of efforts being made to show global leadership on results achievement, effectiveness and accountability.
The Government of Canada continues to encourage departments to use evaluation to strengthen programs. In line with the Financial Administration Act (FAA), the 2009 Treasury Board Policy on Evaluation requires that 100% of direct program spending be evaluated over a five-year cycle. The TB Policy on Evaluation also encourages the use of flexible evaluation approaches guided by risk, scale, and scope. It requires departments to develop a strategically focused evaluation plan that is founded on an assessment of evaluation risk, departmental priorities, and government priorities.
1.3 International Year of Evaluation - 2015
EvalPartners, a global movement to strengthen national evaluation capacities, has designated 2015 as the International Year of Evaluation as a way of advocating for evaluation and evidence-based policy making at international, regional, national and local levels. There will be a thematic focus on inclusion and innovation in evaluation during this year.
The UN General Assembly is expected to endorse 2015 as the International Year of Evaluation, with a primary aim of promoting enabling environments and capacity for evaluation in all member countries. This has particular implications for the Development Evaluation Division, as there will be an expectation of increased engagement with developing country evaluation functions for program evaluations in their countries.
In 2005, the Paris Declaration on Aid Effectiveness articulated a consensus on reforming donor and developing country approaches to delivering and using aid for better development results. The 2008 Accra Agenda for Action further built on the Paris Declaration by promoting policies and actions that improve transparency and accountability in strengthening aid effectiveness. Efforts to promote the Paris Declaration principles within the field of evaluation have continued with increasing numbers of country-led and joint evaluations. Other global trends include enhancing local evaluative capacities; promoting peer review and knowledge exchange; ensuring the identification of good practices, and adhering to recognized international standards in evaluation.
2.0 DFATD's Development Evaluation Function
2.1 DFATD Context
In July 2013, a decision was made to amalgamate the Canadian International Development Agency and the Department of Foreign Affairs and International Trade. The new Department of Foreign Affairs, Trade and Development (DFATD) was created. The two evaluation units that existed previously in the separate departments will be maintained in the coming year, with broadly unchanged focus and scope of work. One unit will focus on evaluating foreign affairs and trade-related initiatives and the other on development programming.
The Development Evaluation Division is part of the new Strategic Policy Branch of DFATD. It leads corporate evaluations, and provides Canadians, Parliamentarians, Ministers, central agencies, partners, beneficiaries and DFATD's management with credible, neutral, and evidence-based assessments of the relevance and performance of the Department's development strategies, programs and projects.
DFATD has a Development Evaluation Committee comprised of six external experts and five DFATD senior executives (including the Deputy Minister of International Development, who chairs the committee). This Committee acts as an advisory body to the Deputy Minister on development evaluation activities.
Program branches fund and manage their own project level evaluations, for which the Development Evaluation Division provides technical advice and quality assurance services. These evaluations typically cover investments below the sub program level of the Program Alignment Architecture, and because they are intended to benefit development partners, are funded from the Aid Budget, as per DFATD's Terms and Conditions for International Development Assistance.
Both corporate and branch-led evaluations contract external consultants for some aspects of evaluation execution. In the case of corporate evaluation, it is for data gathering and analysis, primarily in the field, while overall design, final reports and recommendations are often prepared in house.
The current Plan covers both corporate and branch-led evaluations, including some multi-donor initiatives, with respective responsibilities outlined below.
2.2 Responsibilities of the Development Evaluation Division
The Development Evaluation Division is responsible for:
- developing, in coordination with the respective Branches, the Rolling Five-Year Development Evaluation Plan, which includes corporate and branch-led evaluations;
- ensuring that corporate development evaluations are conducted in a neutral, rigorous and cost-effective manner;
- developing and implementing a dissemination approach to ensure that evaluative knowledge is broadly disseminated across the Department to promote organizational learning;
- instituting a systematic approach to track the implementation of recommendations in management responses and action plans;
- providing technical advice, training/coaching and quality assurance services to Branches in support of the evaluations they and/or their partners are managing;
- ensuring that the Department has continuous access to external development evaluation consultants via contractual mechanisms, in collaboration with the Contracting Policy and Support Services Division;
- reviewing and providing advice on the accountability and performance provisions to be included in Cabinet documents (memoranda to Cabinet, Treasury Board Submissions);
- forging and maintaining beneficial strategic alliances with key stakeholders, inside and outside the Department; and,
- supporting the Development Evaluation Committee to ensure effective governance and oversight.
2.3 Responsibilities of Program Branches
Program branches are responsible for:
- preparing annual multiyear evaluation work plans for inclusion in DFATD's Rolling Five-Year Development Evaluation Work Plan;
- ensuring that sufficient performance information is available to effectively support evaluations;
- providing comments on corporate evaluation deliverables (e.g. work plans, reports) and preparing management responses and action plans;
- managing their evaluations as set out in their multiyear evaluation work plans; accessing evaluation tools, technical advice, training/coaching and quality assurance services from the Development Evaluation Division in support of their evaluations; implementing approved management responses and/or action plans; and,
- disseminating evaluation results for learning and follow-up actions and to ensure transparency.
3.0 Developing the Work Plan
3.1 Key considerations
Several considerations were taken into account when developing DFATD's development evaluation work plan for FY 2014-2015:
- the FAA requirement that "every department conduct a review every five years of the relevance and effectiveness of each ongoing program for which it is responsible"; and the 2009 TB Policy on Evaluation requirement to achieve 100% evaluation coverage of direct program spending, also over 5 years;
- the results of the recent Review of DFATD's Country Program Evaluation Approach Footnote 5;
- the emphasis on the use of evaluation findings for program improvement and decision making, in line with recent Treasury Board guidance; and
- the need to ensure that the approaches and methodologies used in conducting DFATD evaluations take into account the evolving thinking on best practices in development evaluation, including the recent Treasury Board guidance on theory-based evaluation and assessing program resource utilization when evaluating federal programs.
As in 2013-14, the number of planned evaluations has been set at a slightly higher level than allocated budget resources would actually support, understanding that slippage can be expected in actual execution for a variety of reasons including security and scheduling constraints in target countries, and some unpredictability in contracting processes.
3.2 Coverage, Sequencing and Risk Analysis
In 2012/2013, the Development Evaluation Division conducted an in-depth review of DFATD's evaluation universe in order to ensure full evaluation coverage of the Department's direct developmental program spending over 5 years; a plan was developed to meet the 100% coverage requirement by 2017-2018.
At the same time, an examination of sequencing of evaluations was undertaken so that their usefulness and value would be optimized. As recommended by the Treasury Board Secretariat, sequencing was informed by considering a combination of needs and evaluation risks.Footnote 6 This assessment remains valid and continues to be reviewed during regular discussions with programme branches.
The proposed sequencing of evaluations in the current five-year cycle is outlined in Table 1. A description of the Department's evaluation universe can be found in Table 5.
3.3 Evaluations carried over from 2013-2014
Some evaluations are implemented over multiple fiscal years, sometimes due to scale and complexity, or because they are initiated later in a given fiscal year and can only be completed in the next. In addition to the planned evaluations described in Section 4 of this document, in 2014-2015 the Development Evaluation Division will complete several evaluations carried over from 2013-2014. These include:
|Evaluation||Expected Completion Date Footnote 7||Rationale|
|Haiti||May 2014||Complex evaluation that has required extensive consultation with branches and other government departments and has faced some contracting issues.|
|Afghanistan||May 2014||Implementation was delayed due to contracting issues.|
|Indonesia||May 2014||Implementation was delayed due to contracting issues.|
|West Bank/Gaza||October 2014||Initiated in 2013 and due to be completed in 2014.|
|Mozambique/Tanzania||October 2014||Initiated in 2013 and due to be completed in 2014.|
|Ethiopia/Ghana||October 2014||Initiated in 2013 and due to be completed in 2014.|
|Inter-American Development Bank||May 2014||Initiated in 2013 and due to be completed in 2014.|
|International Fund for Agricultural Development||May 2014||Initiated in 2013 and due to be completed in 2014.|
4.0 Planned Evaluations for FY 2014-2015
4.1 Countries of Focus and Modest Presence
The main emphasis will be on DFATD's 20 countries of focus, where at least 80% of bilateral resources are spent. In FY 2014-2015, the Development Evaluation Division will follow through on two pilot "country cluster evaluations" - Mozambique/Tanzania and Ethiopia/Ghana - where there are sectoral and programmatic similarities. This approach will allow thematic review and comparison of lessons within clusters - health and food security, respectively.
The Indonesia country program evaluation and the evaluation of the Canada Investment Fund for Africa, initiated in 2012-2013, will be completed in 2014-2015 and a country program evaluation for Bangladesh will be initiated.
In 2014-2015, a cluster evaluation of several modest presence countries in the Americas, the Middle East and Asia will examine thematic programming on children and youth, sustainable economic growth, and food securityFootnote 8.
4.2 Fragile States
The evaluations of Afghanistan and Haiti, both initiated in 2012-2013, will be completed by mid-2014-2015. An evaluation of West Bank and Gaza was initiated late in 2013-2014 and will also be completed in 2014-2015. The feasibility of updating the joint donor evaluation of South Sudan will also be examined, with a potential focus on lessons and guidance for future programming in this fragile context, as well as a case study of MNCH programming to support the corporate MNCH evaluation. Among others, these evaluations will examine the extent to which fragile state programming aligns with the OECD/DAC Principles for Good International Engagement in Fragile States and Situations. These principles direct international interventions in fragile states towards governance and state building for long-term stability.
4.3 Global Issues and Development
The Global Issues and Development Branch finances and supports a large number of international institutions and funds. The Development Evaluation Division has applied the DAC EvalNet methodology to assess the development effectiveness of these organizations using their own performance reporting and evaluation data. The approach, intended to be done jointly among donors, allows for coverage of a high number of institutions over a short period, at reasonable cost to each donor and with the leverage to affect needed changes.
Canada is also playing an active role in another donor network that measures the development effectiveness of multilateral organizations - the Multilateral Organisation Performance Assessment Network (MOPAN). An examination of the extent to which the DAC EvalNet and MOPAN methodologies are complementary was carried out in FY 2013-14. Consideration of greater coordination, and possible integration, of the two assessment approaches will be pursued in 2014-15, with a significant role being played by the Development Evaluation Division.
In FY 2014-15, the Development Evaluation Division will finalise reviews of the Inter-American Development Bank and the International Fund for Agricultural Development, and initiate reviews of the United Nations Population Fund and the International Organisation of la Francophonie.
4.4 Partnerships for Development Innovation
The new Partnerships for Development Innovation (PDI) Branch (formerly the Partnerships with Canadians Branch) is currently responsible for two sub-programs of DFATD's PAA - Partners for Development and Global Citizens; the former accounts for about 90% of PDI spending. Since 2010 it has operated through calls for proposals.
Given that the Chief Audit Executive will examine the proposal call process itself in 2014, the Development Evaluation Division will evaluate the relevance and effectiveness of the results from those calls since 2010. Any evidence of innovative approaches and/or partnerships that may have been achieved during that time will be captured. This is intended to inform the renewed mandate of this Branch to foster innovative approaches to poverty reduction.
4.5 Process Evaluations
In 2014-2015, a meta-evaluation will be initiated to assess the quality of Branch-led evaluations. As well, the annual report on the State of Performance Measurement will be prepared.
4.6 Horizontal Evaluations
Following the completion of an Evaluability Assessment of Canada's Contribution to the Maternal, Newborn and Child Health Initiative in 2013-14, a formative evaluation of this Initiative is planned for FY 2014-2015. This evaluation will assess progress to date and provide key lessons and recommendations to support evidence-based decision-making on policy, expenditure management and program improvement.
Following a Portfolio Review of DFATD's Natural Resource Governance Projects, which formed part of the evaluation of the Government of Canada's Corporate Social Responsibility Strategy for the Canadian International Extractive Sector, a thematic evaluation of projects related to natural resource governance and the extractive industry will be considered, beginning with an evaluability assessment.
The Development Evaluation Division will participate in the interdepartmental evaluation of the Canadian HIV Vaccine Initiative. This six-year initiative (2007/08 to 2012/13) received $139 million in funding from several Government of Canada departments and $28 million from the Gates Fundation. DFATD's contribution amounted to nearly $60 million. The evaluation will be led by Health Canada/Public Health Agency in collaboration with the Canadian Institutes of Health Research, Industry Canada and DFATD.
5.0 Additional Development Evaluation Division Activities for FY 2014-2015
5.1 Support to Branch-led Evaluations
The Development Evaluation Division will:
- Complete the Evaluation Quality Assurance Tools and Guides Suite;
- Develop guidelines to support Branch-led evaluation strategic planning and knowledge management;
- Provide technical advice on evaluation matters to the Open Agency Programming Process (APP) Implementation and accompanying e-RoadMap;
- Ensure that the new Department Programming Process includes up-to-date tools and guides for evaluation;
- Continue to provide technical advice and quality assurance services to Branch staff;
- Ensure that the Department has continuous access to external development evaluation consultants via contractual mechanisms in collaboration with the Contracting Policy and Support Services Division;
- Establish a central database to house all branch-led evaluations along with an automated retrieval system; and
- Ensure the inclusion of program branches' evaluation plans in the Rolling Five-Year Development Evaluation Work Plan.
5.2 Review of Country Program Evaluation Methodology
In 2013-2014, the Development Evaluation Division completed a review of the current methodology for country program evaluations. This review was endorsed by the Development Evaluation Committee in January 2014. The next step will be the preparation of renewed guidance and tools, to be completed by December 2014.
5.3 Commitments in Treasury Board Submissions
Over the past few years there have been several evaluation commitments made in Treasury Board Submissions to obtain approval for major initiatives. Four of the 19 evaluation commitments made to Treasury Board Secretariat between 2006-2007 and 2013-2014 are the responsibility of the Development Evaluation Division. The remaining evaluation commitments are the responsibility of the program branches. Table 4 presents a list of these evaluation commitments.
5.4 Optimizing the Use and Knowledge Benefits from Evaluations
Development evaluations at DFATD create a source of credible and neutral information, which feed into strategic reviews, renewals of terms and conditions, Treasury Board submissions, the Report on Plans and Priorities, the Departmental Performance Reports, and Memoranda to Cabinet. They also inform decision making on investments and program improvement.
While DFATD has traditionally benefited from an evaluative culture, there remains a need to optimize the use of findings, recommendations and lessons learned from evaluations. The Development Evaluation Division will review its approach to the use and dissemination of evaluation knowledge and will finalise a guide that seeks to increase the use of evaluation findings, recommendations and lessons learned, both within and outside the Department.
The second Report on Lessons Learned from Development Evaluations will be produced in order to ensure the wide dissemination of evaluation knowledge in 2014. This report communicates key lessons derived from corporate evaluations and presents one-page summaries of the evaluations reviewed.
In 2014-2015, the Development Evaluation Division will:
- Revise the Approach to the Dissemination of Evaluation Knowledge to include an emphasis on the use of evaluation findings;
- Finalise a guide to support the use of evaluation knowledge;
- Produce the second Lessons from Development Evaluation report (formerly called "CIDA Learns");
- Promote evaluation knowledge and lessons learned via Evaluation Learning Cafés;
- Provide guidance to Branches on the preparation of evaluation summaries;
- Use DFATD's knowledge networks to share findings and lessons from evaluations; and,
- Prepare for events to be conducted during 2015, which is the International Year of Evaluation.
5.5 Neutral Assessment of DFATD evaluation functions
In 2014-15, a neutral assessment of DFATD's evaluation functions will be carried out as part of the Department's compliance with the TB Policy on Evaluation. This assessment will examine the level of compliance with the Policy, the use of evaluation evidence, and the extent of coherence between decentralized and corporate development evaluation.
5.6 Corporate Engagement
Support and input will be provided to corporate-level initiatives, such as: the Departmental Performance Report; the Report on Plans and Priorities; and Management Accountability Framework. The DFATD Program Committee will be engaged in periodic review of the status of implementation of corporate evaluation recommendations.
5.7 Strategic Alliances and Country Capacity
Constructive working relationships with the Foreign Affairs and Trade Evaluation Division, and the Treasury Board Secretariat's Centre of Excellence for Evaluation will be maintained. More active participation in the Canadian Evaluation Society and the possibility of introducing their accredited evaluator designation as an asset qualification in RFP processes will be pursued.
Internationally, the Development Evaluation Division will focus its engagement with the Network on Development Evaluation of the Development Assistance Committee (of the OECD) in order to remain abreast of emerging thinking in the field of international development evaluation. It will also play an active role in the Multilateral Organisation Performance Assessment Network (MOPAN) as a member of its Technical Working Group and Steering Committee, with a view to promoting the uptake of an integrated methodology to assess the development effectiveness of multilateral organizations.
On-going relationships with the Nordic + Evaluation Group and 3ie (a network on impact evaluation) will continue. The EvalPartners initiative to build evaluation capacity in developing countries will be monitored, and the Development Evaluation Division will seek approval for a modest contribution to a multi donor initiative focused on a targeted sub-set of those countries.
Ongoing engagement with these communities of practice is important to maintain and strengthen Canadian leadership in development evaluation, and to ensure continuing exposure to emerging good practices and approaches.
6.0 Program Branches' Evaluation Plans for FY 2014-2015
Program branches conduct evaluations to improve the effectiveness of projects and programs that benefit developing countries.
The following section describes the evaluation activities planned by the branches during the FY 2014-2015 period. Branch-led activities complement the Development Evaluation Division's work by providing performance assessments, monitoring data, and other relevant information.
6.1 Geographic Program Branches - Branch-led Evaluations Planned for FY 2014-2015
Monitoring, evaluation and reporting is ongoing in the various geographic programs branches. The list below provides a provisional plan for FY 2014-2015.
|Bolivia||Supporting Agro-Industrial Production and Exports|
|Active Communities for Healthy Mothers and Children in Bolivia|
|Caribbean||Disaster Risk Management - Health Sector|
|Caribbean Disaster Risk Management Program|
|Partnership for CARICOM Private Sector Development|
|Caribbean Local Economic Development|
|Promotion of Regional Opportunities for Produce through Enterprise and Linkages|
|Central America (Guatemala, Honduras, Nicaragua)||Sectoral Support Fund|
|Colombia||Assistance to Landmine Survivors|
|Protecting the Rights of Conflict-Affected and Vulnerable Children and Youth|
|Haiti||Services semi-autonomes en électricité|
|Coopération volontaire en appui à la gouvernance et à l'éducation - phase II|
|Prise en charge intégrée de la santé de la mère et de l'enfant dans l'Artibonite|
|Projet d'appui technique en Haiti|
|Inter-American||OAS Cooperation Plan|
|Improved Health and Increased Protection from Communicable Diseases for Women, Children and Excluded Populations in Situation of Vulnerability in Latin America and the Caribbean|
|Strengthening the Role of Parliaments In Democratic Governance|
|Honduras||Clustered evaluation of Food Security/Rural Development projects:|
|Clustered evaluation of Value-Chain projects, covering:|
|Prevention and Control of Chagas and Leishmaniasis Diseases|
|Nicaragua||Support to the Productive Rural Development Sector Program (PRORURAL)|
|Peru||Strengthening Regional Governments for Social and Economic Development (ProGobernabilidad)|
|Ethiopia||Benishangul-Gumuz Food Security and Economic Growth|
|Market-based Solutions for Improved Livelihoods|
|Kenya||Sustainable School Feeding in Kenya|
|Mozambique||Support for Education Materials in Mozambique|
|Support to Ministry of Health PROSAUDE|
|Promotion of a Literate Environment|
|Community-Based Health Training Practice|
|Pan Africa Regional Program||Institutional Support to the African Medical and Research Foundation|
|Enablis East Africa|
|South Africa||South Africa HIV/AIDS Response Fund|
|Epidemiological Modelling for HIV/AIDS|
|South Sudan||Building Community Resilience|
|Mali||Strengthening the Decentralized Health Systems|
|Health Workers Training (DECLIC)|
|Support to agricultural networks in Mali (PAFA)|
|Ghana||Food Security and Environment Facility (FSEF)|
|Afghanistan||Support to the Mine Action Program of Afghanistan (MAPA)|
|Strengthening Emergency Relief and Disaster Management Capacity of the Afghan Red Crescent Society|
|Teacher Certification and Accreditation (TCAP)|
|Girls Education Support Program|
|Community-Based Girls Education Project (GEP)|
|Basic Education Consortium|
|Improving Nutrition for Mothers, Newborns and Children|
|Maternal and Under 5 Nutrition and Child Health|
|Mother and Newborn Child Health - Aga Khan Foundation Canada|
|Bangladesh||Health, Population and Nutrition Development Program (SWAP)|
|Joint GoB-UN Maternal and Neonatal Health|
|Health for Human Resources|
|Institutional Support for International Centre for Diarrhoeal Disease Research, Bangladesh (ISICDDR, B)|
|Strengthening Comptrollership and Oversight of Public Expenditure, SCOPE|
|Burma||Building Social Capital - Burma Border Assistance Program|
|Indonesia||Agroforestry and Forestry in Sulawesi: Linking Knowledge with Actions|
|Canada Indonesia Private Sector Enterprise Development (CIPSED)|
|Better Approaches to Service Provision|
|Environmental Governance (EGSL)|
|Support to Indonesia's Islands of Integrity|
|Restoring Coastal Livelihoods (RCL)|
|Pakistan||Financial Literacy and Business Development Services for Women|
|Community Infrastructure Improvement|
|Vietnam||Soc Trang Small and Medium-Sized Enterprise Development|
|Ha Tinh Agricultural Development|
|Egypt||Decent Employment for Youth Project|
|Morocco||Support to School Management in Morocco|
|MENA||MENA MSME Technical Assistance Facility|
|Ukraine||2012 Elections programming|
|West Bank & Gaza||Improved Framework Conditions for Palestinian Businesses|
|Capacity Development in Forensic Science and Medicine|
|Capacity Development for Facilitating Palestinian Trade (PalTrade)|
|Export Development in the West Bank UNCTAD|
6.2 Partnerships for Development Innovation- Branch-led Evaluations Planned for FY 2014-2015
The Partnerships for Development Innovation (PDI) Branch maintains a Rolling Four-Year Evaluation Plan. The 2014-2015 to 2017-2018 Plan focuses on the implementation of two types of Branch-led evaluations: specific project evaluations on an exceptional basis (for example, in the case of Treasury Board requirements) and group thematic evaluations.
Group thematic evaluations comparatively assess several projects related to the same development theme or addressing the same development problem. Since these evaluations are not limited to a single project, organization or country, their findings are applicable across country contexts, they interest a broad range of development actors, and they provide greater benefit to people in developing countries because they produce broad learning and recommendations applicable to many situations and contexts.
For FY 2014-2015, Partnerships for Development Innovation plans to execute the following group thematic evaluations in programming areas of priority for the Department:
- Community Based Interventions in Maternal, Newborn and Child Health;
- Children and Youth Protection; and,
- Partnerships with Extractive Industries
In FY 2014-2015, PDI also plans to initiate the process to undertake selected group thematic evaluations of projects chosen for funding in December 2011 through the "Under $2 Million" Call for Proposals. In the context of Calls for Proposals, this comparative approach to evaluation will enable PDI to identify and promote the most successful practices applied by partners to deliver development results on the ground, and apply these findings to selection mechanisms and criteria for future programming.
The programming areas that will be assessed through the group thematic evaluations of the "Under $2 Million" Call for Proposals will reflect the thematic focus of funding approved under the entire Call focusing on strategic sub-themes that offer promising opportunities for learning and knowledge sharing.
Partnerships for Development Innovation will also execute the following specific project performance evaluations in FY 2014-2015 principally to meet specific evaluation commitments to Treasury Board:
- Formative evaluation of the Aga Khan Foundation Canada's Partnership for Advancing Human Development in Africa and Asia Initiative;
- Summative evaluation of the Canadian International Food Security Research Fund (CIFSRF) Phase 1;
- Summative evaluation of the Canadian Francophonie Scholarship Program;
- Formative evaluation of the Statistics Canada Strengthening National Statistics Systems Initiative; and
- Evaluation of the Canada Fund for African Climate Resilience.
6.3 Global Issues and Development Branch (MFM) - Branch-led Evaluations Planned for FY 2014-2015
Global Issues and Development Branch (MFM) engages in three distinct types of development and humanitarian programming and therefore engages in three distinct approaches to evaluations.
Long-term Institutional Support
Canada, both as a member of the governing board and through direct consultation with the institution, participates actively alongside other donors in evaluation processes, including reviewing evaluations and providing direction on recommendations. Examples of evaluations being completed by our partners in 2014-2015 include:
- Role of UNDP in supporting national achievement of the MDGs, UNDP;
- Child protection: Combating Violence against Children, UNICEF;
- Evaluation of World Bank Group Support to Health Financing in Improving Health System Performance, World Bank.
Overarching assessments of key partners, such as through the Multilateral Organisation Performance Assessment Network (MOPAN) and multi-donor Development Effectiveness Reviews, provide further opportunities for dialogue and comparison.
Each global initiative supported by DFATD has a strong monitoring and reporting component. These evaluations generally take the form of a mid-term and final evaluation. In most cases, the evaluation is conducted by the partner. DFATD, and other donors, frequently play a role in the process but the relationship is supportive rather than prescriptive. In a few instances, DFATD conducts the evaluation. Examples of evaluations of global initiatives taking place in 2014-2015 supported by the Branch include:
- Improving Nutrition through Homestead Food Protection, Helen Keller International;
- Catalytic Initiative/Integrated Health Systems Strengthening, UNICEF.
International Humanitarian Assistance
Although DFATD supports evaluations conducted by our humanitarian partners on their programming, DFATD also supports system-wide learning, to determine better how the humanitarian response system as a whole is meeting identified needs. The Office for the Coordination of Humanitarian Affairs (OCHA), conducts evaluations to promote transparency, accountability and learning through systematic and objective judgments about the relevance, efficiency, effectiveness and impact of humanitarian interventions.
DFATD also supports specific learning and evaluation mechanisms, such as the Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP). In almost all instances, DFATD's NGO partners include monitoring and evaluation as part of the project - this pertains to both emergency response and complex humanitarian initiatives. In some cases, DFATD conducts an evaluation. In addition to real-time evaluations following a crisis, examples of evaluations being undertaken in 2014-2015 include:
- Inter-agency evaluation of the Large Scale response for Typhoon, United Nations Office for the Coordination of Humanitarian Affairs;
- Joint Summary Evaluation Report of the FAO/WFP-led Global Food Security Cluster, World Food Programme.
The list below provides a provisional plan for FY 2014-2015 evaluations for which the Global Issues and Development Branch is directly involved.
|Evaluation||Evaluation Type||Start Date|
|Evaluation of Canadian Food-Grains Bank||Final Evaluation||2014|
|Nutrition and Health Integration for Maternal, Newborn and Child Health (Micronutrient Initiative)||Endline Evaluation||2014|
|Accelerating Progress in Maternal and Newborn Health (H4+)||Final Evaluation||2014|
|Global Environment Facility||Gender Equality Institutional Assessment||2014|
|Canadian HIV Vaccine Initiative (CHVI)||Project Evaluation||2014|
|Agenda for Action on Women, Girls and HIV (UNAIDS)||Final Evaluation||2015|
In 2012-13 there was under execution of actual vs. planned budget for evaluation. This arose from, among other reasons, postponed field missions (security and embassy constraints) and contracting delays.
The 2013-14 evaluation work plan was therefore purposely constructed at a level of activity 20% greater than the expected budget, on the reasoning that some level of slippage would inevitably occur across a portfolio of evaluations in diverse low income and fragile contexts.
As a result, the overall level of realized evaluation activity in 2013-14 increased over the previous year, and planned budgets for salary, and operations and maintenance (O&M) were fully executed. It is proposed to carry on with this modest over planning in 2014-15.
A total of 12 corporate development evaluations were underway or completed in 2013-14. A total of 18 evaluations are planned for 2014/15, with 8 ongoing and 10 new evaluations.
7.1 Non-Salary O&M
A budget of $2.7 million is planned for FY 2014-2015 in order to implement ongoing and proposed new evaluations. This covers the costs of engaging external professional expertise, and other non-salary costs including staff travel and translation.
7.2 Salary Budget
For 2014-15 the Development Evaluation Division has a planned salary budget of $1.8 million and a staff complement of 19 full-time equivalents (FTEs): the Director, 17 evaluators and 1 administrative support staff.
|Select Organization||Foreign Affairs, Trade and Development Canada (incl. EDC)|
|Identify PAA used:||2013-2014|
|Spending Source Used (include Year):||Main Estimates (2014-15)|
|Identify total organizational spending ($) (e.g. Total Budget Main Estimates, Total Expenditures of the Public Accounts, etc.)||$3,039,696,666.00|
|Identifier||Link to PAAFootnote 9 #(s)||Proposed Title of the Evaluation||Identify Policy on Evaluation Coverage Requirement:||Horizontal Evaluation (Indicate No/Lead/ Participant)Footnote 10||Involves Public Opinion ResearchFootnote 11||Date Last Evaluated (Deputy Head Approval Date) (M/Y)||Planned Evaluation Start Date (M/Y)||Planned Deputy Head Approval Date (M/Y)||Estimated G&C Value ($)Footnote 12 Footnote 13||Estimated ValueFootnote 14 (Including Gs&Cs) ($)||Comments|
|1314.1||3.3.5||Indonesia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||2009||06/2012||09/2014||$23,831,379.00||$24,901,394.00|
|1314.2||3.2.2, 3.2.3||Ghana and Ethiopia Cluster Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||G: 06/2008 E: 01/2010||04/2013||09/2014||$157,929,903.00||$161,229,579.00||Added Main Estimate figures for Ghana and Ethiopia|
|1314.3||3.2.5, 3.2.8||Tanzania and Mozambique Cluster Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||T: 02/2006 M: 02/2010||03/2013||09/2014||$173,591,302.00||$176,965,439.00||Added Main Estimate figures for Mozambique and Tanzania|
|1314.4||3.1.3||Haiti Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||05/2003||04/2012||09/2014||$89,492,331.00||$93,870,614.00|
|1314.5||3.1.5||West Bank / Gaza Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2013||09/2014||$69,222,629.00||$70,864,590.00|
|1314.6||3.1.2||Afghanistan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||05/2007||10/2011||09/2014||$86,991,921.00||$90,112,705.00|
|1314.7||3.4||Inter-American Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||10/2013||08/2014||$0.00||$0.00|
|1314.8||3.4||International Fund for Agriculture Development (IFAD) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2013||08/2014||$12,500,000.00||$12,500,000.00|
|1314.9||3.2, 3.3, 3.4.1||Evaluation of Corporate Social Responsibility Strategy for the Extractive Sector||Ongoing Programs of Grants and Contribution||Horizontal Participant||No||N/A||10/2013||08/2014||$0.00||$0.00|
|1415.1||3.2.1||Bangladesh Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||01/2009||04/2014||04/2015||$59,000,000.00||$60,402,001.00|
|1415.2||3.1.4||South Sudan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||12/2010||04/2015||04/2016||$68,128,303.00||$70,005,582.00|
|1415.3||3.2, 3.3||Canada Investment Fund for Africa Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2015||$0.00||$0.00|
|1415.4||3.2.10, 3.3.8||Modest Presence Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2015||$72,059,232.00||$76,716,618.00|
|1415.5||3.4||International Organization of la Francophonie Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2014||04/2015||$5,200,000.00||$5,200,000.00|
|1415.7||3.4||United Nations Population Fund (UNFPA) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2014||04/2015||$17,350,000.00||$17,350,000.00|
|1415.8||3.1, 3.2, 3.3, 3.4, 3.5||Muskoka Formative Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2015||$135,709,000.00||$135,709,000.00||This amount represents the funding for MNCH-related programming from MFM's Initiative-specific programming|
|1415.9||3.5||Partners for Development Program||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2015||$234,086,138.00||$245,787,195.00|
|Total Year 1||$1,205,092,138.00||$1,241,614,717.00|
|1516.1||3.3.7||Ukraine Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||06/2011||04/2015||04/2016||$20,029,463.00||$21,060,045.00|
|1516.2||3.2.9||Vietnam Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||07/2010||04/2015||04/2016||$19,991,007.00||$20,914,177.00|
|1516.3||3.2.10, 3.3.8||Modest Presence Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||N/A||04/2015||04/2016||$119,048,216.00||$121,263,073.00|
|1516.4||3.4||Caribbean Development Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2015||04/2016||$16,706,000.00||$16,706,000.00|
|1516.5||3.4||Global Environmental Facility (GEF) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2015||04/2016||$54,750,000.00||$54,750,000.00|
|1516.6||3.4||World Food Programme (WFP) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2015||04/2016||$25,000,000.00||$25,000,000.00|
|1516.7||3.4||UN Women Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2015||04/2016||$10,000,000.00||$10,000,000.00|
|1516.8||3.4||Office of the United Nations High Commissioner for Refugees (UNHCR) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2015||04/2016||$14,000,000.00||$14,000,000.00|
|1515.9||3.4||Commonwealth Institutions Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||04/2016||$12,600,000.00||$12,600,000.00||Commonwealth Fund for Technical Cooperation + Commonwealth of Learning|
|1516.10||3.1, 3.2, 3.3, 3.4, 3.5||Muskoka Initiative Summative Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||N/A||04/2015||04/2016||$0.00||$0.00|
|1516.11||3.2, 3.3||Evaluation of Regional Programs (Inter-American, Pan-African, Southeast Asia)||Ongoing Programs of Grants and Contribution||Non-Horizontal||07/2011||04/2015||04/2016||$95,655,975.00||$99,732,968.00||Low income regional programs' + 'middle income regional programs'.|
|Total Year 2||$387,780,661.00||$396,026,263.00|
|1617.1||3.2.7||Senegal Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||02/2011||04/2016||04/2017||$49,675,791.00||$51,225,755.00|
|1617.2||3.3.4||Honduras Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2011||04/2016||04/2017||$24,012,826.00||$35,305,637.00|
|1617.3||3.3.6||Peru Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||07/2012||04/2016||04/2017||$25,000,000.00||$25,699,069.00|
|1617.4||3.4||African Development Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||10/2013||04/2016||04/2017||$108,538,000.00||$108,538,000.00|
|1617.5||3.4||United Nations Development Programme (UNDP) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||04/2012||04/2016||04/2017||$48,000,000.00||$48,000,000.00|
|1617.6||3.4||Global Fund to Fight for AIDS, Tuberculosis and Malaria (GFATM)||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2016||04/2017||$180,000,000.00||$180,000,000.00|
|1617.7||3.4||United Nations Central Emergency Response Fund (CERF)||Ongoing Programs of Grants and Contribution||Non-Horizontal||n/a||04/2016||04/2017||$29,400,000.00||$29,400,000.00||Included in the universe for the first time|
|1617.8||3.1.1||Humanitarian Assistance Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||08/2012||04/2016||04/2017||$363,400,000.00||$364,655,984.00|
|Total Year 3||$828,026,617.00||$ 842,824,445.00|
|1718.1||3.2.4||Mali Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||02/2014||04/2017||04/2018||$106,500,000.00||$125,437,842.00|
|1718.2||3.3.1||Bolivia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||04/2014||04/2017||04/2018||$9,010,963.00||$9,437,848.00|
|1718.3||3.3.2||Caribbean Regional Program evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||02/2013||04/2017||04/2018||$49,553,027.00||$56,602,684.00|
|1718.4||3.3.3||Colombia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||04/2013||04/2017||04/2018||$23,194,937.00||$23,959,382.00|
|1718.5||3.4||Asian Development Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||01/2013||04/2017||04/2018||$47,700,000.00||$47,700,000.00|
|1718.6||3.4||World Health Organization Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||12/2012||04/2017||04/2018||$42,700,000.00||$42,700,000.00||This amount is equivalent to MFM's reference level budget for global health initiatives|
|1718.7||3.4||Consultative Group on International Agriculture Research ( CGIAR) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2017||04/2018||$15,370,000.00||$15,370,000.00|
|1718.8||3.4||UNAIDS||Ongoing Programs of Grants and Contribution||Non-Horizontal||03/2009||04/2017||04/2018||$5,400,000.00||$5,400,000.00|
|1718.9||3.4||International Committee of the Red Cross (ICRC)||Ongoing Programs of Grants and Contribution||Non-Horizontal||n/a||04/2017||04/2018||$6,000,000.00||$6,000,000.00||Included in the universe for the first time|
|1718.10||3.4||GAVI Alliance (GAVI)||Ongoing Programs of Grants and Contribution||Non-Horizontal||n/a||04/2017||04/2018||$10,000,000.00||$10,000,000.00||Included in the universe for the first time|
|Total Year 4||$315,428,927.00||$342,607,756.00|
|1819.1||3.3.5||Indonesia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.2||3.2.2, 3.2.3||Ghana Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.3||3.2.2, 3.2.3||Ethiopia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.4||3.2.5, 3.2.8||Tanzania Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.5||3.2.5, 3.2.8||Mozambique Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.6||3.1.3||Haiti Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.7||3.1.5||West Bank / Gaza Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.8||3.2.6||Pakistan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$27,641,719.00||$28,909,307.00|
|1819.9||3.1.2||Afghanistan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00||$0.00|
|1819.10||3.4||UNICEF Development Effectiveness Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$18,000,000.00||$18,000,000.00|
|1819.11||3.4||Inter-American Development Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2019||$0.00|
|1819.12||3.4||International Fund for Agricultural Development (IFAD) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||09/2014||04/2018||04/2018||$0.00|
|1819.13||3.4||Canadian Foodgrains Bank||Ongoing Programs of Grants and Contribution||Non-Horizontal||04/2018||04/2018||$25,000,000.00||$25,000,000.00||Included in the universe for the first time|
|1819.14||3.5||Global Citizens Program||Ongoing Programs of Grants and Contribution||Non-Horizontal||N/A||04/2018||04/2018||$19,450,638.00||$20,742,056.00|
|Total Year 5||$90,092,357.00||$92,651,363.00|
|Operational Costs for multilateral organisations (this amount has been kept separate as the PAA for DFATD-Development is not aligned with the units used for evaluation purposes - i.e., institutional level)||$17,932,000.00|
|Spending not subject to the Policy on EvaluationFootnote 9|
|Total spending not subject to the Policy on Evaluation||$0.00||$0.00|
|% of spending accounted for||96.51%|
|Title of Ongoing Program of Gs&Cs Footnote 15||Title of Corresponding Voted Gs&Cs Listed in the Main Estimates||Estimated Voted Gs&Cs Value ($) Footnote 16||Estimated Program Value ($)||Program Start Date (M\Y) Footnote 17||Program End Date (M/Y or ongoing)||Date of Next Planned Evaluation (Expected Deputy Head Approval Date) (M/Y)||Date Last Evaluated (Deputy Head Approval Date) (M/Y)||Title of Last Evaluation||Comments|
|Humanitarian assistance||Fragile states and crisis-affected communities||$363,400,000.00||$364,655,984.00||Ongoing||04/2017||08/2012||Evaluation of CIDA's Humanitarian Assistance 2005-2011|
|Afghanistan||Fragile states and crisis-affected communities||$86,991,921.00||$90,112,705.00||05/2009||Ongoing||09/2014||05/2007||Review of the Afghanistan Program|
|Haiti||Fragile states and crisis-affected communities||$89,492,331.00||$93,870,614.00||05/2009||Ongoing||09/2014||05/2003||Corporate Evaluation of Haiti Program (1994-2002)|
|South Sudan||Fragile states and crisis-affected communities||$68,128,303.00||$70,005,582.00||05/2009||Ongoing||04/2015||12/2010||A Multi-donor Evaluation of Support to Conflict Prevention and Peacebuilding Activities in Southern Sudan 2005-2010|
|West Bank and Gaza||Fragile states and crisis-affected communities||$69,222,629.00||$70,864,590.00||05/2009||Ongoing||09/2014||N/A|
|Bangladesh||Low-income countries||$59,000,000.00||$60,402,001.00||05/2009||Ongoing||04/2015||01/2009||Bangladesh Country Program Evaluation 2003-2008|
|Ethiopia||Low-income countries||$77,929,903.00||$79,567,406.00||05/2009||Ongoing||09/2014||01/2010||Ethiopia Country Program Evaluation 2003-2004 to 2008-2009|
|Ghana||Low-income countries||$80,000,000.00||$81,662,173.00||05/2009||Ongoing||09/2014||06/2008||Evaluation of CIDA's Program in Ghana 1999-2005|
|Mali||Low-income countries||$106,500,000.00||$125,437,842.00||05/2009||Ongoing||04/2018||02/2014||Canada - Mali Cooperation Program Evaluation|
|Mozambique||Low-income countries||$73,900,000.00||$75,524,353.00||05/2009||Ongoing||09/2014||07/2010||Mozambique Country Program Evaluation 2004-2005 to 2008-2009|
|Pakistan||Low-income countries||$27,641,719.00||$28,909,307.00||05/2009||Ongoing||04/2019||2013-14||CIDA Pakistan Program Evaluation|
|Senegal||Low-income countries||$49,675,791.00||$51,255,755.00||05/2009||Ongoing||04/2017||02/2011||Evaluation of CIDA's Senegal Program from 2001 to 2010|
|Tanzania||Low-income countries||$99,691,302.00||$101,441,086.00||05/2009||Ongoing||09/2014||02/2006||Evaluation of CIDA Tanzania Program|
|Vietnam||Low-income countries||$19,991,007.00||$20,914,177.00||05/2009||Ongoing||04/2016||07/2010||Evaluation of CIDA's Investments in Vietnam - July 2010|
|Low- income countries of modest presence||Low-income countries||$72,059,232.00||$76,716,618.00||05/2009||Ongoing||04/2015||2010||Review of Program-based Approaches|
|Low- income regional programs||Low-income countries||$54,175,032.00||$56,923,417.00||05/2009||Ongoing||04/2015||02/2013||Caribbean Regional Program Evaluation 2006-2011|
|Bolivia||Middle-income countries||$9,010,963.00||$9,437,848.00||05/2009||Ongoing||04/2018||05/2007||Bolivia Country Program Evaluation|
|Caribbean Regional Program||Middle-income countries||$49,553,027.00||$56,602,684.00||05/2009||Ongoing||04/2018||02/2013||Caribbean Regional Program Evaluation 2006-2011|
|Colombia||Middle-income countries||$23,194,937.00||$23,959,382.00||05/2009||Ongoing||04/2018||04/2013||Colombia Country Program Evaluation 2006-2011|
|Honduras||Middle-income countries||$24,012,826.00||$25,305,637.00||05/2009||Ongoing||04/2017||09/2011||Evaluation of CIDA's Honduras Program from 2002 to 2010|
|Indonesia||Middle-income countries||$23,831,379.00||$24,901,394.00||05/2009||Ongoing||04/2019||06/2014||Evaluation of CIDA's Indonesia Program|
|Peru||Middle-income countries||$25,000,000.00||$25,699,069.00||05/2009||Ongoing||04/2017||07/2012||Evaluation of CIDA's Peru Program from 2005 to 2010|
|Ukraine||Middle-income countries||$20,029,463.00||$21,060,045.00||05/2009||Ongoing||04/2016||06/2011||Evaluation of CIDA's Ukraine Program from 2004 to 2009|
|Middle- income countries of modest presence||Middle-income countries||$119,048,216.00||$121,263,073.00||05/2009||Ongoing||04/2014||2010||Review of Program-based Approaches|
|Middle- income regional programs||Middle-income countries||$41,480,943.00||$42,809,551.00||05/2009||Ongoing||04/2014||2011||Inter-American Regional Program Evaluation|
|International development policy||Global Engagement and Strategic Policy||$5,433,689.00||$18,045,621.00||Ongoing||tbd||2008||Evaluation of CIDA's Implementation of its Policy on Gender Equality|
|Multilateral strategic relationships||Global Engagement and Strategic Policy||$679,530,000.00||$686,567,340.00||Ongoing||Several dates||Several dates||Various sub-program evaluations|
|Multilateral and global programming||Global Engagement and Strategic Policy||$266,279,455.00||$269,095,980.00||Ongoing||Several dates||Several dates||Various sub-program evaluations|
|Partners for development||Canadian Engagement for Development||$234,086,138||$245,787,195||07/2010||Ongoing||04/2015||n/a||Partnerships with Canadians Governance Program Evaluation - 2008-2012||This evaluation was carried out on one thematic area only|
|Global Citizens||Canadian Engagement for Development||$19,450,638||$20,742,056||07/2010||Ongoing||04/2018||2011||Volunteer Cooperation Agreement Evaluation|
|% of the dollar value of Voted Grants and Contributions from the Main Estimates accounted for:||100.00%|
|Forecasted Spending (Budget)|
|Forecasted Spending (Budget)|
|Contracted Services - Specific to Evaluations||$1.8m||$2.5m||$2.5m|
|Operations and Maintenance (excluding Contracted Services Specific to Evaluations)||$0.25m||$0.3m||$0.3m|
Table 4 - Evaluation Commitments to TBS Footnote 18
The table below presents specific evaluation commitments indicated in the TB Submissions that were approved between FY 2006-2007 and FY 2013-2014. It excludes evaluation commitments already completed.
Note: * PB: Program Branch ED: Development Evaluation Division
|TB Submission (abridged title)||Lead*||Evaluation Commitments made to TBS and TB Conditions|
|1. Muskoka Initiative||ED||Thematic evaluation to be undertaken in 2015.|
A review of the initiative to be undertaken in 2014.
|TB Submission (abridged title)||Lead*||Evaluation Commitments made to TBS and TB Conditions|
|1. Afghanistan Program||ED||Summative evaluation to be completed by FY 2009-2010Footnote 19 (postponed to FY 2012-2013).|
|2. Burkina-Faso||PB||Summative evaluation to be completed by 2015.|
|3. Canada Investment Fund for Africa||ED||Summative evaluation to be completed by FY 2013-2014.|
|4. Pakistan (Debt Relief)||PB||Summative evaluation to be completed by FY 2013-2014.|
|5. Tanzania (Education Sector)||PB||Previously planned meta-evaluation will likely be replaced by a review in FY 2015-2016.|
|6. Palestinian Authority's Justice Sector||PB||Project delayed; evaluation timelines to be re-determined once re-scoping approved.|
|7. Support to Aga Khan Foundation Canada's initiative entitled 'Regional Maternal, Newborn and Children Health Centers and Comprehensive Health Program in Afghanistan'.||PB||Formative evaluation to be completed by FY 2012-2013; Initiated in FY 2014/2015.|
Summative evaluation to be completed by FY 2014-2015.
|TB Submission (abridged title)||Lead*||Evaluation Commitments made to TBS and TB Conditions|
|1. United Nation's Office for the Coordination of Humanitarian Affairs (OCHA) to support the Central Emergency Response Fund||PB||Evaluations planned and managed through the OCHA|
|2. GAVI Alliance -Global Partnership for Education; Global Partnership for Education (GPE) formerly "Education for All Fast Track Initiative"||PB||Evaluations to be planned and managed through the:|
|3. World Food Programme||PB||Development Effectiveness Review completed in 2012.|
MOPAN review of WFP completed in 2013-2014. The Review of the World Food Programme's humanitarian programme also to be covered by the nextHumanitarian Assistance program evaluation (2017-2018).
|4. East Africa Drought||ED||To be also covered by the nextHumanitarian Assistance program evaluation (2017-2018).|
|5. Global Malaria Program (WHO)||PB||Summative evaluation to be undertaken in FY 2015-2016.|
|6. Scaling-up Nutrition through Integrated Life Saving Interventions (UNICEF/Helen Keller International (HKI))||PB||Summative evaluation (UNICEF component) in progress (FY 2013-2014).|
Summative evaluation (HKI component) to be undertaken in FY 2014-2015.
|7. Micronutrient Initiative (2014/15 - 2018-19)||PB||Formative evaluation (MI-led) to be undertaken in 2016-2017|
Summative evaluation to be undertaken in 2018-2019
|8. Global Agricultural and Food Security||PB||Partner organizations responsible for implementing each element of the Program are also responsible for planning, resourcing, and conducting evaluations of that programming.|
|9. UNDP Long Term Institutional Support (2012/13-2013-14)||PB||UNDP Development Effectiveness Review completed 2012-2013. A subsequent UNDP Development Effectiveness Review to be undertaken in 2016-2017.|
|10. Funding to implement Canada's final Copenhagen Accord near-term financing commitments||Evaluations planned and managed through the UNDP and ADB|
|TB Submission (abridged title)||Lead*||Evaluation Commitments made to TBS and TB Conditions|
|1. Volunteer Cooperation Program||PB||Formative evaluation was completed in 2012. Summative evaluation to be completed by FY 2013-2014.|
|2. Canadian International Food Security Research Fund (Phase 1)||PB||Summative evaluation to be completed by FY 2014-2015.|
|3. Support to Aga Khan Foundation Canada's initiatives entitled 'Partnership for Advancing Human Development in Africa and Asia'||PB||Formative evaluation to be completed by FY 2014-2015. Summative evaluation to be completed by FY 2015-2016.|
|4. Canadian International Institution for extractive industries Development||PB||Institutional assessment to be completed by FY 2015-2016. Summative evaluation to be completed by FY 2017-2018.|
|5. Canadian International Food Security Research Fund (Phase 2)||PB||Summative evaluation to be completed by FY 2017-2018.|
Table 5 - Establishing the Evaluation Universe
In FY 2012-2013, the Development Evaluation Division revised its evaluation universe to take into consideration the results of the Deficit Reduction Action Plan (DRAP). The number of units in the evaluation universe was based on DFATD's program activity architecture (PAA, FY 2013-2014), the Performance Measurement Frameworks approved by Treasury Board Secretariat, and the commitments made in Treasury Board Submissions.
Based on these considerations and following extensive consultation across the Department at that time, including with the former Multilateral and Global Programs Branch (MGPB) and Geographic Programs Branch (GPB), the Development Evaluation Division arrived at a tentative Evaluation universe of 50 units for coverage during the following five (5) year period. The 2014/15 - 2018/19 work plan includes:
5 evaluation units related to Fragile Countries and Crisis-Affected Communities
- South Sudan
- West Bank/Gaza
- Humanitarian Assistance
8 evaluation units related to Low-Income Countries
- Ghana & Ethiopia
- Mozambique & Tanzania
- Other Low-Income Country Assistance Programs (Benin, Burkina Faso, DR Congo)
8 evaluation units related to Middle-Income Countries
- Caribbean Regional
- Other Middle-Income Country Assistance Programs (Cuba, Egypt, Jordan, Morocco, Guatemala, Nicaragua, Philippines, Kenya, Nigeria, South Africa, Sri Lanka)
1 evaluation unit related to Regional Programs
- Inter-American Program, Pan-African Regional Program, Southeast Asia Regional Program
23 evaluation units related to Global Engagement and Strategic Policy Footnote 20
- Asian Development Bank (AsDB)
- African Development Bank (AfDB)
- Caribbean Development Bank (CDB)
- Inter-American Development Bank (IDB)
- World Bank Group (WBG)
- International Fund for Agricultural Development (IFAD)
- United Nations Children's Fund (UNICEF)
- United Nations Development Program (UNDP)
- United Nations Population Fund (UNFPA)
- World Health Organisation (WHO
- Joint UN Programme on HIV/AIDS (UNAIDS)
- United Nations Entity for Gender Equality and the Empowerment of Women (UN Women)
- United Nations High Commissioner for Refugees (UNHCR)
- United Nations Central Emergency Response Fund (CERF)
- World Food Programme (WFP)
- Global Fund for AIDS, Tuberculosis and Malaria (GFATM)
- Global Alliance for Vaccine Initiative (GAVI)
- Global Environmental Facility (GEF)
- Canadian Foodgrains Bank
- International Committee of the Red Cross (ICRC)
- Commonwealth Institutions
- Institutions of the Francophonie
- Consultative Group on International Agricultural Research (CGIAR)
2 evaluation units related to Canadian Engagement
- Partners for Development
- Global Citizens
3 specific commitments made in Treasury Board submissions
- Muskoka Thematic Evaluation
- Review of the Muskoka Initiative
- Canada Investment Fund for Africa (CIFA)
Through consultation with the Treasury Board Secretariat, it was determined that there is no obligation to evaluate sunsetting programs.
In planning and revising the sequence of evaluations, the Development Evaluation Division consults widely across the Department to ensure that user and corporate needs are being met and that ongoing programs are being evaluated every five years as per Treasury Board Secretariat requirements. Further, the Development Evaluation Division ensures that the timing of evaluations feed into the key decision making processes, such as the replenishment of multilateral funds.
- Footnote 1
This universe is limited to the corporate level only.
- Footnote 2
The countries include Cuba, Guatemala, Nicaragua, Egypt, Jordan, Morocco, Philippines and Sri Lanka.
- Footnote 3
This refers to the systematic review of a series of evaluations for learning purposes.
- Footnote 4
The Department of Foreign Affairs, Trade and Development is undergoing a process of organizational change. The Program Alignment Architecture that was in place as this Plan was finalized was used to define coverage and meet the requirements of the FAA and TB.
- Footnote 5
Some of the recommendations from this Review include a better balance between learning and accountability, more thorough analysis of relevance issues and an increased focus on depth rather than breadth of analysis.
- Footnote 6
Guide to Developing a Departmental Evaluation Plan, Treasury Board of Canada Secretariat, March 2014.
- Footnote 7
"Completion" is assumed once final draft is ready to be shared with DFATD Development Evaluation Committee.
- Footnote 8
The countries to be included in the FY 14/15 evaluation include Cuba, Guatemala, Nicaragua, Egypt, Jordan, Morocco, the Philippines and Sri Lanka. All countries of modest presence in Africa will be evaluated in FY 15/16.
- Footnote 9
Links to the departmental Program Alignment Architecture (PAA).
- Footnote 10
A horizontal evaluation is one that is undertaken with other departments/agencies. The Horizontal Lead designates that the organization is the department/agency that provides direction and is delegated with appropriate decision-making authority for a horizontal evaluation. The Horizontal Participant designates all departments/agencies, other than the Lead organization, that is involved in the horizontal evaluation.
- Footnote 11
Indicates whether or not surveys, focus groups, interviews, etc. are planned with any target groups that are NOT known stakeholders that the program has had previous direct contact with.
- Footnote 12
This is the spending being covered by the evaluation and should always be equal to or greater than the G&C spending as this value includes Gs&Cs and any budgeted operating or capital expenditures.
- Footnote 13
The budgets included for multilateral and international financial institutions are reference-levels. Planned multilateral funding for initiative-specific programming has been allocated against certain organisations with the knowledge that the relationship is not 1:1 (e.g. maternal, newborn and child health programming allocated to the Muskoka Formative Evaluation and the budget for global health initiatives allocated to the World Health Organisation review).
- Footnote 14
This is any spending that is not subject to evaluation under the Policy on Evaluation (e.g. major statutory spending as per section 6.1.8 of the Policy on Evaluation).
- Footnote 15
This provides an inventory of all ongoing programs of grants or contributions by the organization. A program of Gs&Cs may have a one-to-one relationship with the Gs&Cs listed in the Main Estimates, may include more than one grant or contribution, or it is possible that one grant or contribution is distributed across multiple programs of Gs&Cs.
- Footnote 16
Estimated voted value ($) of the grants and/or contributions from the Main Estimates for the first year of the plan. Apply first year values to all evaluations listed in the schedule. The total should be equal to the voted grants and contributions total outlined in the Main Estimates for the first year of the Departmental Evaluation Plan.
- Footnote 17
This is the date when the department obtained the original (as opposed to renewal) required policy and legal authorities for the program (e.g. approved TB submission and spending authority).
- Footnote 18
Table 2 summarizes the evaluations that have to be delivered to the TBS as a result of commitments made in TB Submissions.
- Footnote 19
The Afghanistan Evaluation was postponed to FY 2011-12 in order to ensure that sufficient information was available to conduct a summative evaluation.
- Footnote 20
This universe was defined based on: i) the priority list established by xCIDA in 2009 (Key Multilateral Partners); and, ii) all multilateral organisations receiving at least $5m in long-term institutional support.
- Date Modified: