Rolling Five-Year Development Evaluation Work Plan
2015-2016 – 2019-2020
- Deputy Head Confirmation Note
- List of Abbreviations
- Executive Summary
- 1 Background
- 2 DFATD’s Development Evaluation Function
- 3 Developing the Work Plan
- 4 New Evaluations for FY 2015-2016
- 5 Additional Development Evaluation Division Activities for FY 2015-2016
- 6 Program-Led Evaluation Plans for FY 2015-2016
- 7 Budget
Deputy Head Confirmation Note
I approve Foreign Affairs, Trade and Development Canada’s (DFATD) international development related departmental evaluation plan (DEP) for the fiscal years 2015-2016 to 2019-2020, which I submit to the Treasury Board of Canada Secretariat as required by the Policy on Evaluation.
As per sections 6.1.8 of the policy, I confirm that the following evaluation coverage requirements are met and reflected in this five-year DEP:
- all ongoing direct program spending is evaluated every five years;
- all ongoing programs of grants and contributions are evaluated every five years, as required by section 42.1 of the Financial Administration Act;
- the administrative aspect of major statutory spending is evaluated every five years;
- programs that are set to terminate automatically over a specified period of time, if requested by the Secretary of the Treasury Board following consultation with the affected deputy head;
- specific evaluations, if requested by the Secretary of the Treasury Board following consultation with the affected deputy head.
As per section 6.1.7, I confirm that this five year DEP:
- aligns with and supports the departmental Management, Resources and Results Structure; and
- supports the requirements of the Expenditure Management System, including spending reviews.
I will ensure that this plan is updated annually, and I will provide information about its implementation to the Treasury Board of Canada Secretariat, as required.
Peter M. Boehm
Deputy Minister of International Development
List of Abbreviations
- Country Development Programming Framework
- Centre of Excellence for Evaluation (TBS)
- Canadian Evaluation Society
- Former Canadian International Development Agency
- Network on Development Evaluation of the Development Assistance Committee (of the OECD)
- Departmental Evaluation Plan
- Former Department of Foreign Affairs and International Trade
- Foreign Affairs, Trade and Development Canada
- Departmental Performance Report
- Europe, Middle East and Maghreb
- Financial Administration Act
- Full-time equivalent
- Fiscal Year
- Grants and Contributions
- Partnerships for Development Innovation
- Mutual Accountability Framework
- Memorandum to Cabinet
- Millennium Development Goals
- Global Issues and Development
- Maternal Newborn and Child Health
- Multilateral Organisation Performance Assessment Network
- Development Assistance Committee of the Organization for Economic Development and Cooperation
- Asia Pacific
- Operations and Management
- Program Alignement Architecture
- Development Evaluation Division
- Strategic Policy
- Request for Proposal
- Report on Plans and Priorities
- Grants and Contributions Management Bureau
- State of Performance Measurement
- Treasury Board
- Treasury Board Secretariat
- United Nations
- United Nations Evaluation Group
- United Nations Population Fund
- Sub-Saharan Africa
- Foreign Affairs and Trade Evaluation Division
The Rolling Five-Year Development Evaluation Work Plan (hereafter, the Plan) identifies corporate evaluations scheduled for FY 2015-2016 to FY 2019-2020, with a focus on FY 2015-2016. The Plan also includes a list of Branch-led evaluations planned for FY 2015-2016.
In January 2015, the Development Evaluation Division (PCE) conducted a review of DFATD’s evaluation universe Footnote 1 in order to ensure full evaluation coverage of the Department’s direct development program spending over 5 years. The plan has been developed to achieve that requirement.
Planned Evaluation Work – FY 2015-2016
In FY 2015-2016, PCE will initiate and/or complete the following evaluations:
- Development Countries of Focus and Regional Programs: PCE will complete the country program evaluations of Mozambique/Tanzania; Bangladesh; and the Canada Investment Fund for Africa. It will initiate program evaluations of the Vietnam and Regional Programs.Footnote 2
- Development Partner Countries (formerly Countries of Modest Presence): The evaluation of development partner countries with modest Canadian development assistance in the Americas, Asia and Middle EastFootnote 3 will be completed. An evaluation of development partner countries with modest Canadian development assistance in AfricaFootnote 4 will be initiated.
- Fragile States: The South Sudan country program evaluation will be completed.
- Global Issues and Development: The development effectiveness review of the United Nations Population Fund will be completed. Review of the International Organisation de la Francophonie will be launched.
- Partnerships for Development Innovation: The evaluation of the Partners for Development Program will be completed.
- Corporate Evaluations: The meta-evaluationFootnote 5 of Branch-led evaluations will be launched.
- Thematic Evaluations: The formative evaluation of Canada’s contribution to the Maternal, Newborn and Child Health Initiative will be completed. An evaluation of extractives programming will be initiated.
Further, the Development Evaluation Division will:
- Participate in the Multilateral Organisation Performance Assessment Network (MOPAN) Technical Working Group and Steering Committee. It will continue to provide technical inputs to both the MOPAN and DAC EvalNet networks on the integration of their approaches to assessing multilateral organisations;
- Produce a report on the state of performance measurement;
- Jointly with the Foreign Affairs and Trade Evaluation Division (ZIE) commission a neutral assessment of the evaluation function, as required by the 2009 Treasury Board Policy on Evaluation;
- Complete the Development Evaluation Quality Assurance Tools and Guides Suite intended to facilitate the execution of Branch-led evaluations by DFATD staff, and support Branch-led evaluation strategic planning and knowledge management (e.g. providing training to Partnerships for Development Innovation regarding thematic evaluations);
- Provide technical advice on evaluation matters to the Authorized Programming Process (APP) and accompanying e-RoadMap;
- Conduct a revew of best practices in other government departments to identify opportunities to improve the division’s approach to engaging program and policy branches and to fostering learning; and,
- Serve as Secretariat for DFATD’s Development Evaluation Committee.
If fully executed, this work plan would require an operations and management (O&M) budget of $2.0 million for FY 2015-2016, and a salary budget of $1.7 million for 15 full-time equivalents (FTEs).
In FY 2015-2016, the Development Evaluation Division will undergo a significant staff transition. Workplanning will take account of this temporary period of reduced capacity by delaying initiation of certain evaluations to later in the fiscal year when new staff will be in place. This work plan puts forward the completion of 16 corporate evaluations in 2015-2016, 9 of which were initiated in 2014-2015.
The scope and content of this Plan is consistent with the requirements of the 2006 Financial Administration Act (FAA) and the 2009 Treasury Board (TB) Policy on Evaluation. The Plan positions DFATD’s Development Evaluation Division to achieve 100% evaluation coverage of development grants and contributions and direct program spending as required by the FAA and the 2009 TB Policy on Evaluation, while contributing to the Department’s learning and decision making needs. Footnote 6
Strong demand for credible evaluation of the results of international aid expenditures remains a priority for expert constituencies and the general public. Responding to this fundamental accountability requirement will remain a central purpose of the development evaluation function.
At the same time, the Government of Canada continues to encourage departments to use evaluation to strengthen programs. There is an increasing commitment to innovation and learning in DFATD’s development programming - a purposeful effort to design, pilot and scale up the most effective and cost efficient ways of supporting poverty reduction. In this context, program planners and managers need feedback on what works well and why. Facilitating such learning is increasingly an important aim for both corporate and Branch-led development evaluation at DFATD.
1.3 International Year of Evaluation – 2015
EvalPartners, Footnote 7 the global movement to strengthen national evaluation capacities, declared 2015 as the International Year of Evaluation at the Third International Conference on National Evaluation Capacities held in São Paulo in 2013. It was later endorsed by the United Nations Evaluation Group (UNEG) and acknowledged by United Nations General Assembly in a standalone resolution, titled"Capacity building for the evaluation of development activities at the country level" adopted in December 2014.
EvalPartners’s Guiding Principles for the International Year of Evaluation are:
- inclusion where everyone has a role to play: civil society, governments, international partners, academia, and individuals;
- innovation at many levels: methods of engagement and capacity building, peer-to-peer exchanges, use of technology for communications and scale up, and involvement of new partners; and
- strategic partnership of committed individuals and organizations around the world for coordinated action to promote evaluation as a catalytic intervention for better human development.
This renewed emphasis on evaluation has particular implications for the Development Evaluation Division. There will be an expectation of increased engagement with developing country evaluation practitioners in executing DFATD development evaluations. There will also be an increasing number of country-led and joint evaluations, in line with the 2005 Paris Declaration principles. Other global trends include enhancing both donors and partners’ evaluative capacities and adhering to recognized international standards (such as the OECD/DAC and UNEG) in evaluation.
In 2015, countries also came together to begin work on a Post-2015 Development Agenda. This Agenda will address the unfinished business of the MDGs, and integrates social, economic and environmental priorities. As of January 2015, formal intergovernmental negociations have started, and will culminate in a UN Summit in September 2015, where a global Agenda is expected to be set out. Footnote 8
2.0 DFATD’s Development Evaluation Function
2.1 DFATD Context
The Development Evaluation Division is part of DFATD’s Strategic Policy Branch. It leads corporate evaluations that provide Canadians, Parliamentarians, Ministers, central agencies, partners, beneficiaries and DFATD’s management with credible, evidence-based assessments of the relevance and performance of the Department’s development strategies, programs and projects.
DFATD’s Development Evaluation Committee is comprised of six external experts and four DFATD senior executives (including the Deputy Minister of International Development, who chairs the committee). The Committee acts as an advisory body to the Deputy Minister on development evaluation activities.
Program branches fund and manage their own project level and thematic evaluations (i.e. Branch-led or Program-led). The Development Evaluation Division provides technical advice and quality assurance services for branch-led efforts. These evaluations typically cover investments below the sub-program level of the Program Alignment Architecture, and because they are intended to benefit development partners, are funded from the department’s aid rather than operating budget, as per DFATD’s Terms and Conditions for International Development Assistance.
Both corporate and branch-led evaluations use external consultants for aspects of evaluation execution. In the case of corporate evaluations, consultants are primarily used for data gathering and analysis, while overall design, final reports and recommendations are generally prepared in-house.
2.2 Responsibilities of the Development Evaluation Division
The Development Evaluation Division is responsible for:
- developing, in coordination with the respective Branches, the Rolling Five-Year Development Evaluation Plan;
- ensuring that corporate development evaluations are neutral, rigorous and cost-effective;
- developing and implementing an approach to ensure that evaluative knowledge is disseminated across the Department to promote organizational learning;
- instituting a systematic approach to track the implementation of recommendations in management responses and action plans;
- providing technical advice, training/coaching and quality assurance services to Branches in support of the evaluations they and/or their partners are managing;
- reviewing and providing advice on the accountability and evaluation aspects included in Treasury Board Submissions and Memoranda to Cabinet;
- forging and maintaining beneficial strategic alliances with key stakeholders, inside and outside the Department; and,
- providing secretariat support for the Development Evaluation Committee.
2.3 Responsibilities of Program Branches
Program branches are responsible for:
- preparing multi-year evaluation work plans for inclusion in DFATD’s Rolling Five-Year Development Evaluation Work Plan;
- ensuring that sufficient performance information is available to effectively support evaluations;
- providing comments on corporate evaluation deliverables (e.g. work plans, reports) and preparing management responses and action plans;
- managing their evaluations as set out in their multi-year evaluation work plans;
- accessing evaluation tools, technical advice, training/coaching and quality assurance services from the Development Evaluation Division in support of their evaluations;
- implementing approved management responses and/or action plans; and,
- disseminating evaluation results for learning and following-up actions on recommendations, and to ensure transparency for corporate evaluations.
3.0 Developing the Work Plan
3.1 Key considerations
The following considerations were taken into account when developing this plan:
- the FAA requirement that “every department conduct a review every five years of the relevance and effectiveness of each ongoing program for which it is responsible”; and the 2009 TB Policy on Evaluation requirement to achieve 100% evaluation coverage of direct program spending, also over 5 years;
- the results of the recent Review of DFATD’s General Approach and Compendium Tools for Country Program Evaluations, Footnote 9
- the emphasis on the use of evaluation findings for program improvement and decision making; and
- the need to ensure that the approaches and methodologies used in DFATD evaluations take into account evolving best practices in development evaluation, including the recent Treasury Board guidance on theory-based evaluation.
3.2 Coverage, Sequencing and Risk Analysis
In January 2015, the Development Evaluation Division conducted a review of DFATD’s development evaluation universe in order to ensure full evaluation coverage of the Department’s direct developmental program spending over 5 years.
At the same time, an examination of the sequencing of evaluations was undertaken so that their usefulness and value would be optimized. As recommended by the Treasury Board Secretariat, sequencing was informed by considering a combination of needs and evaluation risks.Footnote 10 The proposed sequencing of evaluations in the current five-year cycle is outlined in Annex 1. A description of the Department’s evaluation universe can be found in Annex 5.
3.3 Ongoing Evaluations
Some evaluations are implemented over multiple fiscal years, sometimes due to scale and/or complexity. In addition to the planned evaluations described in Section 4 of this document, the Development Evaluation Division will complete several ongoing evaluations. These include:
|Evaluation||Expected Completion Date Footnote 11|
|Mozambique/Tanzania Country Program Evaluation||Summer 2015|
|Bangladesh Country Program Evaluation||Fall 2015|
|South Sudan Country Program Evaluation||Spring 2016|
|Canada Investment Fund for Africa||Summer 2015|
|Development Partner countries in the Americas, the Middle East and Asia Footnote 12||Fall 2015|
|Muskoka Formative Evaluation||Summer 2015|
|Partners for Development Program||Winter 2015|
|United Nations Population Fund||Summer 2015|
|Meta-evaluation of Branch-led Evaluations||Spring 2016|
4.0 New Evaluations for FY 2015-2016
4.1 Country Program Evaluations
In FY 2015-2016, PCE will initiate the country program evaluation for Vietnam and an evaluation of development partner countries in Africa.Footnote 13 An evaluation of Regional Programs covering the Inter-American, Pan-African and Southeast Asia regions will be initiated in late 2015-2016.
4.2 Multilateral and Global Organizations Evaluations
In recent years, PCE has used the OECD-DAC EvalNet methodology, intended to be done jointly among donors, to assess the development effectiveness of multilateral organizations. Canada is also playing an active role in a multi-donor network – the Multilateral Organisation Performance Assessment Network (MOPAN). In 2015, the OECD-DAC Evalnet and MOPAN methodologies will be integrated to ensure greater coordination and reduce the evaluation burden on international organizations.
Following this integration, MOPAN will increase the number of organisations it assesses to approximately 12-14 organisations over two-year periods. Decisions about which organizations will be assessed from 2015 onwards will be taken in 2015-2016.
As it will not be assessed by MOPAN, an evaluation of the International Organization of La Francophonie will be carried out in collaboration with the Foreign Affairs and Trade Evaluation Division using a jointly agreed-upon methodology in FY 2015-2016.
4.3 Meta Evaluations
In 2015-2016, a meta-evaluation to assess the quality of Branch-led evaluations will be initiated. As well, the annual report on the State of Performance Measurement will be prepared.
4.4 Thematic Evaluations
Following the recent Portfolio Review of DFATD’s Natural Resource Governance Projects and the evaluability assessment of Canada’s development assistance on extractives and sustainable development, an evaluation on this theme will be initiated in late 2015-2016.
5.0 Additional Development Evaluation Division Activities for FY 2015-2016
5.1 Support to Branch-led Evaluations
The Development Evaluation Division will:
- Develop up-to-date tools and guides for the Evaluation Quality Assurance Tools and Guides Suite and finalize guidelines to support Branch-led evaluation strategic planning and knowledge management;
- Continue to provide technical advice and quality assurance services to program branch employees at headquarters and in the field, and on the Authorized Programming Process (APP) and the accompanying e-RoadMap;
- Finalise and maintain a database to house all branch-led evaluations; and
- Ensure that the Department has continuous access to external development evaluation consultants via contractual mechanisms in collaboration with the Grants and Contributions Management Bureau;
5.2 Evaluation Requirements in Treasury Board Submissions
Over the past few years there have been several evaluation-related requirements articulated in Treasury Board Submissions. Six of theses 31 evaluation requirements, articulated to Treasury Board between 2006-2007 and 2014-2015, are the responsibility of the Development Evaluation Division. The remaining 25 are the responsibility of the implicated program branches. Annex 4 provides a list of these evaluation requirements.
5.3 Optimizing the Use and Knowledge Benefits from Evaluations
Development evaluations at DFATD create a source of information to inform decision making on investments and program improvement, but also to feed into strategic reviews, renewals of terms and conditions, Treasury Board submissions, the Report on Plans and Priorities (RPP), the Departmental Performance Reports (DPR), and Memoranda to Cabinet.
While DFATD has traditionally benefited from an evaluative culture, there remains a need to optimize the use of findings, recommendations and lessons learned from evaluations. The Development Evaluation Division will review its approach to the use and dissemination of evaluation knowledge. It will implement a new Standard Operating Procedure for finalising evaluations through increased engemeent with the department, and it will refine a guide that seeks to increase the use of evaluation findings, recommendations and lessons learned. A meta-synthesis of corporate and decentralised evaluations will also be conducted in order to provide input to medium term planning processes.
A Report on Lessons Learned from Development Evaluations will be produced in order to ensure the wide dissemination of evaluation knowledge in 2015. This report communicates key lessons derived from corporate evaluations.
In 2015-2016, the Development Evaluation Division will:
- Promote evaluation knowledge and lessons learned by revising the Approach to the Dissemination of Evaluation Knowledge to include an emphasis on the use of evaluation findings;
- Provide guidance to Branches on the preparation of evaluation summaries;
- Use DFATD’s knowledge networks and corporate committees to share findings and lessons from evaluations; and,
- Contribute to events to be conducted by the Canadian Evaluation Society and others during 2015, which is the International Year of Evaluation.
5.4 Neutral Assessment of DFATD Evaluation Functions
In 2015-2016, a neutral assessment of the DFATD’s evaluation functions will be carried out as part of the Department’s compliance with the TB Policy on Evaluation. It will examine the level of compliance with the Policy.
5.5 Corporate Engagement
Input will be provided to corporate initiatives, such as: the Departmental Performance Report (DPR); the Report on Plans and Priorities (RPP); and Management Accountability Framework (MAF). DFATD’s Program Committee will be engaged in periodic review of the status of implementation of corporate evaluation plans and recommendations.
5.6 Strategic Networks and Country Capacity
Constructive working relationships with the Foreign Affairs and Trade Evaluation Division, and the Treasury Board Secretariat’s Centre of Excellence for Evaluation (CEE) will be maintained. Dynamic participation in the Government of Canada’s EvalConnex’s group, which is a working space for the federal evaluation community managed by CEE, will be undertaken. More active participation in the Canadian Evaluation Society (CES) will also be pursued.
Internationally, the Development Evaluation Division will continue its engagement with the Network on Development Evaluation of the Development Assistance Committee (of the OECD) in order to remain abreast of emerging thinking in the field of international development evaluation. It will also play an active role in the Multilateral Organisation Performance Assessment Network (MOPAN) as a member of its Technical Working Group and Steering Committee, with a view to promoting the uptake of an integrated methodology to assess the development effectiveness of multilateral organizations.
On-going relationships with the Nordic + Evaluation Group and 3ie (a network on impact evaluation) will continue to be pursued. The EvalPartners initiative to build evaluation capacity in developing countries will be monitored.
Ongoing engagement with these communities of practice is important to maintain and strengthen PCE’s expertise and value-added through continued exposure to leading development evaluation practices and approaches.
6.0 Program-Led Evaluation Plans for FY 2015-2016
Program branches conduct evaluations to improve the effectiveness of their projects and programs, to the benefit of developing countries and institutions.
The following section describes the evaluation activities planned by programming branches during FY 2015-2016. Branch-led activities complement the Development Evaluation Division’s work.
6.1 Geographic Branches – Evaluations Planned for FY 2015-2016
Evaluations in the geographic branches are mainly mid-term or final project evaluations. However, these branches are increasingly using innovative approaches such as clustering projects/countries and thematic evaluations to be able to respond to their needs.
The list below provides the plan for geographic branches for FY 2015-2016:
|Haiti||Hospital in Gonaïves|
|Haiti||Technical Support in Haiti|
|Haiti||Electoral Transition Support (PNUD/NDI)|
|Haiti||Strengthening of Public Management|
|Haiti||Agriculture Finance and Insurance System in Haiti|
|Haiti||Haiti Centre for Professional Training (CFPH CANADO)|
|Haiti||Volunteer Cooperation in sustainable economic growth (phase II)|
|Colombia||Assistance to Landmine Survivors (Handicap International)|
|Colombia||Protecting Children’s Education in South-West Colombia (Save the Children / NRC)|
|Peru||Strengthening the Management of the Education Sector (GRADE)|
|Peru||Sustainable and Efficient Management of Energy Resources in Peru (PROSEMER )|
|Honduras||Prevention and Control of Chagas and Leishmaniasis Diseases (COCHALE)|
|Honduras||Education for All (Joint Donor Evaluation led by the Government of Honduras)|
|Honduras||Education for All Common Fund|
|Bolivia||Active Communities for Healthy Mothers and Children in Bolivia’|
|Inter-American||Sustainable Energy Access for LAC Region (OLADE)|
|Carribean||Regional Integration and Trade (CTCP)|
|Carribean||Strengthening Distance Education in the Caribbean (S-DEC)|
|Carribean||Canada-Caribbean Leadership Program (CLP)|
|Carribean||Entrepreneurship Program for Innovation in the Caribbean (EPIC)|
|Carribean||Caribbean Local Economic Development (CARILED)|
|Pan-Africa Regional Program||Pan-Africa Bean Research Alliance (PABRA ) IV|
|Ethiopia||Digital Opportunity Trust|
|Ghana||Food Security and Environment Facility - Government of Ghana|
|Ghana||Greater Rural Opportunities for Women (GROW)|
|Ghana||Resilient and Sustainable Livelihoods Transformation in Northern Ghana|
|Ghana||Ghana Environment Management Project|
|Ghana||Technical Assistance for the Growth and Poverty Reduction Program – GoG|
|Mali||Strengthening Decentralized Health Systems|
|Mali||Health Workers Training (DECLIC)|
|Mali||Support to Agricultural Sector Supply Chains|
|Mozambique||Inhambane Rural Water Supply and Sanitation Project (IRWSSP)|
|South Sudan||Building Community Resilience (project implemented by the Canadian Red Cross)|
|Tanzania||Legal Sector Reform Program|
|Tanzania||Tanzania Extractive Industries Transparency Initiative (TEITI) II|
|Tanzania||Tanzania Minerals Audit Agency (TMAA)|
|Tanzania||Improving Access to Financial services|
|Tanzania||Support to the Ethics Secretariat|
|Senegal||Teachers Training Using a Competency-based Approach|
|South Africa||Public Sector Anti-Corruption Training (DPSA)|
|South Africa||Child Protection Surveilance Project (DSD)|
|South Africa||Building a Capable State (GTAC/DPME)|
|Afghanistan||Teacher Certification and Accreditation Project|
|Afghanistan||Improving Nutrition for Mothers, Newborns and Children in Afghanistan|
|Afghanistan||Maternal and Under Five Nutrition and Child Health|
|Afghanistan||Promoting Women’s Political Participation in Afghanistan|
|Bangladesh||Improving Health and Nutrition for Hard-to-Reach Mothers and Children|
|Burma||Building Social Capital: Burma Border Assistance Program|
|Indonesia||Better Approaches to Service Provision|
|Indonesia||Support to Indonesia’s Islands of Integrity|
|Indonesia||Restoring Coastal Livelihoods|
|Indonesia||Agroforestry and Forestry in Sulawesi: Linking Knowledge with Actions|
|Pakistan||Enhancing Employability and Leadership for Youth Project|
|Vietnam||Soc Trang Small and Medium-Sized Enterprise Development|
|Vietnam||Ha Tinh Agricultural Development|
|Europe, Middle East and Maghreb|
|MENA||MENA MSME Technical Assistance Facility|
|Morocco||Education Reform Through Competency-Based Approach|
|Ukraine||2014 Elections support|
|Ukraine||Judicial Education for Economic Growth (JEEG)|
|West Bank and Gaza||Improved Framework Conditions for Palestinian Businesses|
|West Bank and Gaza||Capacity Development for Facilitating Palestinian Trade|
|West Bank and Gaza||Export Development in the West Bank|
|West Bank and Gaza||Support to the Palestinian Prosecution (Sharaka)|
|West Bank and Gaza||Courthouses Construction|
6.2 Partnerships for Development Innovation – Evaluations Planned for FY 2015-2016
The Partnerships for Development Innovation Branch (KFM) maintains its own Rolling Four-Year Evaluation Plan (2014-2015 - 2017-2018) which focuses on Branch-specific thematic and project evaluations.
Thematic evaluations examine several development interventions under a specific theme (e.g., capacity building, innovation and local governance) to identify successful models of intervention and share lessons. This method allows for a comparative evaluation of a mix of small and large projects in various countries, many of which would have never been evaluated due to resource constraints and other operational issues.
Project evaluations assess the performance of projects in progress (formative) or completed (summative) in terms of producing anticipated results and value for money. This approach is more appropriate for larger investments and those subject to Treasury Board evaluation requirements.
For FY 2015-2016, KFM plans to execute the following evaluations:
- Community-based interventions in Maternal, New born and Child Health
- Canada Fund for Africa Climate Resilience
Project Evaluations(as per TBS requirements)
- Formative evaluation of Aga Khan’s Partnership for Advancing Human Development in Africa and Asia
- Summative evaluation of Right to Play’s Play to Learn Program
- Summative evaluation of Francophonie Scholarships
- Summative evaluation of the Canadian International Food Security Research Fund (Phase 1)
6.3 Global Issues and Development – Evaluations Planned for FY 2015-2016
Global Issues and Development Branch (MFM) engages in three distinct types of programming and therefore engages in three distinct approaches to evaluations.
Long-Term Institutional Support – Canada, both as a member of the governing board and through direct consultation with the institution, participates actively alongside other donors in evaluation processes of multilateral organisations, including reviewing evaluations and providing direction on recommendations. Key evaluations being completed in 2015-2016 by multilateral organisations we support include:
- Global Fund to Fight for AIDS, Tuberculosis and Malaria
Mid-Term Evaluation of the Progress Made Against the Objectives of the Global Fund’s 2012-2016 Strategy
- Global Partnership for Education
Independent Evaluation of the Global Partnership for Education
- World Bank
World Bank’s Evaluation of World Bank Support to Early Childhood Development
- Consultative Group for International Agricultural Research
Evaluation of CGIAR Research Program on Agriculture for Improved Nutrition and Health
- Commonwealth of Learning
Commonwealth of Learning Evaluation of the 2012-2015 Strategic Plan
- United Nations Population Fund
Evaluation of support to adolescents and youth
- United Nations Development Programme
Evaluation of support to gender equality
Evaluation of strengthening national health systems and capacity
As noted earlier, overarching assessments of key partners will be done through MOPAN and multi-donor Development Effectiveness Reviews.
Global Initiatives – Each global initiative supported by DFATD has a strong monitoring and reporting component. These evaluations generally take the form of mid-term and final evaluations. In most cases, the evaluation is conducted by the partner. DFATD, and other donors, frequently play a role in the process but the relationship is supportive rather than prescriptive. In a few instances, DFATD conducts the evaluation. Examples of evaluations of global initiatives taking place in 2015-2016 supported by MFM include:
- Helen Keller International & UNICEF
Scaling-up Nutrition through Integrated Life-Saving Interventions
- World Health Organisation
Global Polio Eradication Initiative
- World Health Organisation
Accelerating Nutrition Improvements in Sub-Saharan Africa (ANI)
International Humanitarian Assistance – Although DFATD supports evaluations conducted by our humanitarian partners on their programming, DFATD also supports system-wide initiatives to asses how the humanitarian response system as a whole is meeting identified needs. The Office for the Coordination of Humanitarian Affairs (OCHA) conducts evaluations to promote transparency, accountability and learning through systematic and objective judgments about the relevance, efficiency, effectiveness and impact of humanitarian interventions.
DFATD also supports specific learning and evaluation mechanisms, such as the Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP). In almost all instances, DFATD’s NGO partners include monitoring and evaluation as part of their projects – this pertains to both emergency response and complex humanitarian initiatives. In some cases, DFATD conducts an evaluation. In addition to real-time evaluations following a crisis, examples of evaluations being undertaken in 2015-2016 include:
- Evaluation of the World Food Programme (WFP) Nutrition Policy
- Whole of System Review: Protection in the Context of Humanitarian Action
There are also occasions when, above and beyond Canada’s governance role in multilateral and global institutions, MFM carries out branch-led evaluations. In particular, MFM has developed the Gender Equality Institutional Assessment (GEIA) methodology to facilitate assessments of our partners’ ability to plan, achieve, monitor and report on gender equality results. The list below provides an evaluation plan for FY 2015-2016 evaluations that MFM is leading.
Evaluations led by MFM
- Mid-Term/Project Evaluation of DFATD-Canadian Red Cross Society (CRCS) Strategic Partnership: Monitoring and Evaluation Initiative
- Final Evaluation of the Renewed Efforts Against Child Hunger and Undernutrition (REACH)
- Gender Equality Institutional Assessment of the Global Partnership for Education (GPE)
- Gender Equality Institutional Assessment of Gavi, the Vaccine Alliance and/or the World Health Organization (WHO)
- Gender Equality Institutional Assessment of the International Fund for Agricultural Development (IFAD)
In 2015-2016, the Development Evaluation Division will undergo a significant staff transition. Workplanning has taken account of this temporary period of reduced capacity by delaying initiation of certain evaluations to later in the fiscal year when new staff will be in place.
For 2015-2016, a total of 16 evaluations are planned, comprising 9 ongoing and 8 new evaluations. Although this is slightly lower than in the previous year (18), given the human resources transition this remains a high degree of productivity.
An operations and management (O&M) budget of $2.0 million is planned for FY 2015-2016, along with a salary budget of $1.7 million and a staff complement of 15 full-time equivalents (FTEs) in order to implement ongoing and new evaluations.
Annex 1 - On-going Program of Grants and Contributions
Select Organization: Foreign Affairs, Trade and Development Canada (incl. EDC)
Identify PAA used: 2015-2016
Spending Source Used (include Year): Main Estimates (2015-2016)
Identify total organizational spending ($) (e.g. Total Budget Main Estimates, Total Expenditures of the Public Accounts, etc.): 2,745,392,615
|Identifier||Link to PAAFootnote 14 #(s)||Proposed Title of the Evaluation||Identify Policy on Evaluation Coverage Requirement:||Horizontal Evaluation (Indicate No/Lead/ Participant)Footnote 15||Involves Public Opinion ResearchFootnote 16||Date Last Evaluated (Deputy Head Approval Date)|
|Planned Evaluation Start Date (M/Y)||Planned Deputy Head Approval Date|
|Estimated G&C Value ($)Footnote 17 Footnote 18||Estimated ValueFootnote 19 (Including Gs&Cs) |
|Tanzania and Mozambique Cluster Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||T: 02/2006|
|03/2013||04/2016||$160,000,000||$161,788,482||Main Estimate figures for Mozambique and Tanzania combined.|
|Bangladesh Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||01/2009||04/2014||04/2016||$60,000,000||$60,000,000|
|South Sudan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||12/2010||04/2015||09/2016||$60,000,000||$61,284,612|
|1415.3||SO 3.2.1||Canada Investment Fund for Africa (CIFA)||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2016||$0||$0||Sunsetting program with no budget allocated for FY2015/2016|
|Development Partner Countries Evaluation/formerly Countries of Modest Presence (Americas, Asia and the Middle East)||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2016||$109,500,000||$110,290,552||Countries covered include Cuba, Guatemala, Nicaragua, Philippines, Sri Lanka, Egypt, Jordan, and Morocco.|
|1415.5||SO 3.2.4||United Nations Population Fund (UNFPA) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2014||04/2016||$15,600,000||$15,600,000|
|1415.6||SO 3.2.2||Muskoka Formative Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2016||$0||$0||This is a thematic evaluation. Funds are disbursed through geographic branches, thus also covered in country program evaluations.|
|Partners for Development Program||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2014||04/2016||$235,155,361||$235,155,361||Estimated values based on a 90%/10% split between the two Programs in KFM.|
|Vietnam Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||07/2010||04/2015||10/2016||$20,000,000||$20,000,000|
|Development Partner Countries Evaluation/formerly Countries of Modest Presence (Africa)||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2015||10/2016||$92,000,000||$92,583,737||Covers Benin, Burkina Faso, the Democratic Republic of Congo, Nigeria, South Africa and Kenya|
|1516.3||SO 3.2.1||Formative Evaluation of Canada’s Development Assistance on Extractives and Sustainable Development.||Ongoing Programs of Grants and Contribution||Horizontal Participant||No||N/A||$0||$0||This is a thematic evaluation. Funds are disbursed through geographic branches, thus also covered in country program evaluations.|
|1516.4||SO 3.2.4||International Organization of La Francophonie (IOF) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2014||04/2016||$5,200,000||$5,200,000|
|Evaluation of Regional Programs (Inter-American, Pan-African, Southeast Asia)||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||07/2011||04/2015||10/2016||$61,000,000||$63,005,424|
|Total Year 1||$818,455,361||$824,908,168|
|Senegal Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||02/2011||04/2016||04/2017||$60,000,000||$60,877,831|
|Honduras Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||09/2011||04/2016||04/2017||$23,000,000||$23,000,000|
|Peru Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||07/2012||04/2016||04/2017||$25,000,000||$25,000,000|
|Ukraine Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||06/2011||04/2015||10/2016||$50,000,000||$50,152,542||Moved to FY 2016/17 because Program Audit in FY 2015/16|
|African Development Bank (AfDB) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||10/2013||04/2016||04/2017||$131,157,009||$131,157,009||Direct Payment ($103.1M) and General Capital Increase ($28,057,009).|
|1617.6||SO 3.2.4||United Nations Development Programme (UNDP) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||04/2012||04/2016||04/2017||$40,000,000||$40,000,000|
|1617.7||SO 3.2.4||Global Fund to Fight for AIDS, Tuberculosis and Malaria (GFATM) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2016||04/2017||$216,666,667||$216,666,667|
|United Nations Central Emergency Response Fund (CERF) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2016||04/2017||$29,400,000||$29,400,000||Included in the universe for the first time|
|Humanitarian Assistance Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2012||04/2016||04/2017||$243,800,000||$243,800,000||MFM's Humaniatrian Assistance Base Budget ($318.8), of which $75M going to Food Security sub-activity for CFGB ($25M), WFP (Core) ( $25M) and School Feeding Program with WFP ($25M). Amount excludes any additional funds received for humanitarian crisis, and access to Crisis Pool|
|1617.10||SO 3.2.4||Commonwealth Institutions Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||10/2016||$2,600,000||$2,600,000||Commonwealth Fund for Technical Cooperation + Commonwealth of Learning|
|Office of the United Nations High Commissioner for Refugees (UNHCR) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||10/2016||$12,600,000||$12,600,000||Undertake by MOPAN. Further details will be added as decisions are made.|
|1617.12||SO 3.2.4||Global Environmental Facility (GEF) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||10/2016||$54,750,000||$54,750,000||Undertake by MOPAN. Further details will be added as decisions are made.|
|World Food Programme (WFP) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||10/2016||$25,000,000||$25,000,000||Undertake by MOPAN. Further details will be added as decisions are made.|
|Caribbean Development Bank Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2015||10/2016||$16,705,000||$16,705,000||Undertake by MOPAN. Further details will be added as decisions are made.|
|Total Year 2||$930,678,676||$931,709,049|
|Mali Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||02/2014||04/2017||04/2018||$95,000,000||$95,899,450|
|1718.2||SO 3.2.1||Caribbean Regional Program evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||02/2013||04/2017||04/2018||$50,000,000||$50,000,000|
|Colombia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||04/2013||04/2017||04/2018||$30,000,000||$30,000,000|
|Asian Development Bank (ADB) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||01/2013||04/2017||04/2018||$47,690,125||$47,690,125|
|1718.5||SO 3.2.4||World Health Organization (WHO) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||12/2012||04/2017||04/2018||$15,000,000||$15,000,000||This amount is equivalent to MFM’s reference level budget for global health initiatives|
|1718.6||SO 3.2.4||Consultative Group on International Agriculture Research (CGIAR) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2017||04/2018||$10,000,000||$10,000,000|
|1718.7||SO 3.2.4||Joint United Nations Programme on HIV/AIDS (UNAIDS) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2009||04/2017||04/2018||$4,860,000||$4,860,000|
|International Committee of the Red Cross (ICRC) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2017||04/2018||$5,400,000||$5,400,000||Included in the universe for the first time|
|1718.9||SO 3.2.4||GAVI Alliance (GAVI) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2017||04/2018||$90,000,000||$90,000,000||Included in the universe for the first time|
|Total Year 3||$347,950,125||$348,849,575|
|1819.1||SO 3.2.4||United Nations Children's Fund (UNICEF) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2015||04/2018||04/2019||$16,200,000||$16,200,000|
|Inter-American Development Bank (IDB) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||02/2015||04/2018||04/2019||$13,619,615||$13,619,615|
|1819.3||SO 3.2.4||International Fund for Agricultural Development (IFAD) Review||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2015||04/2018||04/2019||$22,500,000||$22,500,000||Base ($12.5 M) + Initiative: Complementary Fund for Climate Change Adaptation ($10 M).|
|Canadian Foodgrains Bank||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2018||04/2019||$25,000,000||$25,000,000||Included in the universe for the first time|
|1819.5||SO 3.2.2||Muskoka Initiative Summative Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2018||04/2019||$0||$0|
|Global Citizens Program||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2018||04/2019||$26,128,373||$26,128,373||Estimated values based on a 90%/10% split between the two Programs in KFM.|
|Total Year 4||$103,447,988||$103,447,988|
|Haiti Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||01/2015||04/2019||04/2020||$90,000,000||$90,000,000|
|West Bank / Gaza Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2015||04/2019||04/2020||$65,000,000||$65,652,718|
|Afghanistan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||03/2015||04/2019||04/2020||$100,000,000||$100,000,000|
|Ethiopia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2015||04/2019||04/2020||$73,000,000||$73,665,141|
|Ghana Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2015||04/2019||04/2020||$80,000,000||$80,746,338|
|Indonesia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||08/2015||04/2019||04/2020||$30,000,000||$30,000,000|
|1920.7||SO 3.2.2||Democratic Republic of the Congo Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2019||04/2020||$0||$0||New country of focus. This amount has been included in the evaluation of countries of modest presence.|
|Burma Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2016||04/2017||$13,000,000||$13,000,000||New country of focus.|
|1920.9||SO 3.2.1||Benin Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2016||04/2017||$0||$0||New country of focus. This amount has been included in the evaluation of countries of modest presence.|
|1920.10||SO 3.2.1||EXCEED Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2016||04/2017||$25,000,000||$25,772,415||New Program.|
|1920.10||SO 3.2.1||Mongolia Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2017||04/2018||$4,000,000||$4,000,000||New country of focus.|
|Jordan Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2017||04/2018||$0||$0||New country of focus. This amount has been included in the evaluation of countries of modest presence.|
|1920.12||SO 3.2.1||Philippines Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||06/2004||04/2018||04/2019||$12,000,000||$12,000,000||New country of focus.|
|Burkina Faso Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||N/A||04/2018||04/2019||$0||$0|
|Mozambique Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||2015||04/2019||04/2020||$0||$0||This amount is included in year 1 of this plan|
|Tanzania Country Program Evaluation||Ongoing Programs of Grants and Contribution||Non-Horizontal||No||2015||04/2019||04/2020||$0||$0||This amount is included in year 1 of this plan|
|Total Year 5||$492,000,000||$494,836,612|
|Operational Costs for multilateral and bilateral programs (this amount has been kept separate since information on direct allocation to particular programs was not available)||$30,030,155|
|Spending not subject to the Policy on Evaluation|
|Total spending not subject to the Policy on Evaluation||0|
|% of spending accounted for||100%|
Annex 2 - Five-year Evaluation Schedule
|Title of Ongoing Program of Gs&CsFootnote 20||Title of Corresponding Voted Gs&Cs Listed in the Main Estimates||Estimated Voted Gs&Cs Value ($)Footnote 21||Estimated Program Value ($)||Program Start Date (M\Y)Footnote 22||Program End Date (M/Y or ongoing)||Date of Next Planned Evaluation (Expected Deputy Head Approval Date) (M/Y)||Date Last Evaluated (Deputy Head Approval Date) (M/Y)||Title of Last Evaluation||Comments|
|Humanitarian assistance||International Humanitarian Assistance||$243,800,000||$243,800,000||Ongoing||Apr-2017||Aug-2012||Evaluation of CIDA's Humanitarian Assistance 2005-2011|
|Afghanistan||International Security and Democratic Development, International Development, International Humanitarian Assistance||$100,000,000||$100,000,000||May-2009||Ongoing||Apr-2020||Mar-2015||Summative Evaluation of Canada’s Afghanistan Development Program|
|Haiti||International Development||$90,000,000||$90,000,000||May-2009||Ongoing||Apr-2020||Jan-2015||Evaluation of Canada-Haiti Cooperation (2006-2013)|
|South Sudan||International Security and Democratic Development, International Development||$60,000,000||$61,284,612||May-2009||Ongoing||Apr-2016||Dec-2010||A Multi-donor Evaluation of Support to Conflict Prevention and Peacebuilding Activities in Southern Sudan 2005–2010|
|West Bank and Gaza||International Security and Democratic Development, International Development, International Humanitarian Assistance||$65,000,000||$65,652,718||May-2009||Ongoing||Apr-2020||Aug-2015||Evaluation of DFATD Development and Humanitarian Assistance Programming in West Bank and Gaza|
|Bangladesh||International Development||$60,000,000||$60,000,000||May-2009||Ongoing||Apr-2020||Apr-2016||Bangladesh Country Program Evaluation 2003-2008|
|Ethiopia||International Development||$73,000,000||$73,665,141||May-2009||Ongoing||Apr-2020||Aug-2015||Ethiopia Country Program Evaluation 2003-2004 to 2008-2009|
|Ghana||International Development||$80,000,000||$80,746,338||May-2009||Ongoing||Apr-2020||Aug-2015||Evaluation of CIDA's Program in Ghana 1999-2005|
|Mali||International Security and Democratic Development, International Development||$95,000,000||$95,899,450||May-2009||Ongoing||Apr-2018||Feb-2014||Mali Country Program Evaluation 2006-2007 – 2010-2011|
|Mozambique||International Development||$70,000,000||$71,197,801||May-2009||Ongoing||Apr-2020||Sep-2015||Mozambique Country Program Evaluation 2004-2005 to 2008-2009|
|Senegal||International Development||$60,000,000||$60,877,831||May-2009||Ongoing||Apr-2017||Feb-2011||Evaluation of CIDA's Senegal Program from 2001 to 2010|
|Tanzania||International Development||$90,000,000||$90,590,681||May-2009||Ongoing||Apr-2020||Sep-2015||Evaluation of CIDA Tanzania Program|
|Vietnam||International Development||$20,000,000||$20,000,000||May-2009||Ongoing||Apr-2016||Jul-2010||Evaluation of CIDA's Investments in Vietnam - July 2010|
|Development Partner Countries (formerly Countries of Modest Presence in Americas, Asia and Middle East)||International Security and Democratic Development; International Development; International Humanitarian Assistance||$109,500,000||$110,290,552||n/a||Ongoing||Sep-2015||n/a|
|Development Partner Countries (formerly Countries of Modest Presence in Africa)||International Security and Democratic Development, International Development, International Humanitarian Assistance||$92,000,000||$92,583,737||n/a||Ongoing||Sep-2016||n/a|
|Caribbean Regional Program||International Development||$50,000,000||$50,000,000||May-2009||Ongoing||Apr-2018||Feb-2013||Caribbean Regional Program Evaluation 2006-2011|
|Colombia||International Development||$30,000,000||$30,000,000||May-2009||Ongoing||Apr-2018||Apr-2013||Colombia Country Program Evaluation 2006-2011|
|Honduras||International Development||$23,000,000||$23,000,000||May-2009||Ongoing||Apr-2017||Sep-2011||Evaluation of CIDA's Honduras Program from 2002 to 2010|
|Indonesia||International Security and Democratic Development, International Development||$30,000,000||$30,000,000||May-2009||Ongoing||Apr-2019||Jun-2014||Evaluation of CIDA's Indonesia Program|
|Peru||International Development||$25,000,000||$25,000,000||May-2009||Ongoing||Apr-2017||Jul-2012||Evaluation of CIDA's Peru Program from 2005 to 2010|
|Ukraine||International Security and Democratic Development, International Development||$50,000,000||$50,152,542||May-2009||Ongoing||Apr-2017||Jun-2011||Evaluation of CIDA's Ukraine Program from 2004 to 2009|
|Democratic Republic of the Congo||International Development||$0||$0||Ongoing||Apr-2020||n/a||New country of focus|
|Burma||International Security and Democratic Development, International Development||$13,000,000||$13,000,000||Ongoing||Apr-2020||n/a||New country of focus|
|Benin||International Development||$0||$0||Ongoing||Apr-2020||n/a||New country of focus|
|EXCEEED Program||International Development||$25,000,000||$25,772,415||Ongoing||Apr-2020||n/a||New Program|
|Mongolia||International Development||$4,000,000||$4,000,000||Ongoing||Apr-2020||n/a||New country of focus|
|Jordan||International Development||$0||$0||Ongoing||Apr-2020||Sep-2015||Evaluation of DFATD Development Programming in former Countries of Modest Presence (Americas, Middle East, Asia) - FY 2009/2010 - 2013/2014||New country of focus|
|Philippines||International Development||$12,000,000||$12,000,000||Ongoing||Apr-2020||Jun-2004||Philippines Contry Program Evaluation 1989/90 to 2001/02||New country of focus|
|Regional Programs||International Development||$61,000,000||$63,005,424||Ongoing||Apr-2015||Oct-2016||Includes EXCEED|
|Burkina Faso||International Development||$0||$0||Ongoing||Apr-2020||n/a||New country of focus|
|International development policy||$0||$0||Ongoing||tbd||2008||Evaluation of CIDA's Implementation of its Policy on Gender Equality|
|Multilateral and global programming and strategic relationships||International Development; International Humanitarian Assistance||$799,948,416||$799,948,416||Jul-2010||Ongoing||Several dates||Several dates||Various sub-program evaluations|
|Partners for development Program||$235,155,361||$235,155,361||Ongoing||Apr-2016||n/a|
|Global Citizens||$26,128,373||$26,128,373||Ongoing||Apr-2019||2011||Volunteer Cooperation Agreement Evaluation|
|Operational Costs for multilateral and bilateral programs (this amount has been kept separate since information on direct allocation to particular programs was not available)||$30,030,155|
|% of the dollar value of Voted Grants and Contributions from the Main Estimates accounted for:||100%|
Annex 3 - Resources Dedicated to the Evaluation Function
|Forecasted Spending(Budget) |
|Forecasted Spending(Budget) |
|Contracted Services – Specific to Evaluations||$1.8m||$1.8m||$2.0m|
|Operations and Maintenance (excluding Contracted Services Specific to Evaluations)||$0.21m||$0.2m||$0.3m|
Annex 4 - Evaluation Requirements to TBSFootnote 23
The table below presents specific evaluation requirements indicated in the TB Submissions that were approved between FY 2007-2008 and FY 2014-2015. It excludes evaluation requirements already completed.
Note: * PB: Program Branch PCE: Development Evaluation Division
TB Submission (abridged title): Muskoka Initiative
Evaluation Requirements made to TBS and TB Conditions: Formative evaluation initated in 2014-2015, and to be completed in 2015-2016.
|TB Submission (abridged title)||Lead*||Evaluation Requirements made to TBS and TB Conditions|
|1. Canada Investment Fund for Africa||PCE||Summative evaluation to be completed by FY 2015-2016.|
|2. Pakistan (Debt Relief)||PB||Joint Partner-led evaluation currently underway (2015)|
|3. Tanzania (Education Sector)||PB||A review in FY 2015-2016.|
|4. Palestinian Authority’s Justice Sector||PB||Project delayed; evaluation timelines to be re-determined once re-scoping approved.|
|5. Support to Aga Khan Foundation Canada’s (AKFC) initiative entitled ‘Regional Maternal, Newborn and Children Health Centers and Comprehensive Health Program in Afghanistan’.||PB||AKFC-led evaluation currently underway|
|6. Funding to the Afghanistan Reconstruction Trust Fund (2014-15 to 2016-17)||PB||Evaluations to be planned and managed through the World Bank|
|7. West Bank Gaza Courthouses Project||PB||Mid-term evaluation currently underway|
Summative evaluation to be completed FY 2017-2018
|8. National Irrigation Program in Mali (2014-15 to 2018-19)||PB||Summative evaluation to be completed FY 2018-2019|
|9. Support to Senegal Education Sector (2013-14 to 2017-18)||PB||Mid-term evaluation to be completed FY 2015-2016|
Summative evaluation to be completed FY 2018-2019
|10. Support to the Bangladesh Health and Education Sectors (2012-13 to 2016-17)||PB||Joint-donor evaluations:|
Mid-term evaluation completed in 2014-2015
Summative evaluation to be completed FY 2016-2017
|11. Productive Safety Net Program (PSNP) Support to Ethiopia's agriculture sector – (2012-13 to 2016-17).||PB||Joint-donor evaluations:|
WB-led impact evaluation completed in 2013
WB-led impact evaluation to be completed in FY 2015-2016
Partnerships for Development Innovation
|TB Submission (abridged title)||Lead*||Evaluation Requirements made to TBS and TB Conditions|
|1. Canadian International Food Security Research Fund (Phase 1)||PB||Summative evaluation to be completed by FY 2014-2015 to be merged with Phase 2|
|2. Support to Aga Khan Foundation Canada’s initiatives entitled ‘Partnership for Advancing Human Development in Africa and Asia’||PB||Formative evaluation initiated, to be completed by FY 2015-2016. |
Summative evaluation to be completed by FY 2015-2016.
|3. Canadian International Resources and Development Institute (CIRDI)||PB||Institutional assessment to be completed by FY 2015-2016. |
Summative evaluation to be completed by FY 2017-2018.
|4. Canadian International Food Security Research Fund (Phase 2)||PB||Summative evaluation to be completed by FY 2017-2018.|
|5. Canadian Francophonie Scholarship Program (2014-15 to 2018-19)||PB||Formative evaluation to be completed by FY 2017-2018. |
Summative evaluation to be completed by FY 2019-2020
|6. Volunteer Cooperation Program||PB||Formative evaluation to be completed by FY 2017-2018. |
Summative evaluation to be completed by FY 2019-2020
Global Issues and Development
|TB Submission (abridged title)||Lead*||Evaluation Requirements made to TBS and TB Conditions|
|1. United Nation's Office for the Coordination of Humanitarian Affairs (OCHA) to support the Central Emergency Response Fund||PB||Evaluations planned and managed through the OCHA|
|2. Gavi, the Vaccine Alliance||PB||Evaluations to be planned and managed through the GAVI Evaluation Advisory Committee|
|3. Global Partnership for Education (GPE) (2014-2015 to 2017-2018)||PB||Summative evaluation to be undertaken in FY 2015-2016.|
|4. World Food Programme||PCE||Development Effectiveness Review completed in 2012.|
MOPAN review of WFP completed in 2013-2014. The Review of the World Food Programme's humanitarian programme also to be covered by the nextHumanitarian Assistance program evaluation (2017-2018).
|5. East Africa Drought||PCE||To be also covered by the nextHumanitarian Assistance program evaluation (2017-2018).|
|6. Global Malaria Program (WHO)||PB||Summative evaluation to be undertaken in FY 2015-2016.|
|7. Scaling-up Nutrition through Integrated Life Saving Interventions (UNICEF/Helen Keller International (HKI))||PB||Independent Comprehensive Evaluation of the Scaling Up Nutrition Movement completed in 2015.|
HKI-led evaluation (HKI component) underway.
|8. Micronutrient Initiative (2014/15 – 2018-19)||PB||Formative evaluation (MI-led) to be undertaken in 2016-2017|
Summative evaluation to be undertaken in 2018-2019
|9. Global Agricultural and Food Security||PB||Partner organizations responsible for implementing each element of the Program are also responsible for planning, resourcing, and conducting evaluations of that programming.|
|10. UNDP Long Term Institutional Support (2012/13-2013-14 and 2014-15 to 2015-16)||PCE||UNDP Development Effectiveness Review completed 2012-2013. A subsequent UNDP Development Effectiveness Review to be undertaken in 2016-2017.|
|11. Funding to implement Canada’s final Copenhagen Accord near-term financing commitments||PB||Evaluations planned and managed through the UNDP and ADB|
|12. Funding for the Global Fund for Aids, Tuberculosis and Malaria over 2014-15 to 2016-2017||PB||Evaluations to be planned and managed through the GFATM Secretariat|
Annex 5 - Establishing the Evaluation Universe
For FY 2015-2016, the Development Evaluation Division reviewed its evaluation universe to taking into consideration the new thematic DFATD’s program activity architecture (PAA, FY 2015-2016), the Performance Measurement Frameworks approved by Treasury Board Secretariat, and the commitments made in Treasury Board Submissions.
The chart below provides an overview of the evaluation coverage under the new thematic PAA. Following discussions with Treasury Board Secretariat’ Centre for Excellence in Evaluation, it was decided to keep the same approach used under the previous PAA to evaluate programming. Therefore, country program evaluations will be undertaken for this fiscal year, with a caviat that a particular country programming can be associated to more than one PAA Sub-Programs as illustrated below.
Based on these considerations and following consultations across the Department, the Development Evaluation Division arrived at a tentative evaluation universe for coverage for the following five (5) year period Footnote 24. Through consultation with the Treasury Board Secretariat, it was determined that there is no obligation to evaluate sunsetting programs.
In planning and revising the sequence of evaluations, the Development Evaluation Division consults across the Department to ensure that user and corporate needs are being met and that ongoing programs are being evaluated every five years as per Treasury Board Secretariat requirements. Further, the Development Evaluation Division ensures that the timing of evaluations feed into the key decision making processes, such as the replenishment of multilateral funds.
- Date Modified: