In this episode we review the $41 Million World Vision Canada project (www.worldvisioncanada.ca) entitled Realizing Gender Equality, Attitudinal Change, and Transformative Systems in Nutrition. More information about this project can be found at https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p011791001.

A critique of the Performance Measurment Framework (PMF) for this project reveals 13 expected Outcomes for this project with 38 Outcome Indicators developed to examine whether those Outcomes were indeed achieved. This critique concludes that 10 Outcome Indicators are designed to enable to examine whether those Outcomes were achieved while the remaining 28 Outcome Indicators were considered to be poorly designed with no possibility of supporting the claim that their related Outcomes were achieved. Data on these Outcome Indicators are not available to the public which would enable the public to see if Outcomes were achieved.

Flaws in Outcome Indicator design include using self-reporting bias instead of external objective measures as well as Outcome Indicators not related to the Outcome. Even for the 10 Outcome Indicators considered to well designed in measuring the achievement of its related Outcome, many of these Outcome Indicators failed to offer statistical significance analysis to show that the achievment of the Outcome could be attributed to the $41 Million project where that achievement was significantly different compared to the Outcome Indicator moving in the desired direction anyway in the absence of the $41 Million project or moving in the desired direction over time but with negligible effect (i.e. lacks significant Impact).

Please sign the petition here https://www.change.org/EvaluateCanadaAid to have the Government of Canada require all Canadian taxpayer funded international development organizations release on their websites their Performance Measurement Frameworks (PMFs) or its equivalent and data for all output and outcome indicators listed in the PMF.

For a 15% discount on sunglasses, and cotton polo shirts when visiting the Global South use this discount link: https://mydeals.page/1hjl

Donate here: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL

Or at buymeacoffee.com/davidwand to help the podcast

Please sign the petition here https://www.change.org/EvaluateCanadaAid to have the Government of Canada require all Canadian taxpayer funded international development organizations release on their websites their Performance Measurement Frameworks (PMFs) or its equivalent and data for all output and outcome indicators listed in the PMF.

CUSO International (www.cusointernational.org) has failed to properly measure and evaluate its 2 projects costing the Canadian taxpayer $7.5 Million. CUSO International cannot make the claim that it has achieved its outcomes for their 2 projects. This is based upon a review and critique of the Performance Measurement Frameworks (PMFs) for these 2 projects. This critique is explained for each outcome and outcome indicator from these 2 PMFs in this episode. These PMFs and PMF critique can be requested by emailing evaluatecanadaaid@gmail.com.

Details on these 2 CUSO International projects is available here: Blueprints for Gender Equality https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p010478001 and Building Bricks Caribbean https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/p013586001

For the Blueprints for Gender Equality CUSO International project, the PMF had 9 Outcomes with 13 Outcome Indicators. Only 1 of those Outcome Indicators was properly designed to support the claim that the Outcome was achieved. Even if it was achieved, no data was provided to support that claim. The remaining 12 poorly designed Outcome Indicators were poorly designed due to either self-reporting bias or conflict of interest when an external consultant should have been used instead to objectively measure whether the outcome was achieved. They used an external consultant for the 1 good Outcome Indicator but oddly refused to do it for the other Outcome Indicators!! Other poorly designed Outcome Indicators were due to measures that had nothing to do with whether the Outcome was achieved.

For the Building Bricks CUSO International project, the PMF had 8 Outcomes and 15 Outcome Indicators. 4 of those Outcome Indicators were properly designed to support the claim that some of the Outcomes were achieved. Even if they were achieved, no data was provided to support that claim. The remaining 11 poorly designed Outcome Indicators were poorly designed due to either self-reporting bias or due to measures that had nothing to do with whether the Outcome was achieved.

CUSO International has been invited to attend the podcast to provide a response to this critique of their project PMFs. The PMF critique and PMFs have been sent to CUSO International as well as the Secretary of State for International Development and the shadow critics for International Development.

For a 20/15% discount on sunhats, sunglasses, and cotton polo shirts when visiting the Global South use this discount link: https://mydeals.page/1hjl

Donate here: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL

Or at buymeacoffee.com/davidwand to help the podcast

In this episode, the Global Community Engagement Resilience Fund (GCERF) (www.gcerf.org) fails to evaluate the effectiveness of its $ 1.1 Million USD received from Global Affairs Canada. GCERF claims to be achieving its 4 outcomes by funding organizations in developing countries to deliver services to achieve those outcomes. But GCERF provides no measures on these outcomes through outcome indicators nor any data related to those outcome indicators in the document they sent to Dr. Wand. This document was a response to his request for the outcome indicators and their data used to measure changes in these outcomes. The 4 outcomes that GCERF claims to be achieving with this $1.1 Million USD Government of Canada funding are:

1. Increased social cohesion
2. Increased ability to mobilize, organize, represent their own interests (agency)
3. Increased knowledge, skills, and subsequent increases in income/livelihoods.
4. Increased confidence, critical thinking, life skills, self-worth, resilience (sense of purpose).

GCERF claims on its website, "At grant level, each project is guided by a theory of change and a results framework with outcome and output indicators, requiring grantees to collect baseline data, report quarterly, and conduct final assessments."

GCERF is falsely claiming to Canadians that they have achieved these 4 outcomes because GCERF provides no outcome indicators nor data from these outcome indicators showing that social cohesion, agency, skills & income, or sense of purpose have increased.

Dr. Wand has sent his critique of this GCERF document to the Secretary of State for International Development as well as the shadow critics for International Development. He has recommended that all funding to GCERF be suspended until outcome indicators and the data used to measure the achievement of these outcomes is provided on their website for all grants including this grant, if such outcome indicators and data exist.

Sign the petition here to require GCERF to put all its PMFs and related data on its website:

www.change.org/EvaluateCanadaAid

GCERF has also been sent the critique of their response as well as an invitation to be on the podcast to respond and offer actions to address the absence of outcome measures for their expected outcomes or to respond in writing to evaluatecanadaaid@gmail.com.

https://mydeals.page/1hjl

Donate here to increase the number of organizations that receive performance audits like this one: https://www.paypal.com/ncp/payment/ZAQD8888DEDXL

Or at buymeacoffee.com/davidwand