Independent Impact Evaluation of Myanmar's 3MDG Fund
The Three Millennium Development Goal Fund (3MDG), established in 2012, targets the provision of health services that contribute towards the overall efforts of the Government of Myanmar to achieve the three health related Millennium Development Goals (MDGs 4,5&6). The 3MDG is supported by seven donors and implemented under the Fund Management Office run by UNOPS. The Fund, estimated at $300million, initially provided continued support to various organizations contracted under the Three Diseases Fund (3DF) in addition to the Joint Initiative on Maternal, Neonatal & Child Health. In 2013 the 3MDG Fund began expansion of activities towards national coverage.
EHG carried out the final evaluation of the 3DF, precursor to the 3MDG Fund, documenting lessons learned to inform future health funding under the 3MDG. Seven key recommendations were developed and taken into account during the design phase of the 3MDG including increased emphasis on M&E and evidenced-based research for the key diseases and MNCH.
As part of the design of the 3MDG, a greater emphasis was placed on ensuring that the impact of the Fund could be measured. In an effort to ensure a robust measurement of impact the Fund Management Office contracted EHG to carry out evaluation services as the Independent Evaluation Group (IEG) of the 3MDG Fund. EHG, in consortium with Itad, UK and in collaboration with the Department of Medical Research in Lower Myanmar began work as the IEG in September 2013.
While routine monitoring is done by the Fund Manager, Euro Health Group evaluates the impact of the 3MDG Fund through design and implementation of specific evaluations of different components of the 3MDG Fund as well as the Fund as a whole in part through:
- Establishing an evaluation Framework and overall Theory of Change targeting MNCH, HIV and AIDS, TB, Malaria and Health Systems Strengthening
- Assessing the 3MDG data collection system and proposing data collection tools and methods
- Conducting mid-term and final evaluations including programme, financial and management issues
- Conducting impact evaluation targeting MNCH services including family planning, access to critical services and commodities, etc. and specific evaluations or research
During the inception visit in September 2013 the core expert team, accompanied by EHG’s CEO, Michele Gross, interviewed key stakeholders from the Fund Management Office, Fund Management Board, Ministry of Health, Implementing Partners and other organizations and institutions involved in the implementation of activities targeting MNCH, HIV/AIDS, TB, Malaria and health systems strengthening in Myanmar. The information gathered formed the basis for developing the overall Theory of Change which establishes ties with the expected results and supplements the logframe. The EHG team developed and has begun operationalization of an evaluation framework, with emphasis on context-mechanism-outcome configurations that maximize the benefits of ‘process evaluation’ and ‘impact evaluation’ elements. National data on trends will be assessed as part of the mid-term, final and impact evaluations and quantitative and qualitative information will be gathered to validate data, including comparison communities/townships if possible. The impact evaluation design, which is underway, will integrate information of the theory-based analysis of implementation and understanding of processes and mechanisms etc. to add depth to the assessment of impact.