Financial Empowerment and Monitoring and Evaluation

The Financial Empowerment – Monitoring and Evaluation (FE-M&E) practice at DNA Economics has extensive experience working with national, provincial, and local government, donors, and the private sector to solve complex problems.

We offer a diverse range of services that are customised to meet the specific needs of our clients. In our approach, we commonly employ a theory based methodology that combines both quantitative and qualitative methods. This approach allows for data triangulation, thereby strengthening the validity of study findings. By utilising a combination of these rigorous research techniques, we ensure comprehensive and reliable evaluation results.

The aim of the Monitoring & Evaluation (M&E) practice is to facilitate the systematic and independent measurement of project and programme performance. We conduct evaluations with a strategic focus on enhancing project performance, outcomes, and impact. These evaluations also serve to inform policy and investment decisions while promoting institutional learning.

The Financial Empowerment (FE) practice is dedicated to delivering comprehensive financial sector research, policy analysis, strategic guidance, programme redesign, and monitoring and evaluation services. With a specific focus on consumer education, we leverage insights from behavioural economics and transformative learning theories to help our clients enhance the effectiveness and impact of their programmes.

Monitoring

Evaluation

Financial Empowerment

Our clients include all spheres of government, the private sector, foundations, donors, and non-profits. Our experience is extensive; using our embedded understanding of the South African and broader African context, we have conducted more than 50 evaluations in the fields of education, health, financial services, corporate social investment, industrial development, and trade. Our evaluation specialists and economists deliver evaluations that can stand up to external scrutiny, are objective, and provide the insight needed for clients to assess project progress and improve their interventions to maximise impact. We also help our clients to communicate the results of evaluations to their broader stakeholders in the form of workshops and forums.

For more information on DNA’s financial empowerment and M&E work please contact:
Zulaikha Brey or Alex Spyrelis at +27 (0)12 362 0024 or email us on contact@dnaeconomics.com.

Projects

APROS FOUNDATION, SOUTH AFRICA, 2018

DNA Economics developed a Monitoring and Evaluation (M&E) Framework for the APROS Foundation. The framework provided guidance on how the organisation would carry out its monitoring and evaluation functions over the life span of its programmes and projects. The M&E framework allows the Foundation to track and measure progress on the implementation of its programmes and provide information to management and funders about the performance of the projects.

More >

SOUTH AFRICA’S NEAR-TERM CLIMATE CHANGE PRIORITY FLAGSHIP PROGRAMMES ASSESSMENT FRAMEWORK (GIZ/DEA, SOUTH AFRICA, 2015-2016)

DNA Economics developed an assessment framework that can be used to evaluate, compare and contrast the implementation of the Near-term Priority Flagship Programmes driving climate change adaptation and mitigation responses in South Africa at scale. The framework allowed for the identification of Flagship Programmes which are being successfully implemented, and for highlighting barriers and challenges faced by Flagship Programmes from a programme perspective. DNA Economics also assisted with the creation of detailed operational model that will guide the roll-out of Flagships in future.

More >

REVIEW AND UPDATE OF GUIDELINES FOR DEVELOPMENT OF POLLUTION PREVENTION PLANS (THE GREEN HOUSE/GIZ, SOUTH AFRICA, 2015)

DNA Economics supported The Green House in assisting the Department of Environmental Affairs (DEA) to review and update the Guidelines for the Development of Pollution Prevention Plans for greenhouse gases (PPP-GHGs). The Guidelines provide guidance to companies that have been allocated carbon budgets by the Minster of Environmental Affairs. The requirement for submitting PPP-GHGs has been specified in the National Pollution Prevention Plans Regulations in Respect of GHGs developed by the DEA in terms of the National Environmental Management: Air Quality Act, 2004. The project is funded by GIZ.

More >

DEVELOPMENT OF A BUSINESS POSITION ON THE SOUTH AFRICAN INTENDED NATIONALLY DETERMINED CONTRIBUTION (INDC) TO THE UNFCCC (BUSA, SOUTH AFRICA, 2015)

South Africa’s INDC forms the basis of the contribution it undertakes to make to prevent and address climate change in the medium term in the international arena. BUSA commissioned DNA to consider what an INDC would look like that adequately reflects South Africa’s socio-economic development and climate mitigation ambitions. The international and local mitigation policy contexts (including the nature of South Africa’s existing pledge under the UNFCCC and local process being undertaken to reduce national GHG emissions) were considered to develop a number of approaches that could be considered to develop South Africa’s INDC. These approaches were presented to BUSA members who voted for their preferred approach. The outcome of this process was a BUSA-mandated view of what South Africa’s INDC should look like. The proposed INDC option, and the process required to fully develop and present it to the UNFCCC, were presented in a position paper that BUSA shared with the Department of Environmental Affairs.

More >

SOUTH AFRICA LOW EMISSIONS DEVELOPMENT (LED) PROJECT (CHEMONICS INTERNATIONAL/ USAID, SOUTH AFRICA, 2015 – 2020)

USAID partnered with the Department of Environmental Affairs (DEA) and Department of Science and Technology (DST) in South Africa to implement the $14 million South Africa Low Emissions Development (SA-LED) Program.
The SA-LED Program aims to address capacity and analytical needs related to low emission development planning and project development at the Municipal level and to transform the South African economy in such a way that it supports jobs and sustainable growth, while lowering GHG emissions. Initiated in May 2015 and continuing until 2020, the Program provided project development capabilities and strengthening public sector development planning skills for low emissions development. In addition, technical assistance and capacity building activities facilitated private sector participation in potential low-emissions bankable projects through identifying opportunities, bringing relevant actors together and facilitating feasibility studies and innovative financing models.
DNA Economics was part of the consortium implementing the project, led the program’s M&E and communications efforts, and provided targeted appraisals, studies, and feasibility analyses. This included value-chain research in specific sectors, to assess the potential for ‘greening’ industrial

More >

DIAGNOSTIC EVALUATION OF THE IMPACT OF THE LEGISLATIVE ENVIRONMENT ON THE AGRICULTURAL SECTOR IN THE WESTERN CAPE (WESTERN CAPE DEPARTMENT OF AGRICULTURE, SOUTH AFRICA, 2014-2015)

The Western Cape Department of Agriculture (WCDoA) commissioned DNA to consider the impact of policies and legislation on the agriculture sector in the province. The study identified both commodity-specific and cross-cutting issues that negatively impact the development of a number of key commodity groupings in the Western Cape. Issues were defined broadly to include both policies, regulations and laws at all levels of governments, and voluntary and mandatory requirements that farmers felt they had to comply with to ensure local and international market access. A combination of primary (interviews and focus groups) and secondary research was used to identify issues and propose solutions to key issues. A framework was developed to assist the WCDoA to priorities addressing 5 issues out of a total of 115 issues identified. 11 recommendations were put forward to address the 5 priority issues, with a further 60 recommendations suggested to addresses other issues in future.

More >

ASSESSMENT OF THE BIOFUELS INCENTIVE MODEL (NATIONAL TREASURY, SOUTH AFRICA, 2014)

A model (the Biofuels Incentive Model) has been developed on behalf of the Department of Energy to calculate the value of a fiscal production incentive for biofuels announced by the South African government in 2013. The incentive is to be funded by a biofuels levy on all petrol and diesel sold for domestic consumption. The National Treasury requested an assessment of this model to understand its theoretical underpinnings, the calculations behind the model, conduct sensitivity analyses to highlight risks and their likely magnitudes, and identify possible risk mitigation options. The assessment will assist the National Treasury to assess the fiscal risk related to the incentive and to respond effectively to possible parliamentary and other queries on the subject.

More >

DEVELOPMENT OF A HIGH-LEVEL CLIMATE CHANGE MITIGATION TECHNOLOGY IMPLEMENTATION PLAN FOR SOUTH AFRICA (THE GREEN HOUSE/GIZ, SOUTH AFRICA, 2014-2015)

The project developed a high-level technology implementation plan for the Departments of Environmental Affairs and Science and Technology to support climate mitigation efforts in South Africa as a complement to work already undertaken by the Departments (most notably the 2013 Mitigation Potential Analysis (MPA)). The project identified short, medium and long-term technology development, commercialisation and roll-out support programmes for priority technologies (and where possible, related technologies for which broadly similar technology support programmes may be relevant).

More >

MONITORING AND REPORTING SERVICES TO THE PRIVATE SECTOR ENERGY EFFICIENCY PROGRAMME (PSEE) (NBI/DFID,SOUTH AFRICA, 2014-2015)

The National Business Initiative (NBI) implemented the £8.6 million Private Sector Energy Efficiency Programme PSEE) on behalf of UK Department for International Development (DFID) to improve the energy efficiency of commercial and industrial companies in South Africa. The PSEE assisted companies to identify and implement energy saving measures. Assistance was differentiated by company size and provided throughout South Africa. DNA Economics developed the PSEE monitoring and reporting framework by customising an initial framework proposed by the Carbon Trust to ensure that it is suited to South African conditions; consistent with DFID’s reporting requirements; cost-effective; and in line with the PSEE Business Case and logical framework (logframe). The framework included both data collection and process tools for monitoring the success of PSEE interactions with firms. DNA administered an online survey to beneficiaries of PSEE remote advice and implemented outcome monitoring calls to 450 medium and large firms that benefited from PSEE site surveys or strategic energy management interventions. In addition, DNA also provided monitoring and reporting capacity building and training to PSEE personnel and provided quality assurance services.

More >

ASSESSMENT OF CLIMATE CHANGE MITIGATION POLICY MAINSTREAMING (GIZ/DEA, SOUTH AFRICA, 2013-2014)

The project assessed the alignment of policies in five South African sectors (Agriculture, forestry and other land use, Energy, Industry, Transport, and Waste) with the National Climate Change Response Policy (NCCRP). A detailed policy gap assessment framework was developed based on NCCRP general principles and customised for use with four types of policy documents (High-level policy frameworks and strategies, Legislation/Acts, Regulations, and Implementation plans). The “effectiveness” (whether a mitigation option is likely to reduce GHG emissions) and “appropriateness” (whether a mitigation option conforms to the general NCCRP principles) of mitigation elements included in policy documents were also considered.

More >
ECIC-APROS SED REPORTING
This was an extension of the previous project to provide quarterly and annual reports for the ECIC’s SED programme. The ECIC’s Socio-economic development programme seeks to both transform and develop a pipeline of critical skills for the export industry through education, training, and skills development. This is done via the provision of funding for a range of student bursaries schemes and consumer financial education initiatives. This project involved the collection and reporting of monitoring data, used to report to Exco on a quarterly and annual basis. The project was carried out on behalf of Alternative Prosperity who administered the SED funds.
 
 
EVALUATION OF THE CRIMINAL ASSET RECOVERY ACCOUNT (CARA) FUND TO GENDER-BASED VIOLENCE AND FEMICIDE (GBV&F)
DNA Economics was commissioned by the National Development Agency (NDA) to undertake an implementation evaluation of the Criminal Asset Recovery Account (CARA) Fund to Gender-Based Violence & Femicide (GBV&F) implemented through Civil Society Organisations (CSO’s). The objective of the evaluation was to assess and evaluate: a) the extent to which the Memorandum of Understanding (MoU) between the Department of Social Development (DSD) and the NDA was implemented as planned (including but not limited to financial disbursements, monitoring and reporting, management, governance and accountability), and the appropriateness of the partnership between the DSD and NDA in implementing the CARA programme to CSOs; b) the capacity of, and processes used by, the NDA to select and appoint CSOs, the coordination and reporting systems used by the NDA, and the capacity of CSOs to deliver their CARA-funded projects; and c) the extent to which the CSOs were implementing their CARA-funded projects, including the quality and quantity of services provided, and the contribution of the CARA-funded projects to national objectives around GBV&F.
 
 
RAPID ASSESSMENT OF THE 2021 SAB SHARP PILOT PROGRAMME
The South Africa Be Sharp (SAB Sharp) is an initiative by the South African Breweries (SAB), launched in 2021, that aims to deliver impactful interventions that champion the responsible consumption of alcohol in South African communities and drive transformative change. SAB Sharp aims to reduce the harm associated with excessive alcohol consumption and consists of four pillars, which focus on promoting responsible communities, driving, marketing, and trading. It will be implemented over a five-year period, from 2021 to 2025.

DNA Economics was commissioned to conduct a rapid evaluation of the SAB Sharp programme, which was piloted in 2021. The evaluation focused on the implementation and emerging outcomes of the pilot programme by assessing performance against the specified objectives, as well as programme successes, challenges, key risks, and areas for improvement.
 
 
PROCESS AND PRELIMINARY OUTCOME EVALUATION OF THE GROW LEARN OWN (GLO) PROGRAMME
The Grow Learn Own (GLO) Programme is part of a layered service offering of a broader HIV prevention programme funded by the Global Fund to address the social and structural drivers of HIV by assisting vulnerable adolescent girls and young women to become economically active. The programme provides young women who are not in employment, education, or training (NEET) to transition to the labour market by providing them with opportunities to study, find employment, or start their own businesses, and to become financially literate. DNA was commissioned to assess whether the programme had been implemented as intended and whether it achieved its outputs and preliminary outcomes.
 
 
SOLVESA, SOUTH AFRICA, 2021
DNA was contracted by SolveSA, a member of the Alternative Prosperity Group, to develop a Monitoring & Evaluation Framework for their transformation solutions platform. The SolveSA platform pools resources and efforts to offer cost-effective B-BBEE implementation initiatives that drive real change in the lives of beneficiaries by linking clients to accredited and impactful providers.
 
 
SAB PIC ASSESSMENT OF THE 2020 PUBLIC INVESTMENT COMMITMENT (PIC) SPEND (SAB/AB INBEV, SOUTH AFRICA, 2021)
As part of the merger conditions set out by the Competition Tribunal for SAB, AB InBev agreed to invest in Public Interest Commitment (PIC) programmes focused on the development of agriculture and enterprise, the promotion of local manufacturing and exports, and education (to the value of R1 billion over a 5-year period). SAB has contracted DNA Economics to conduct an annual evaluation of the project to assess whether it had been implemented as planned, to identify emerging successes and challenges, and whether the objectives had been met. AB InBev use the findings to report on performance to the Competition Commission. This project was undertaken in 2021 to evaluate programme implementation in 2020 across the three pillars (Agricultural Development, Enterprise & Supplier Development, and Societal Benefits).
 
 
OUTCOME EVALUATION OF THE RMB FUND’S GROWING THE GREEN ECONOMY PROGRAMME: CONSERVATION PILLAR (TSHIKULULU SOCIAL INVESTMENTS, SOUTH AFRICA, 2021)
DNA was commissioned by Tshikululu Social Investments, on behalf o the FirstRand Foundation Trust, to conduct an outcome evaluation of Conservation pillar of their Growing the Green Economy Programme. The evaluation focused on the five implementing conservation partners that were supported by the RMB Fund throughout the previous 3-year funding cycle, between 2018 and 2020. The five partners implemented 10 projects across various provinces of South Africa during this period. The partners included in the evaluation were BirdLife SA, Rhodes University Environmental Science Department, The Endangered Wildlife Trust, The Southern African Foundation for the Conservation of Coastal Birds (SANCCOB), and The World Wide Fund for Nature (WWF). The evaluation measured programme outcomes, how partners performed against their objectives, whether the programme should be continued, and how impact can be maximised if so.

 
RESEARCH PROGRAMME ON TECHNICAL AND VOCATIONAL EDUCATION AND TRAINING (TVET) THEORY OF CHANGE AND LOGFRAME (UNIVERSITY OF WESTERN CAPE, SOUTH AFRICA, 2021)
DNA was contracted by the Institute for Post-School Studies (IPSS) at the University of the Western Cape to develop a Theory of Change and Logframe for the five-year TVET Research Programme.

The team reviewed the programme documents and interviewed stakeholders at the Department of Higher Education and Training and the IPSS to develop a Theory of Change and Logframe for the programme.

The Theory of Change maps out the relationship between:
-Inputs, activities, and outputs
-Outputs and outcomes
-Outcomes and impact
Performance indicators were also developed against which the programme can be monitored and evaluated.
 
 
EXPORT CREDIT INSURANCE CORPORATION OF SOUTH AFRICA (ECIC), SOUTH AFRICA, 2019-2021
The ECIC’s Socio-economic development programme seeks to both transform and develop a pipeline of critical skills for the export industry through education, training, and skills development. This is done via the provision of funding for a range of student bursaries schemes and consumer financial education initiatives. This project involved the design of a M&E Framework to enable the tracking and measurement of programme performance and progress towards objectives, as well as the collection and reporting of monitoring data, used to report to Exco on a quarterly and annual basis. The project was carried out on behalf of Alternative Prosperity who administered the SED funds.
 
 
UN WOMEN, SOUTH AFRICA, 2018-2019
The Department of Women developed a Gender Responsive Budgeting, Monitoring, Evaluation and Auditing Framework. DNA Economics was hired through UN Women to support the Department of Women to develop indicators to track and monitor the implementation of the framework by government departments and agencies.
 
 
GAUTENG OFFICE OF THE PREMIER, SOUTH AFRICA, 2018
DNA Economics was asked by the Office of the Premier to evaluate a component of the Ntirhisano Outreach Programme. This evaluation focused on the fourth pillar of the Ntirhisano programme – the outreach component. It examined the implementation of the outreach programme across all five development corridors across the Gauteng City Region (GCR). The evaluation assessed the relevance, efficiency and effectiveness of the outreach programme. For this evaluation, DNA Economics developed a Theory of Change against which the programme was assessed.
 
 
SAVE THE CHILDREN SOUTH AFRICA, SOUTH AFRICA, 2018
DNA Economics was commissioned to conduct a comprehensive review of the Monitoring, Evaluation, Accountability and Learning processes on the Sireletsa Bana Project administered by Save the Children South Africa. The project consisted of two distinct but interrelated components. The first component focused on the assessing the quality of data. The second component of this evaluation was a formative evaluation to understand the progress in delivering on the results set out in the logical framework.
 
 
ZENEX, SOUTH AFRICA, 2018-2019
DNA Economics was asked by Zenex Foundation to evaluate the implementation of the Gauteng Literacy and Numeracy (LitNum) Strategy: “2015 and beyond”. This strategy aimed to improve the curriculum management practices and behaviours within schools.
 
 
DEVELOP AN INSTITUTIONAL ANALYSIS (DUCHARME CONSULTING, SOUTH AFRICA, 2017)
DNA Economics subcontracted to Ducharme Consulting to develop an institutional analysis, logical framework and indicators for the Performance Expenditure Review on Government Fleet Services.
 
 
NATIONAL QUALIFICATIONS FRAMEWORK ACT (DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA 2017-2019)
This national evaluation focused on the National Qualifications Framework. Commissioned by the Department of Planning, Monitoring and Evaluation, this evaluation assessed the extent to which the National Qualifications Framework Act had been implemented as intended. Given the complex nature of the National Qualifications Framework, DNA Economics used a complexity-responsive approach to analyse the effectiveness of the framework.
 
 
THE DESIGN AND POSSIBLE STRUCTURE OF AN OUTCOMES FUND IN THE EDUCATION SECTOR (BERTHA CENTRE, SOUTH AFRICA, 2017)
Bertha Centre tasked DNA Economics and Alternative Prosperity with assessing the feasibility of an Outcomes Fund for Johnson and Johnson. As part of this project, the DNA team looks at the design and possible structure of an Outcomes Fund in the education sector. The project involved identifying the social problem that could be addressed through an Outcomes Fund, designing the structure of a fund and developing models for performance-based payments to implementing agents.
 
 
POSITION PAPER AND COSTING MODEL FOR THE QUALITY COUNCIL FOR TRADES AND OCCUPATIONS (QCTO), QCTO, SOUTH AFRICA, 2017
DNA Economics provided technical support to JET Education Services who were commissioned by the Quality Council for Trades and Occupations (QCTO) to develop a business case, including position paper and costing model, for the future activities of the QCTO. In its role as quality council, the QCTO takes overall responsibility for the qualification development, quality assurance and certification of occupational (workplace) training in South Africa. This business case allowed the QCTO to clearly set out and cost its future operational model as part of a request for the creation of a more secure and sustainable funding stream for the organisation that will enable it to better execute its strategic responsibilities.
 
 
EVALUATION OF THE NECT’S DISTRICT IMPROVEMENT PROGRAMME (DIP) LEARNING PROGRAMME (LP) (SOCIAL SURVEYS AFRICA, SOUTH AFRICA, 2017-2019)
This evaluation of the NECT’s District Improvement Programme (DIP) Learning Programme (LP) was commissioned by the Zenex Foundation and implemented by Social Surveys Africa and DNA Economics. The evaluation assessed the extent to which the DIP was implemented as planned and achieved its intended outcomes and impacts. The evaluation draws conclusions on the implementation of the programme and its emerging impacts. Lessons from this evaluation form the basis for recommendations on how the LP and the DIP can be improved, sustained and scaled up beyond the current interventions and provinces.

This study combined a theory-based implementation and impact evaluation. The impact assessment used a quasi-experimental design that measures the differences between the matched treatment and comparison groups. Work on the evaluation began in October 2016 and was completed in July 2019.
 
 
BLUE LADDER SCHOOL PROGRAMME (SANLAM FOUNDATION, SOUTH AFRICA,2016)
DNA Economics helped to design the Blue Ladder School programme, a holistic intervention to improve the quality of learning and teaching in schools. As part of this project, DNA Economics developed the theory of change for the intervention, held validation workshops, designed the monitoring and evaluation frameworks and conducted the annual programmatic reviews.
 
 
INCREMENTAL INVESTMENT IN FORENSIC SERVICES (DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA, 2015-2017)
This was an economic evaluation, that used cost benefit analysis to determine whether the benefits arising from the investment in forensics services outweighs the cost. DNA Economics would cost data on the implementation of the incremental investment programme within the South African Police Services. Once this information was collected, DNA Economics identified how fiscal resources were spent and where possible monetise the incremental benefits of this investment.

This evaluation focused on the Incremental Investment in Forensic Services, under the Seven-Point Plan approved by Cabinet in 2007. The Seven-Point Plan seeks to build capacity in the Criminal Justice System (CJS) to tackle the high levels of crime in South Africa. Forensic Services was chosen as the focal point for the additional funding because it influences the effectiveness of subsequent investigations, prosecution, and judicial proceedings within the CJS.

The South African Police Services (SAPS) and Department of Planning, Monitoring and Evaluation (DPME) have commissioned an evaluation of the Incremental Investment in Forensic Services (IIFS). Through the IIFS, the SAPS received an additional R6.2 billion in funding between 2009/10 and 2014/15. This funding was made available to recruit forensic personnel, train existing staff, purchase specialised equipment, modernise systems and fund the operations of the Division: Forensic Services. This evaluation sought to understand the effectiveness of the Incremental Investment in Forensic Services in improving criminal justice outcomes.
 
 
MILLENNIUM DEVELOPMENT GOALS – SOUTH AFRICA’S PROGRESS TOWARDS GOAL 8 (STATISTICS SOUTH AFRICA, 2015 / 2013 / 2010)
Assisted Statistics SA in writing up a sectoral report on Goal 8 for the Millennium Development Goals Report (2010, 2013 and 2015) (South Africa). This involved reporting on South Africa’s progress towards its goals within the context of other national indicators and targets, in line with global MDG standards and principles. The 2015 MDG report also focused on the transition to the Sustainable Development Goals post-2015.
 
 
FORMATIVE EVALUATION OF GAUTENG’S TOWNSHIP ECONOMIC REVITALISATION PROGRAMME (GAUTENG PROVINCIAL GOVERNMENT, SOUTH AFRICA, 2015)
The Gauteng Government has adopted a Township Economy Revitalisation (TER) strategy to build and strengthen township economies. This strategy sets out numerous action plans across several focus areas. DNA was contracted to undertake a formative evaluation of this strategy in order to test the theory of change for the TER Strategy; validate the connections and assumptions across each level of the underlying results chain; and identify a set of indicators which can be used to monitor the performance of the strategy against this theoretical framework.
 
 
FACTORS THAT DRIVE THE WORKLOAD OF SOUTH AFRICAN DIRECTORS GENERAL (DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA, 2015)
This study examined the factors that drive the workload of South African Directors General; and how they allocate their work across the various demands on their time.The study used a mixed methods approach: including an analysis of their diaries and time allocated to different meetings, interviews with key informants and political principals.
 
 
REVIEW GAUTENG PLANNING COMMISSION’S PROGRAMME OF ACTION AND ITS INDICATORS(GAUTENG OFFICE OF THE PREMIER, SOUTH AFRICA, 2014)
DNA Economics was tasked with reviewing the Gauteng Planning Commission’s Programme of Action and its indicators. For this project, DNA Economics reconstructed the Programme Theory for each of the ten Pillars of the GPC’s POA. By applying a indicator evaluation framework, DNA Economics was able to assess the quality and robustness of each indicator in the POA. Based on this assessment, the project team proposed changes to existing indicators.
 
 
DESIGN AND REFINE THE FRONT LINE SERVICE DELIVERY MONITORING TOOL (DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA, 2014)
DNA Economics was appointed to design and refine the Front Line Service Delivery Monitoring tool used by the Presidency to monitor service delivery across home affairs offices, health clinics, schools, police stations, SASSA offices, licence testing centres, magistrate’s courts and municipal offices. The project involved designing a rating tool and manual for monitoring staff in the Presidency. As part of this project, the DNA team piloted the revised tool and refined it based on the findings.
 
 
MID-TERM REVIEW OF THE AGRIBUSINESS DEVELOPMENT AGENCY (KWAZULU-NATAL AGRIBUSINESS DEVELOPMENT AGENCY, 2015)
Contracted to undertake a review of the KZN Agribusiness Development Agency (ADA). The review had two broad objectives: (1) To evaluate the economy, efficiency and effectiveness of ADA and its project management processes; and (2) To reflect on the Agency’s performance and identify improvement opportunities for the organisation and its project management processes. The methodology incorporated a literature review, review of KZN ADA’s documentation, stakeholder consultations and a visit to (and review of) 6 ADA project sites.
 
 
MID-TERM EVALUATION OF THE ZIMBABWE STRATEGIC ECONOMIC RESEARCH AND ANALYSIS (SERA) PROGRAM (USAID, ZIMBABWE, 2014)
DNA Economics was contracted to conduct a performance evaluation of specific elements of the Zimbabwe Strategic Economic Research and Analysis (SERA) Program in order to inform the future programming of USAID economic interventions in Zimbabwe and its economic policy work elsewhere.
 
 
EVALUATION OF FOUR USAID PROJECTS FUNDED THROUGH THE DEVELOPMENT GRANTS PROGRAMME (USAID, SOUTH AFRICA, 2014)
DNA Economics was contracted by USAID South Africa to undertake a final evaluation of the USAID-funded Development Grants Programme (DGP) environment portfolio. Four projects in four different countries (South Africa, Swaziland, Lesotho and the Seychelles) were selected for evaluation. These projects focused on strengthening regional capacity for utilization of clean energy technologies and expanding key stakeholder capacities to adapt to anticipated climatic changes.
 
 
PRESIDENTIAL HOTLINE DATABASE (DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA, 2014-2015)
DNA Economics was commissioned to analyse the Presidential Hotline Database of about 160,000 complaints across 14 sectors. This project involved categorising complaints by sector, analysing key trends in complaints and identifying common themes. The project also did an assessment of the complaints mechanisms in government departments to understand their effectiveness. As a final output of this project, DNA Economics produced an improvement plan that outlined some systemic changes that could be introduced within the government to improve the handling of complaints.
 
 
MID-TERM EVALUATION OF TRADEMARK SOUTHERN AFRICA (WYGI/DFID, SOUTH AFRICA, 2013/14)
DNA Economics was part of the WYGI-led team appointed to evaluate TradeMark Southern Africa (TMSA); a GBP100m, 5-year programme funded by the UK’s Department for International Development (DFID). Matthew Stern of DNA was the team leader on this evaluation and was responsible for coordinating all activities and a team of 8 evaluators and technical specialists.
 
 
IMPACT ASSESSMENT OF NATIONAL LIQUOR ACT (2003) (THE DTI, SOUTH AFRICA, 2013)
DNA Economics was contracted to undertake an assessment of the National Liquor Act (2003), focussing on whether the policy goals outlined in the Act have been achieved since the implementation of the Act in 2003. Specifically the study focussed on the regulation of manufacturing and distribution of liquor, the production of illicit liquor and the employment of minors and the extent to which the Act has successfully reduced the socio-economic harms associated with liquor abuse. The study comprised of desktop research, stakeholder consultations and focus group research of informal liquor retailers.
 
 
IMPACT EVALUATION FRAMEWORK (BANKSETA, SOUTH AFRICA, 2013)
DNA has been commissioned to design an impact evaluation framework for BANKSETA, and to test this framework across 5 of BANKSETA’s priority skills development programmes. This has included a review of international evaluation techniques in the training sector, the development of impact or logic chains for each of the programmes, the design and implementation of a survey of 200 learners and 50 corporate beneficiaries, and the calculation of the return on investment from these programmes.
 
 
PERFORMANCE EVALUATION OF THE SOUTHERN AFRICAN REGIONAL ENVIRONMENTAL PROJECT (USAID, SOUTHERN AFRICA, 2013)
The purpose of this assignment was to conduct a performance evaluation of the USAID-funded Southern Africa Regional Environment Program. The specific objectives included:

• To document the degree to which USAID-funded environmental project interventions through Chemonics Inc. worked, or did not work;
• To identify best practices, lessons learned, and areas of improvement; and
• To provide recommendations to inform USAID’s follow-on interventions toward improved management of the Okavango river basin, with emphasis on institutional strengthening, biodiversity conservation, water and sanitation, and climate change adaptability, and assess what will be required to achieve existing strategic goals and results.

The findings from this evaluation informed USAID’s decision to extend the projec for a further year.
 
 
DTI IMPLEMENTATION PROGRAMMES (DPME, SOUTH AFRICA, 2012)
DNA was contracted by the DPME to identify and plot the logical framework for four implementation programmes of the Department of Trade and Industry: Small, Micro and Medium Enterprise Development; the Cooperative Development Programme; Export Promotion; and the National Liquor Authority.
 
 
EVALUATION OF SEDA TECHNOLOGY PROGRAMME (STP) (SMALL ENTERPRISE DEVELOPMENT AGENCY (SEDA), 2012)
SEDA’s Technology Programme (STP) was developed to provide a form of targeted support to entrepreneurs and small enterprises.The STP programme has become one of the main avenues through which technology based small enterprises can seek and obtain support. SEDA plans to further expand on this programme in order to increase the depth and coverage of its incubation support services.
In line with the proposed expansion, DNA Economics undertook a comprehensive assessment of Seda’s incubation programme through an evaluation of the performance of six existing incubators and an international benchmarking exercise.
Through the international benchmarking the study identifies key aspects of incubator design and performance that ensure the implementation of successful incubation programmes and, in turn, providing an enabling environment for clients. Six incubators selected by SEDA were evaluated and assessed in a number of areas to determine their level of performance and determine the most suitable incubation models to achieve SEDA objectives.
 
 
10 YEAR PERFORMANCE REVIEW OF THE JOHANNESBURG DEVELOPMENT AGENCY (JDA, SOUTH AFRICA, 2011)
DNA was contracted to undertake a comprehensive review of all evidence of the Johannesburg Development Agency’s (JDA’s) outputs, outcomes and impact from existing reports and other supporting quantitative and qualitative information; and to report on progress made against the JDA’s strategic, developmental and delivery objectives.
 
 
NIDS EVALUATION (PSPPD, SOUTH AFRICA, 2009)
The National Income Dynamics Study (NIDS), the first national household panel study in South Africa, was launched in 2006. The first wave of this survey was undertaken by the Southern Africa Labour and Development Research Unit (SALDRU) at UCT, and the data was released to the public in July 2009. It was hoped that this data would serve as a resource for researchers, academics and policy makers. The main purpose of this review was to assess the performance of NIDS to date, and to recommend ways in which the study could be improved.
 
 
EVALUATION OF COMMARK TRUST (DFID, 2009)
Participated in the formal mid-term review of the DFID-funded Commark Trust.
 
 
EVALUATION OF THE UNTYING OF AID (DIIS/OECD, 2009)
Assessment of the status and impact of the untying of official development assistance (ODA) across seven donor projects in South Africa and Zambia as part of a larger international review of the Paris Declaration commissioned by the OECD DAC.
 
 
REVIEW OF THE PROGRAMME OF ACTION SYSTEM (THE PRESIDENCY, 2009)
An assessment of the current programme of action to inform the development of a new tool for political accountability that will allow Cabinet to monitor progress of key programmes within National Government
 
 
SADRN PROJECTS ASSESSMENT (TIPS, SOUTH AFRICA, 2008)
DNA was requested, by TIPS, to provide a quick and independent assessment of the 15 proposals received in response to the call for host institutions for the SADRN (Southern African Development Research Network) thematic working groups (TMGs). DNA developed an assessment framework, evaluated the 15 project proposals, and recommended four applications for further consideration.
 
 
DEPARTMENT OF PLANNING, MONITORING AND EVALUATION, SOUTH AFRICA, 2016
A review of the regulatory environment of Non-Profit Organisations for the NPO Directorate in the National Department of Social Development. The methodology used combined evaluation and regulatory impact assessment techniques, and included primary research among NPOs. The impact of a complex, multi-jurisdictional regulatory environment was unpacked and regulatory recommendations were made.