October 22, 2002
Draft Work Program for Fiscal Year 2003–04: Some Options
Discussion Paper for Comments
Full text in PDF Format (229Kb)
1. The work program of the IEO in its first full year of operation FY 2002-03 consisted of three projects chosen from a list of 15 identified as possible evaluation projects which would be undertaken over a three-year period. The first IEO evaluation on Prolonged Use of IMF Resources has been completed and is available on the IEO website along with a summary of the Executive Board discussion. The other two studies on The Role of the IMF in Capital Account Crises: Korea, Indonesia and Brazil and on Fiscal Adjustment in IMF-Supported Programs are scheduled to be completed by the end of April 2003.
2. The 12 remaining items from the original list of 15 are reproduced in Appendix I.1 This note presents a short list of items drawn from the list in Appendix I from which the work program for FY 2003-04 could be chosen.
3. All the subjects listed in Appendix I are potentially highly relevant but as the IEO budget is currently calibrated around undertaking 3 or 4 projects per year some choice is unavoidable. Based on internal discussions and some preliminary consultations, the following short list of 5 items is proposed as a first step in the consultative process for determining the work program for FY 2003-04.
a) The PRSP/PRGF experience based on full PRSPs.
b) Country case study of Argentina or Turkey programs.
c) The role of the IMF in providing Technical Assistance.
d) The IMF's surveillance function.
4. The issues involved in each of the five studies listed above are outlined briefly in this note. Comments are invited from all interested parties on which subjects should be included in the work program and also on specific aspects of these subjects which may not be adequately covered in the note.
Evaluation of the PRSP/PRGF experience
5. Through the creation, in 1999, of the PRGF, the IMF shareholders have given it a responsibility to help low-income countries to deal with structural balance of payments problems in a manner which encourages pro-poor growth based on Poverty Reduction Strategy Papers (PRSPs) which emerge from a consultative and participatory process. This is intended to ensure a country driven agenda of reforms. The PRSP is also expected to provide a mechanism for effective collaboration with the World Bank, which has primary responsibility for many of the structural reform areas, and for coordination with other donors.
6. The initial experience based on 19 "Interim-PRSPs" and associated PRGF arrangements between 1999 and 2001 showed only tentative improvements over the earlier ESAF programs, but this could be because the early PRGFs were based on Interim PRSPs. Since then, about 18 countries have completed full PRSPs and 15 are engaged in PRGF arrangements based on these PRSPs. Since PRSPs involve both the IMF and the World Bank it is proposed that aspects of the evaluation related to the PRSPs be undertaken in parallel with the World Bank's Operations Evaluation Department (OED). However, the IEO and the OED would each produce their own evaluation report, to be submitted to their respective Boards.
7. The evaluation would seek to present an overview of experience in all countries which have completed PRSPs based on cross country data combined with a detailed evaluation of between six to eight case studies. Since the evaluation will be undertaken in the course of calendar year 2003, it is too early to evaluate performance against long-term objectives such as the Millennium Development Goals, but the available information on the first two and in some cases three years under PRGF-supported arrangements will provide useful insights on many important aspects.2
Some of the questions which will be addressed are:
In addressing these questions, the evaluation would seek to look beyond process issues and to assess the substantive policy changes brought about by these initiatives. It will also assess performance in the two or three years on which data will be available.
8. In announcing the work program for FY 2002-03, it was indicated that the PRGF/PRSP study would be undertaken in FY 2003-04 and feedback received since then has reinforced this view. IEO has therefore commenced preliminary work on the issues paper for this study. The PRGF/PRSP evaluation would be a large project, involving considerably more resources than an "average"-sized project. If this project is included in the final list as is very likely, the total number of projects may have to be restricted to three.
Case study of Argentina or Turkey
9. It has been argued that the IEO should routinely do ex post evaluations of all large programs. Argentina and Turkey represent recent cases of large program support and could be considered as individual case studies. The results of the evaluation would build further on the findings of the ongoing study of capital account crises in Korea, Indonesia and Brazil.
10. The crisis in Argentina with the collapse of the currency board arrangement has raised a number of questions about the effectiveness of IMF crisis prevention and the quality and impact of its policy advice. This is especially so since Argentina was continuously engaged in IMF-supported programs for most of the period since the adoption of the Convertibility Law in 1991 and was often presented as a success story.
11. The evaluation would focus on the IMF's involvement with Argentina from 1991 until the recent crisis and would seek to address two sets of questions:
(i) Did the IMF provide adequate and effective policy advice? Issues to be looked at under this heading would include the quality, timeliness and impact of the IMF's policy advice on the currency board and possible "exit" strategies, on fiscal policy and debt sustainability, and on structural policies required for the successful operation of the currency board arrangement. Reasons for nonimplementation of IMF policy advice would also be examined.
(ii) Was it appropriate for the IMF to remain continuously engaged in Argentina with lending arrangements over that period? Issues to investigate would include program design adequacy, possible moral hazard effects of continued IMF involvement on both the authorities and financial market participants, the modalities of the internal decision making process at key stages of Argentina's programs--including possible defensive lending considerations and internal governance issues--and private sector involvement.
12. The primary focus of the evaluation would be on drawing lessons from this experience that would contribute to improve the effectiveness of IMF lending and surveillance activities in future.
13. Turkey experienced severe financial instability in the past few years leading to a request for a stand-by arrangement at the end of 1999. The original intention was to protect the exchange rate which had come under pressure and was viewed as an essential nominal anchor. This effort proved unsustainable and was abandoned in February 2001 when the lira was floated. The amount of the stand-by arrangement was increased substantially to SDR 15 billion in several rounds between December 2000 and May 2001. This arrangement was cancelled in February 2002 with SDR 11.7 billion drawn and a new SBA adopted for SDR 12.8 billion expiring in December 2004.
14. An evaluation of the IMF's experience in Turkey would provide useful lessons on the effectiveness of Fund surveillance in the pre-crisis period and the reasons for several strategic changes in the program including especially the switch from defending the exchange rate initially followed by floating. The study would address a number of questions. What are the lessons on how to stabilize an inflationary economy where important structural factors impair progress on the fiscal side and remain a major source of overall financial vulnerability? What is the critical progress needed in the quasi fiscal area (state enterprise reform, extrabudgetary funds, etc.) and the banking sector prior to embarking on an exchange rate based anti-inflationary program? How can a program expect to quickly change market expectations and real interest rates in situations where the latter constitute a major burden on public finances?
15. In view of the constraints on the total number of projects that can be undertaken by the IEO in FY 2003-04 the Argentina and Turkey case studies might be considered as alternatives. Since the current SBA approved in February 2002 will expire in December 2004 it may be more appropriate to take up the Turkey study in FY 2004-05 as the evaluation could cover the entire period 1999-2004.
Technical assistance by the IMF
16. Technical assistance (TA) is regarded as critical for capacity building and fostering ownership, which are viewed as increasingly important in both surveillance and program contexts. TA is potentially extremely important in low-income countries, which often suffer from severe capacity constraints that limit the effectiveness of policy formulation and implementation. It is also important in other member countries especially where the growing concern with financial sector stability points to many new areas where TA could help to strengthen the financial system and thus help crisis prevention.
17. A review of the IMF's TA activities was undertaken by an internal evaluation group in 1999 and a number of shortcomings were identified, including uneven effectiveness, in part owing to weak follow up by the Fund and the lack of satisfactory internal evaluation and reporting procedures, and an insufficient complementarity between surveillance and TA activities. Several initiatives were taken to address these shortcomings including the establishment of a centralized Office of TA Management, the adoption of a policy framework to ensure that TA supply is suitably prioritized, and the opening of regional TA centers in the Caribbean and in Africa. In the past few years new areas of TA have emerged, including especially in the financial sector, where an evaluation of what has been done would be useful before expanding the scale of the effort.
18. TA raises somewhat different questions in low-income and in middle-income countries. The focus of the evaluation and the choice of case studies would take account of the coverage provided by other projects retained in the final work program
19. Some of the questions which the study could address are:
20. Surveillance is a core activity of the IMF and consists of bilateral surveillance conducted primarily in the context of Article IV consultations and multilateral surveillance on the world economy. The quality of the IMF's bilateral surveillance of some borrowing countries has already been reviewed as part of the evaluation of Prolonged Use of IMF Resources and will be extensively studied as part of future IEO studies of specific IMF-supported programs (including the ongoing evaluation of capital account crisis cases). This evaluation would thus focus on bilateral surveillance of industrialized countries and multilateral surveillance, which are closely connected. Effective surveillance of industrialized country policies combined with strong multilateral surveillance is key to enable the IMF to make valuable inputs in the process by which the international community achieves a shared perception on the state of the world economy.
21. The IMF's surveillance activity was reviewed by an external evaluation panel in 1999 and more recently in the summer of 2002 in the context of the biennial internal review of surveillance, which led to a clarification of surveillance guidelines. A review in FY 2003-04 would therefore be an appropriate vehicle to examine the extent to which problems identified by the external review panel and those identified subsequently have been addressed. The study would address the following issues:
The IMF's approach to capital account liberalization
22. The IMF has been widely criticized for pushing capital account liberalization in developing countries in situations where the financial sector in those countries was not sufficiently sophisticated to avoid the build up of vulnerabilities associated with short-term capital flows. In this respect, critics argue that the IMF not only failed to prevent crises but may even have contributed to their emergence in the first place. In response to these criticism the IMF has often said that whatever may have been the approach prior to 1997, the IMF's approach to capital account liberalization has been much more nuanced subsequently. Specifically, it is argued that there is no effort to push countries to liberalize the capital account prematurely and there is clear recognition of the importance of sequencing and establishing the pre-conditions for successful liberalization of the capital account.
23. The evaluation could examine IMF-supported programs and surveillance activity from 1998 onwards in order to determine what are the characteristics of the current approach. Specific questions to be addressed could include the following:
* * * * *
Comments on the proposals in this note are invited by November 20. Based on comments received and ongoing consultations being undertaken by the IEO, the work program for FY 2003-04 will be finalized by early December and subsequently submitted to the Executive Board for review as required under the IEO Terms of Reference. Comments may include suggestions for covering topics other than those discussed above.
Items Previously Identified for Work Program
1The original three work programs are available on the IEO website.
2The timeframe of the operations reviewed will need to take account of the IEO's Terms of Reference which require it to refrain from interfering with ongoing operations.
3The 1999 External Evaluation of IMF Surveillance identified an inadequate cross-fertilization between multilateral and bilateral surveillance as a problem and made a number of recommendations for improvements. The study could also assess the impact of these recommendations.