Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections

Author/Editor:

Klaus-Peter Hellwig

Publication Date:

December 7, 2018

Electronic Access:

Free Full Text. Use the free Adobe Acrobat Reader to view this PDF file

Disclaimer: IMF Working Papers describe research in progress by the author(s) and are published to elicit comments and to encourage debate. The views expressed in IMF Working Papers are those of the author(s) and do not necessarily represent the views of the IMF, its Executive Board, or IMF management.

Summary:

I regress real GDP growth rates on the IMF’s growth forecasts and find that IMF forecasts behave similarly to those generated by overfitted models, placing too much weight on observable predictors and underestimating the forces of mean reversion. I identify several such variables that explain forecasts well but are not predictors of actual growth. I show that, at long horizons, IMF forecasts are little better than a forecasting rule that uses no information other than the historical global sample average growth rate (i.e., a constant). Given the large noise component in forecasts, particularly at longer horizons, the paper calls into question the usefulness of judgment-based medium and long-run forecasts for policy analysis, including for debt sustainability assessments, and points to statistical methods to improve forecast accuracy by taking into account the risk of overfitting.

Series:

Working Paper No. 18/260

English

Publication Date:

December 7, 2018

ISBN/ISSN:

9781484386187/1018-5941

Stock No:

WPIEA2018260

Price:

$18.00 (Academic Rate:$18.00)

Format:

Paper

Pages:

43

Please address any questions about this title to publications@imf.org