(BNP Paribas Team)
Economic forecasting in the run-up to and during recessions is particularly challenging. An analysis of the Federal Reserve of Philadelphia’s survey of professional forecasters shows that, since 1968, forecast errors during recessions are significantly higher than during non-recession periods.
Moreover, forecast errors during recessions are predominantly positive, so forecasts tend to be too optimistic, even if they concern the next quarter. At the current juncture, there is broad consensus, if not unanimity, that downside risks to growth dominate due to the multiple headwinds and uncertainties. The historical forecast record is another reason to be mindful of these risks.
A recession is a period of high uncertainty: how much will demand, activity, employment, and corporate profits decline? How long will it last? For economic forecasters, it is a stressful period: the pressure to produce good forecasts rises proportionally to the difficulty of doing so because, during a recession, the economy is in a state of flux. The relationships between the components of final demand -consumption, capital formation, exports- and their drivers become less predictable due to confidence effects, financial constraints, non-linearities, etc.
In 2018, a working paper by the IMF concluded that “while forecasts in recession years are revised each month, they do not capture the onset of recessions in a timely way and the extent of output decline during recessions is missed by a wide margin.” This result held for private as well as public sector forecasts.
Capturing the onset of a recession is particularly difficult: when will the tipping point be reached whereby an economy reacts to recent shocks in such a way that it corresponds to a recession? The IMF paper gives a sobering conclusion for advanced and emerging economies, but what about forecasts for the US specifically? The question is important given the weight of the US in the world.
Chart 1 shows the forecast errors of the Survey of Professional Forecasters (SPF) conducted by the Federal Reserve Bank of Philadelphia.23 The forecasts concern those made in the current quarter for the next quarter (henceforth labeled as Q-1).
At first glance, it seems that recessions tend to be marked by large positive forecast errors, which implies that the depth of the recessions was underestimated. To analyze this in detail, chart 2 distinguishes between a recession and non-recession periods and shows the results for various forecast horizons. The metric that is used is the root mean squared error (RMSE). One would expect an improvement of the forecast quality -a decline in the RMSE- when the forecast horizon shortens.
This is indeed the case during recession periods, but outside these, the RMSE is stable across the different forecast horizons. The forecast errors for periods when the US was in a recession are also considerably higher compared to non-recession periods. For longer forecast horizons -four or three quarters ahead-, this could reflect that recessions come as a surprise. For shorter horizons, including quarters when the economy was already in recession when the forecasts were made, it could be the result of new shocks and hard-to-anticipate dynamics during the recession. Another interpretation is that it is extremely difficult to anticipate the contraction of GDP during recessions.
Finally, as shown by the table, forecasts covering periods when the US was in recession, are too optimistic by a wide margin: this is the case for 70% of the forecasts for the next quarter and the number increases to 89% for the four quarters ahead forecast. At the current juncture, there is broad consensus, if not unanimity, amongst forecasters that downside risks to growth dominate due to the multiple headwinds and uncertainties. The historical forecast record also underpins this distribution of risks.