Winner of the New Statesman SPERI Prize in Political Economy 2016


Showing posts with label Compass. Show all posts
Showing posts with label Compass. Show all posts

Wednesday, 29 May 2013

Data, Theory and Central Bank Models

As the Bank of England finally publishes [1] its new core model COMPASS, I have been thinking more about what the central bank’s core model should look like. (This post from Noah Smith I think reacts indirectly to the same event.) Here I will not talk in terms of the specification of individual equations, but the methodology on which the model is based.

In 2003, Adrian Pagan produced a report on modelling and forecasting at the Bank of England. It included the following diagram.



One interpretation is that the Bank has a fixed amount of resources available, and so this curve is a production possibility frontier. Although Pagan did not do so, we could also think of policymakers as having conventional preferences over these two goods: some balance between on the one hand knowing a forecast or policy is based on historical evidence and on the other that it makes sense in terms of how we think people behave.

I think there are two groups of macroeconomists who will feel that this diagram is nonsense. The first I might call idealists. They will argue that in any normal science data and theory go together – there is no trade-off. The second group, which is I will call purists, will recognise two points on this curve (DSGE and VARs), but deny that there is anything in between. I suspect most macroeconomists under 40 will fall into this group.

The purists cannot deny that it is possible to construct hybrid models that are an eclectic mix of some more informal theory and rather more estimation that DSGE models involve, but they will deny that they make any sense as models. They will argue that a model is either theoretically coherent or it is not – we cannot have degrees of theoretical coherence. In terms of theory, there are either DSGE models, or (almost certainly) incorrect models.

At the time Pagan wrote his report, the Bank had a hybrid model of sorts, but it was in the process of constructing BEQM, which was a combination of a DSGE core and a much more data based periphery. (I had a small role in the construction of both BEQM and its predecessor: I describe the structure of BEQM here.) It has now moved to COMPASS, which is a much more straightforward DSGE construct. However judgements can be imposed on COMPASS, reflecting a vast range of other information in the Bank’s suite of models, as well as inputs from more informal reasoning.

The existence of a suite of models that can help fashion judgements imposed on COMPASS may guard against large errors, but the type of model used as the core means of producing forecasts and policy advice remains significant. Unlike the idealists I recognise that there is a choice between data and theory coherence in social science, and unlike the purists I believe hybrid models are a valid alternative to DSGE models and VARs. So I think there is an optimum point on this frontier, and my guess is that DSGE models are not it. The basic reason I believe this reflects the need policymakers have to adjust reasonably quickly to new data and ideas, and I have argued this case in a previous post

Yet I suspect it will take a long time before central banks recognise this, because most macroeconomists are taught that such hybrid models are simply wrong. If you are one of those economists, probably the best way I can persuade you that this position is misguided is to read this paper from Chris Carroll. [2] It discusses Friedman’s account of the permanent income hypothesis (PIH). For many years graduate students have been taught that while PIH was a precursor to the intertemporal model that forms the basis of modern macro, Freidman’s suggestion that the marginal propensity to consume out of transitory income might be around a third, and that permanent income was more dependent on near future expectations than simple discounting would suggest, were unfortunate reflections of the fact that he didn’t do the optimisation problem formally.

Instead, Carroll suggests that the PIH may be reasonable approximation to how an optimising consumer might behave as they anticipate the inevitable credit constraints that come with old age. There is also a lot of empirical evidence that consumers do indeed quickly consume something like a third of unexpected temporary income shocks. In other words Friedman’s mix of theoretical ideas and empirical evidence would have done rather better at forecasting consumption than anything microfounded that has supplanted it. If that can be true for consumption, it could be true for every other macroeconomic relationship, and therefore a complete macromodel.


[1] A short rant about the attitude of the Bank of England to the outside world. COMPASS has been used for almost two years, yet it has only just been published. I have complained about this before, so let me just say this. To some senior officials at the Bank, this kind of lag makes perfect sense: let’s make sure the model is fit for purpose before exposing it to outside scrutiny. Although this may be optimal in terms of avoiding Bank embarrassment and hassle, it is obviously not optimal in terms of social welfare. The more people who look at the model, the sooner any problems may be uncovered.  I am now rather in favour of delegation in macroeconomics, but delegation must be accompanied by the maximum possible openness and accountability.

[2] This recently published interview covers some related themes, and is also well worth reading (HT Tim Taylor).

Tuesday, 6 November 2012

Disengagement at the Bank of England?


The Bank of England has just published three reviews of aspects of its performance over the last few years. These reviews were controversial before they were published: Andrew Tyrie, chair of parliament’s Treasury Select Committee, says that “the Bank of England has yet to produce a comprehensive review of the Bank's role in, and response to, the crisis. The decision to commission these reviews fell well short of what was required."

One of the reviews, by Dave Stockton (former Director of Research and Statistics at the US Fed), looks at the MPC’s forecasting capability. I want to discuss just one small part of that review, which I think illustrates how macroeconomic discussion of policy has appeared to degenerate in the UK over the last twenty years. (There is a lot else of interest in the reviews: see here for example.) The Bank’s current forecasting model, a DSGE model, is called Compass. Stockton notes that (para 92): “Compass has now been in active use by the staff as input into the forecast for nearly a year.  However, interested parties outside the Bank have little to no understanding of the model and its key features.”

There is a very simple reason why those interested parties have little or no understanding. The Bank has not published any details of the model. In a speech by Spencer Dale in March, there is a footnote that says: “It is a DSGE model that explains the behaviour of 16 – a relatively small number – of macroeconomic variables in terms a set of underlying economic shocks.  In general, the structure of COMPASS is similar to models used in other central banks, although a few aspects have been tailored specifically to the UK economy.  Further details of COMPASS will be published in due course.” And that, as far as I can find out, is all anyone outside the Bank knows.

But is anyone too bothered by this lack of transparency? They used to be. Less than ten years ago, when the Bank published their previous model BEQM (which I have written about here), the model was launched at a one day conference which was attended – from my rather jet-lagged memory – by a large number of UK academics and macro analysts who showed great interest in the model, and who were rather frustrated at the lack of detail provided on that occasion. Going further back, there was continuous and active discussion of the properties of the main macromodels used in the UK mediated by the ESRC’s Macromodelling Bureau, which I have talked about here.

When monetary and fiscal policy was in the hands of the UK Treasury, the Treasury model was subject to detailed scrutiny. It was and still is available for outsiders to use (which a UK MP, Jeremy Bray, took full advantage of). Treasury macro analysis, including work on the model, was examined by their ‘Academic Panel’, which contained some of the leading UK macroeconomists at the time. Nothing like this exists at the Bank.

So what is behind this gradual disengagement of the tools of monetary policy from the UK academic community? Is it that, in the era of the Great Moderation, the issues became less controversial or interesting? Was the transition of monetary policy from the UK Treasury to a more insular Bank a factor? Did the transition from empirically based econometric models to DSGE analysis play a part? Whatever the reason, it does seem regrettable that the Bank has been using a model to produce its forecast for a whole year that no one knows anything about.