Winner of the New Statesman SPERI Prize in Political Economy 2016


Showing posts with label five tests. Show all posts
Showing posts with label five tests. Show all posts

Friday, 16 September 2016

Economics, DSGE and Reality: a personal story

As I do not win prizes very often, I thought I would use the occasion of this one to write something much more personal than I normally allow myself. But this mini autobiography has a theme involving something quite topical: the relationship between academic macroeconomics and reality, and in particular the debate over DSGE modelling and the lack of economics in current policymaking. [1]

I first learnt economics at Cambridge, a department which at that time was hopelessly split between different factions or ‘schools of thought’. I thought if this is what being an academic is all about I want nothing to do with it, and instead of doing a PhD went to work at the UK Treasury. The one useful thing about economics that Cambridge taught me (with some help from tutorials with Mervyn King) was that mainstream economics contained too much wisdom to be dismissed as fundamentally flawed, but also (with the help of John Eatwell) that economics of all kinds could easily be bent by ideology.

My idea that by working at the Treasury I could avoid clashes between different schools of thought was of course naive. Although the institution I joined had a well developed and empirically orientated Keynesian framework [2], it immediately came under attack from monetarists, and once again we had different schools using different models and talking past each other. I needed more knowledge to understand competing claims, and the Treasury kindly paid for me to do a masters at Birkbeck, with the only condition being that I subsequently return to the Treasury for at least 2 years. Birkbeck at the time was also a very diverse department (incl John Muellbauer, Richard Portes, Ron Smith, Ben Fine and Laurence Harris), but unlike Cambridge a faculty where the dedication to teaching trumped factional warfare.

I returned to the Treasury, which while I was away saw the election of Margaret Thatcher and its (correct) advice about the impact of monetarism completely rejected. I was, largely by accident, immediately thrust into controversy: first by being given the job of preparing a published paper evaluating the empirical evidence for monetarism, and then by internally evaluating the economic effects of the 1981 budget. (I talk about each here and here.) I left for a job at NIESR exactly two years after I returned from Birkbeck. It was partly that experience that informed this post about giving advice: when your advice is simply ignored, there is no point giving it.

NIESR was like a halfway house between academia and the Treasury: research, but with forecasting rather than teaching. I became very involved in building structural econometric models and doing empirical research to back them up. I built the first version of what is now called NIGEM (a world model widely used by policy making and financial institutions), and with Stephen Hall incorporated rational expectations and other New Classical elements into their domestic model.

At its best, NIESR was an interface between academic macro and policy. It worked very well just before 1990, where with colleagues I showed that entering the ERM at an overvalued exchange rate would lead to a UK recession. A well respected Financial Times journalist responded that we had won the intellectual argument, but he was still going with his heart that we should enter at 2.95 DM/£. The Conservative government did likewise, and the recession of 1992 inevitably followed.

This was the first public occasion where academic research that I had organised could have made a big difference to UK policy and people’s lives, but like previous occasions it did not do so because others were using simplistic and perhaps politically motivated reasoning. It was also the first occasion that I saw close up academics who had not done similar research but who had influence use that influence to support simplistic reasoning. It is difficult to understate the impact that had on me: being centrally involved in a policy debate, losing that debate for partly political reasons, and subsequently seeing your analysis vindicated but at the cost of people becoming unemployed.

My time at NIESR convinced me that I would find teaching more fulfilling than forecasting, so I moved to academia. The publications I had produced at NIESR were sufficient to allow me to become a professor. I went to Strathclyde University at Glasgow partly because they agreed to give temporary funding to two colleagues at NIESR to come with me so we could bid to build a new UK model. [3] At the time the UK’s social science research funding body, the ESRC, allocated a significant proportion of its funds to support econometric macromodels, subject to competitions every 4 years. It also funded a Bureau at Warwick university that analysed and compared the main UK models. This Bureau at its best allowed a strong link between academia and policy debate.

Our bid was successful, and in the model called COMPACT I would argue we built the first UK large scale structural econometric model which was New Keynesian but which also incorporated innovative features like an influence of (exogenous) financial conditions on intertemporal consumption decisions. [4] We deliberately avoided forecasting, but I was very pleased to work with the IPPR in providing model based economic analysis in regular articles in their new journal, many written with Rebecca Driver.

Our efforts impressed the academics on the ESRC board that allocated funds, and we won another 4 years funding, and both projects were subsequently rated outstanding by academic assessors. But the writing was on the wall for this kind of modelling in the UK, because it did not fit the ‘it has to be DSGE’ edict from the US. A third round of funding, which wanted to add more influences from the financial sector into the model using ideas based on work by Stiglitz and Greenwald, was rejected because our approach was ‘old fashioned’ i.e not DSGE. (The irony given events some 20 years later is immense, and helped inform this paper.)

As my modelling work had always been heavily theory based, I had no problem moving with the tide, and now at Exeter university with Campbell Leith we began a very successful stream of work looking at monetary and fiscal policy interactions using DSGE models. [5] We obtained a series of ESRC grants for this work, again all subsequently rated as outstanding. Having to ensure everything was microfounded I think created more heat than light, but I learnt a great deal from this work which would prove invaluable over the last decade.

The work on exchange rates got revitalised with Gordon Brown’s 5 tests for Euro entry, and although the exchange rate with the Euro was around 1.6 at the time, the work I submitted to the Treasury implied an equilibrium rate closer to 1.4. When the work was eventually published it had fallen to around 1.4, and stayed there for some years. Yet as I note here, that work again used an ’old fashioned’ (non DSGE) framework, so it was of no interest to journals, and I never had time to translate it (something Obstfeld and Rogoff subsequently did, but ignoring all that had gone before). I also advised the Bank of England on building its ‘crossover’ DSGE/econometric model (described here).

Although my main work in the 2000s was on monetary and fiscal policy, the DSGE framework meant I had no need to follow evolving macro data, in contrast to the earlier modelling work. With Campbell and Tatiana I did use that work to help argue for an independent fiscal council in the UK, a cause I first argued for in 1996. This time Conservative policymakers were listening, and our paper helped make the case for the OBR.

My work on monetary and fiscal interaction also became highly relevant after the financial crisis when interest rates hit their lower bound. In what I hope by now is a familiar story, governments from around the world first went with what macroeconomic theory and evidence would prescribe, and then in 2010 dramatically went the opposite way. The latter event was undoubtedly the underlying motivation for me starting to write this blog (coupled with the difficulty I had getting anything I wrote published in the Financial Times or Guardian).

When I was asked to write an academic article on the fiscal policy record of the Labour government, I discovered not just that the Coalition government’s constant refrain was simply wrong, but also that the Labour opposition seemed uninterested in what I found. Given what I found only validated what was obvious from key data series, I began to ask why no one in the media appeared to have done this, or was interested (beyond making fun) in what I had found. Once I started looking at what and how the media reported, I realised this was just one of many areas where basic economic analysis was just being ignored, which led to my inventing the term mediamacro.

You can see from all this why I have a love/hate relationship to microfoundations and DSGE. It does produce insights, and also ended the school of thought mentality within mainstream macro, but more traditional forms of macromodelling also had virtues that were lost with DSGE. Which is why those who believe microfounded modelling is a dead end are wrong: it is an essential part of macro but just should not be all academic macro. What I think this criticism can do is two things: revitalise non-microfounded analysis, and also stop editors taking what I have called ‘microfoundations purists’ too seriously.

As for macroeconomic advice and policy, you can see that austerity is not the first time good advice has been ignored at considerable cost. And for the few that sometimes tell me I should ‘stick with the economics’, you can see why given my experience I find that rather difficult to do. It is a bit like asking a chef to ignore how bad the service is in his restaurant, and just stick with the cooking. [6]

[1] This exercise in introspection is also prompted by having just returned from a conference in Cambridge, where I first studied economics. I must also admit that the Wikipedia page on me is terrible, and I have never felt it kosher to edit it myself, so this is a more informative alternative.

[2] Old, not new Keynesian, and still attached to incomes policies. And with a phobia about floating rates that could easily become ‘the end is nigh’ stuff (hence 1976 IMF).

[3] I hope neither regret their brave decision: Julia Darby is now a professor at Strathclyde and John Ireland is a deputy director in the Scottish Government.

[4] Consumption was of the Blanchard Yaari type, which allowed feedback from wealth to consumption. It was not all microfounded and therefore internally consistent, but it did attempt to track individual data series.

[5] The work continued when Campbell went to Glasgow, but I also began working with Tatiana Kirsanova at Exeter. I kept COMPACT going enough to be able to contribute to this article looking at flu pandemics, but even there one referee argued that the analysis did not use a ‘proper’ (i.e DSGE) model.

[6] At which point I show my true macro credentials in choosing analogies based on restaurants.  

Thursday, 24 March 2016

Is evidence based policy left wing?

The answer in principle is of course not. In practice, not so clear. This is something I talked about back in October 2013, and there are no signs that things are getting better. Alex Marsh makes the same point in the context of the latest budget. This antagonism to ‘unhelpful’ evidence is out there in plain sight for all to see in the UK government’s current attempt to deny academics in receipt of public funding the ability to talk about the policy implications of their work. I talked about this in terms of the misuse of the term ‘public money’ a few weeks ago, but it is also a pretty direct attempt to suppress unhelpful advice. (Note that ministers have the power under this proposed legislation to revoke this ban in individual cases, presumably when evidence is ‘helpful’ - to them.)

Of course we are not talking about a hostility to evidence based policy by everyone on the right on all occasions. In a THE article by Ben Goldacre, where he also highlights the dangers of the government’s proposed legislation, he details the extent to which he is talking to ministers about evidence based policy. But that interest does not seem to extend to big macro decisions. I was reminded in reading this about what I regard as a triumph of evidence based policy making in my own area: the UK Treasury analysis of Euro entry in 2003. (Disclaimer: my little contribution is the fourth one down in the picture of the reports.) Why didn’t this government do something similar for both the Scottish referendum and the EU referendum?

Everytime I mention the 2003 exercise someone responds that it was just a smokescreen for a power play between Brown and Blair. I think this is an overly cynical view, a view that evidence never changes anyone’s mind. Ramsden’s own view is that the civil service, using the evidence, “ultimately persuaded both the Chancellor and in particular the Prime Minister that it wasn't right to join." It was also the right decision. With both recent referendums we have seen proponents of change putting out documents suggesting that change will not be economically damaging, when most evidence shows pretty clearly that it will be. With the EU referendum in particular, would it not have been better if the government had asked the Treasury to do a similar exercise to 2003, using outside experts where appropriate to provide or validate the technical analysis?

Ben Goldacre’s piece reminded me of my own recent place on John McDonnell’s Economic Advisory Council (EAC). From Ben’s tweets I knew that he was not the greatest fan of this government, and in particular their current treatment of junior doctors, so I asked him whether he had received any negative comments from doctors or others about him giving advice to the government. I was not surprised to hear he had not. Who could object to him taking the opportunity to argue for better use of data and trials in medicine and elsewhere with people who just might do something about it?

It is a shame that some people did not take the same view when I agreed to be on the EAC. I would lose credibility as a macroeconomist, I was told. When McDonnell did his U-turn about supporting the fiscal charter, some suggested this reflected badly on me, even though he had turned in the direction I thought was correct! One charge in particular was levelled at the time. We were being used to make the leadership look respectable, but our advice would in practice be ignored. A couple of weeks ago Labour adopted a fiscal rule which is based on my own work with Jonathan Portes, and in particular by a presentation I made to the group. Mariana Mazzucato’s own work has also featured strongly in Labour party speeches, with good reason.

At the end of the day, policy makers need to look at evidence. If they do not we need strong mechanisms that allow them to be confronted by this evidence. Policy makers that make space for evidence and take decisions based on it need to be congratulated for this, rather than being told their efforts were just a smokescreen. They should be congratulated because letting evidence in often involves a risk: not just to the policy maker’s priors or preferences but also for scrutiny of past actions. Equally we should regard policymakers who knowingly ignore evidence with great suspicion, and those that try to deliberately keep evidence out of the public domain should be condemned.




Friday, 5 July 2013

How knowledge transmission should work

The tenth anniversary of the UK’s 2003 decision not to join the Eurozone has just passed. With all my complaints about how bad macroeconomic policymaking has been recently, I thought it was worth analysing an example of a good decision. Good not just because it was the right decision given the events of the last few years, but good also because of how it was done, and the way academic knowledge was used.

If you want detail on the background and process itself, I recommend viewing or reading a recent lecture by Dave Ramsden, who was the civil servant who masterminded the process. Here is just a short summary. The UK opted out of being one of the founding members of the Eurozone, but the possibility of us joining shortly afterwards was always taken seriously. The Chancellor Gordon Brown announced 5 tests that would need to be passed if this were to happen, and the Treasury spent a couple of years doing extensive work on these five tests. It eventually published 18 studies, which I recommend to any students who want to take a serious interest in Optimal Currency Area (OCA) theory. Although there is some original work there (of which more later), they were mainly very good summaries of the relevant academic literature, and various academics were consulted to help ensure this was the case.

I should declare an interest here. I wrote one of those studies, which tried to assess what exchange rate the UK should join at, if the decision was yes. However I do not think this has any influence on what I have to say below, because in an important sense my study was secondary to the question of whether we should join. [1] In contrast, much more critical was modelling work done by Peter Westaway, at the time a Bank of England economist who had previously built the Bank’s core macromodel.

Now some will argue that these 18 studies, and the years of work that went into them, were window dressing for a decision that had already been made. I think that is simply incorrect. Some of the reasons I think that are described by Dave Ramsden: if the politicians involved had already made up their mind, they went to quite elaborate lengths to conceal the fact from those that worked for them. (Compare this to the Iraq war, for example, where a dodgy dossier sufficed.) Furthermore, the studies themselves contain some very strong arguments (probably too strong) why joining the Eurozone could be very beneficial, which is not the kind of thing you do if you want the analysis to back up a foregone conclusion.

As a result, I think the exercise was what it purported to be: an attempt by civil servants to give the best advice they could to politicians. What marks it out for me was the extent to which those civil servants involved academics, and placed academic work at the centre of their analysis. The merits or otherwise of the Euro did divide macroeconomists, but there was no attempt to just consult those who agreed with some predefined view. (See, for example, the space given to Andrew Rose’s empirical work of the benefits of OCAs.)

So why was this process close to what I consider an ideal of how academic knowledge should be used, when I have just written a post which is far more pessimistic about how these things are generally done? I should think about this some more, but here are three ideas. The first is that the decision, although it generated strong opinions on either side, was not fundamentally ideological. There was no existing political apparatus that was clearly aligned with potential winners and losers. The second is that you had a Chancellor who had a very strong respect for economic ideas, whatever else you may think of him as a politician. Third, the Chancellor had to convince the Prime Minister Tony Blair, and so whatever decision he came to needed to be backed up as strongly as possible.

Most people would now agree that the 2003 decision (only one the five tests were passed) was the correct one. [2] While the analysis, and particularly the work by Westaway, contained some of the elements that came to the fore in the Eurozone crisis, I think Ramsden in his 10 year retrospective is clear that the 18 studies also failed to foresee other elements of the crisis, perhaps not surprisingly as most macroeconomists missed these too. Yet the deeper point is this. The decision was based on the best analysis that macroeconomics at the time could provide. It is a shame that this way of making economic decisions now looks like the exception rather than the rule.  


[1] If anyone ever asks whether I can keep a secret, I always give this as evidence that I can. The original work I did for the study was done and written up in 2002. At the time the Euro/Sterling rate was at or near 1.6 E/£, and my analysis suggested something closer to £1.4 E/£ was sustainable. So for nearly a year I sat on information that was extremely market sensitive, and I received plenty of phone calls trying to extract any hint at what my analysis would be, and I’m glad to say no one got anything out of those calls. Alas I also felt it would be improper for me to bet on my own analysis, which had been funded by the Treasury - perhaps that just makes me an honest fool. (The morning my study was published - by which time the rate had fallen to much nearer my numbers, naturally - it did move the market by about one percent, but that is another story.)


[2] Will Hutton disagrees. In his counterfactual where we joined, the UK not only does better before the crisis because sterling stays at a competitive rate, but also the UK’s benign influence provides a counterweight to Germany. This alternative history deserves a proper analysis which I do not have space for here, but my initial take is that it involves a lot of wishful thinking.