Winner of the New Statesman SPERI Prize in Political Economy 2016


Showing posts with label CBR. Show all posts
Showing posts with label CBR. Show all posts

Saturday, 5 May 2018

How to spot fraudulent economic arguments: an example from Lexit


When I last talked about Lexit, I said Lexiter arguments had “many structural similarities to right wing arguments for Brexit.” In this post I want to go further and suggest ways you can spot when economic arguments are fraudulent, using an article by Thomas Fazi and William Mitchell advocating Lexit as an example. To show how generic the tactics are, I will demonstrate how exactly the same techniques were used by those who argued for austerity.

The first sign that the wool is being pulled over your eyes is wildly exaggerating your opponents case. It is so much easier to attack a straw man. This particular article talks about the “Left’s anti-Brexit hysteria” i.e anyone who disagrees with us is acting hysterically. They talk about those opposing Brexit predicting “Brexit Armageddon”. The tactic works particularly well if you can find an example of someone who did exaggerate their case, and focus on how their fears have not come to pass.

I am very familiar with this tactic from the UK in 2013. From 2010 to 2012 growth was very low, and the expected recovery from the Great Recession did not materialise. People like myself blamed austerity, and we were quite right to do so. But some in 2012 made the foolish claim that the economy will never start growing again unless austerity came to an end. So when growth returned to trend in 2013, proponents of austerity used those claims to announce the critics were wrong and austerity had been vindicated. The example that Lexiters and Brexiters alike use is of course the Treasury short term post Brexit forecast.

That forecast was not about the longer term impact of Brexit, but uncertainty about the prospect of Brexit. It overestimated the immediate impact of Brexit. But the real question is not whether forecasts were wrong, but whether the Brexit announcement and subsequent uncertainty has damaged the UK economy. The article says the economy is still growing, and quotes some other selected statistics, implying all is fine. They do not mention that we have gone from the top to the bottom of the international growth league. Of course they cannot avoid acknowledging that sterling fell sharply on announcement. However they say but this has not destroyed the British economy: another straw man (who ever seriously said the depreciation would destroy the economy?!), and no mention of what the depreciation did do, which is cut the real incomes of workers. The debate over whether Brexit uncertainty has harmed the economy is over, as no one seriously thinks it has not. 

A second sign of a fraudulent argument is to focus on a single study that supports what you want to say, and ignore all the rest. The Brexiters have Minford of course, but Lexit have the study by Coutts, Gudgin and Buchanan (CGB) published by the Centre for Business Research (CBR) at Cambridge. Those advocating austerity had two well known papers: one suggested there was empirical evidence that high government debt reduced growth, and the other that austerity was expansionary. In all these cases the studies are outliers, so you need some reason why the majority of academic work can be discredited.

This leads to a third tactic: tar academic work that goes against what you say with some broad assertions that have only a grain of truth. If your audience has a political bias, play to it. With austerity it was that those against austerity were old fashioned Keynesians who just wanted a larger state. (Some were, but most were just using a much more modern Keynesian framework and its macroeconomics implications.) The way this paper does the same with the many studies that have suggested Brexit will be harmful in the longer term is so laughable I have to quote it:
“The neoliberal biases built into these models include the assertion that markets are self-regulating and capable of delivering optimal outcomes so long as they are unhindered by government intervention; that “free trade” is unambiguously positive; that governments are financially constrained; that supply-side factors are much more important than demand-side ones; and that individuals base their decision on “rational expectations” about economic variables, among others. Many of the key assumptions used to construct these exercises bear no relation to reality.”

It will be news to most trade economists whose work is the basis of the long term case against Brexit that they are assuming things like governments being financially constrained and rational expectations. A key part of why Brexit is a bad idea is the gravity equation, which says trade is more likely to take place with neighbouring countries. It is a robust empirical relationship that makes no assumptions about governments or markets at all. [1] The article pours scorn on the ‘neoliberal’ idea that openness to trade is good for the economy, and again neglects to say that the relationship linking openness to productivity growth is also empirical, not theoretical.

Another tactic that if you see being employed you should start to worry is to impugn the motives of your opponents. That may be a common enough tactic in political discourse, but not if you are trying to make a serious economic argument. It is notable how academic economists who have criticised the Brexit work of Minford for example do not try and suggest he is ideologically motivated. Being good academics they instead question the model he uses (e.g. no gravity) and how he uses it. That is what should be done. But this article tries to discredit the current government’s analysis of the impact of Brexit by implying the results have been fiddled to produce large numbers for the long term costs of Brexit. They write:
“The models are notoriously unreliable and easily manipulated to achieve whatever outcome one desires. The British government has refused to release the technical aspects of their modeling, which suggests they do not want independent analysts examining their “black box” assumptions.”

Apparently the current UK government do not want us to see their workings because if we did we could see how they had fiddled results to make Brexit look bad. The attempt in this case is again laughable, because this government is pro-Brexit so any fiddling would go the other way.

All these four signs are easy to spot. The fifth is less obvious to the non-expert, which is to inconsistently use lots of broad brush statistics that do not get the heart of the issue, or which are problematic for other reasons. For example in arguing that Brexit has had as yet little impact on the economy they quote unemployment data, just as the government did from 2013 to argue that the economy was strong as a result of austerity. It is problematic because strong employment growth coupled with weak output growth means poor productivity. As I noted here, current productivity growth performance in the UK is worse than it has been for centuries.

In terms of broad brush statistics, they argue that GDP growth has been weaker rather than stronger than post-war trends as a result of EU membership, as if nothing else had been going on in all these years. The reality is that we joined the EU in part because our post-war growth and particularly productivity was worse than most other countries, and from the 1980s onwards it has if anything been better than other major countries. But why look at GDP rather than exports, where you would expect the impact of EU membership to be clearer. In fact the CGB study they quote from extensively does exactly this, and the following chart shows the results.


The benefits for UK exports of being in the single market are clear from this data. (To see how the CGB study erroneously avoids this conclusion, see here.)

There are of course plenty of Brexit specific points as well (the article does not even mention the Irish border), but this post is long enough already. I wrote it because it struck me when reading the Fazi and Mitchell article how similar its rhetorical devices were to those of many who tried to sell austerity. So if you read anything that wildly exaggerates the opposing position, focuses on a single academic study and ignores the rest, particularly if it suggests that there is some generic problem with these other studies which may include the motives of those who did them, and if it uses broad brush statistics when it could have used data that was more relevant, beware that you may be reading a piece of political persuasion rather than serious analysis.

[1] The confusion is compounded when they quote Paul Romer’s criticism of macroeconomics, and then drop the macro bit to pretend that Romer was talking about the whole of economics.

Sunday, 19 March 2017

A response to Gudgin, Coutts & Gibson

The authors have a post on the Prime website in which they, among other things, respond to two blog posts of mine where I mention their work on Brexit. In the first post they mention [1], I use a graph from their paper to illustrate how important the Single Market was for UK exports. Here is the graph.


I then wrote

“But didn’t the CBR report say that the benefits of the Single Market had been exaggerated by the Treasury? Yes it did. Here is some of its reasoning. That growth in UK export share after the Single Market is not as impressive as it looks, because there is an underlying 6% positive trend in the share, which you can detect before we joined the EU. That looks pretty on a picture, until you realise it is nonsense. A 6% trend rise in an export share will imply that at some point not too far away UK exports to the EU will be as high as total EU GDP. UK exporters are just not that much better than exporters in other countries. There is no underlying trend rise in the UK’s export share.”

By export share, it is obvious that I’m talking about share in destination GDP, as in the chart. In my paragraph there is an error. I used a 6% figure rather than the correct 3.5% figure for their trend in export penetration relative to the non-EU penetration. It was a particularly stupid error, because just below Chart 7 is Chart 8, which contains the correct figure.


But, as the authors must know, this error is not important to my argument. Replace 6 by 3.5 in the relevant paragraph and it still makes perfect sense. What I was criticising was the notion that there was any substantial underlying trend in export penetration, and that the impact of EU membership should be judged relative to that trend. You can see from this chart how ludicrous a 3.5% trend is: it implies that without EU membership the UK exports share would be now above 10% and rising fast. This trend seems to be an important part of their judgement that UK export penetration relative to the EU would fall by substantially less than the Treasury assume in their analysis. The trend makes no sense, unless the aim is to make the impact of EU membership look small.

So what is the authors’ response to my basic criticism in their Prime piece? There is none.

As far a the 6 rather than 3.5 is concerned, it is also odd is that this is the first time they have mentioned the error to me. The post was from mid-January, and I would have happily changed 6 to 3.5 if they had pointed it out to me earlier.

The second post was a discussion of the notion of ‘fake economics’. I said fake economics could be described as “economic analysis or research that is obviously flawed but whose purpose is to support a particular policy.” or “We can equally talk about evidence based policy and its fake version, policy based evidence.” Here is what I wrote in full about their study in that post.

“The CBR analysis is less obviously fake. However Ben Chu has gathered the views of some academics who are experts in trade theory, including Richard Baldwin (who has just written a definitive and widely praised book on the ‘new globalisation’) and Alan Winters, both hugely respected with immense experience, who pour some very cold water over the study.”

How do the authors respond to this second post in the Prime piece. They write

“It is unusual for Wren-Lewis to rely uncritically on mainstream economists, but he was willing to do so in this case. With many of Wren-Lewis’ articles being used by one of us in economics teaching to encourage students to query and to test what is considered ‘mainstream’ it seems more than a little surprising to be discredited for daring to do so.”

This is wrong in many ways. First, I was not relying on others, as I had serious misgivings about their use of trends that I outline above. Second, I made no mention of ‘mainstream’ and heterodox anywhere, so any suggestion that this was behind what I wrote is their invention. Finally, there is no problem with anyone challenging anyone else.

Let me reproduce one of the quotes from Ben’s piece

“The HMT [Treasury] use of gravity model was perfectly in line with best practice. It was classic evidence-based policy analysis”, said Richard Baldwin, Professor of International Economics at The Graduate Institute of Geneva. Professor Baldwin went on to accuse Mr Gudgin himself of engaging in “policy-based evidence making” and “using evidence the way a drunk uses a lamp post – for support, not illumination”.

So Richard Baldwin was accusing the authors of exactly the fake economics that I talked about. Given my suspicions about their treatment of trends discussed above, I felt justified in writing about their piece in this context.

I could have ignored Richard Baldwin’s criticism and my own suspicions, and not included them in this post. But here is another quote from Ben’s piece:

“Dr Graham Gudgin of the CBR criticised the Treasury’s analysis, which predicted a major hit to the UK economy by 2030 if the UK experienced a “hard Brexit”, in unusually strident terms describing it as “very flawed and very partisan”. Dr Gudgin said he “suspected” Treasury civil servants had been leaned on by ministers to produce the results David Cameron and George Osborne wanted.”

Recall that the Centre of Economic Performance argued, based on their own extensive analysis, that the Treasury had underestimated the costs of Brexit, so presumably the accusation of ‘very flawed and very partisan’ applies to their analysis too. If one of the authors was happy to argue that the analysis of others had been designed to produce certain results, I felt it only fair to ask the same question of the authors.

[1] Actually the second post by date: the two post were a day apart.


Wednesday, 18 January 2017

The Single Market was Mrs Thatcher’s great achievement for the UK

Parliament should be able to vote on whether leaving the EU means destroying this legacy.

The story of how Mrs Thatcher helped in the creation of the Single Market is told by Helene Von Bismarck here. She believed it would be of great benefit to the UK, and she was right. Here is a nice chart from this CBR report I discussed in my last post.


It shows the share of UK exports as a percentage of the GDP of the area exported to, for both the EU and the rest of the world. The rapid increase in the UK export share, doubling between 1990 and the beginning of the financial crisis, has to be largely down to the Single Market. [1]

But didn’t the CBR report say that the benefits of the Single Market had been exaggerated by the Treasury? Yes it did. Here is some of its reasoning. That growth in UK export share after the Single Market is not as impressive as it looks, because there is an underlying 6% 3.5% ** positive trend in the share relative to non-EU penetration, which you can detect before we joined the EU. That looks pretty on a picture, until you realise it is nonsense. A 6% 3.5% trend rise in an export share will imply that at some point not too far away UK exports to the EU will be as high as total EU GDP. UK exporters are just not that much better than exporters in other countries. There is no underlying trend rise in the UK’s export share.

As I say in The Independent, the rationale for going down the route of leaving the Single Market is completely wrongheaded. First, the Brexit vote was close - hardly a ringing endorsement for undoing Thatcher’s legacy. Second, all the evidence we have is that large numbers of Leave voters are not prepared to accept a reduction in their living standards as a price for reducing immigration, a reduction which is in the process of happening right now as a result of the collapse in Sterling. If you say we have no real evidence for this, show me your evidence that the referendum vote was a vote to leave the Single Market. If May really believes it when she says that the recent strength of the economy has convinced her that the costs of Brexit will not be that great, she is a fool. Third, the logic of saying that we cannot accept Single Market rules because we would have no say in what they are makes no sense because we will be worse off not accepting them. Once again, a majority of the country does not want to ‘take back control’ if it costs them money.

I say in The Independent that this is happening because May wants to finally show that she can bring down immigration, after 6 years trying and failing. It is also because she thinks she has to do this to keep her party together. But what Brexit means should not be up to the Prime Minister, particularly one who cannot be objective about immigration and who is a hostage to the Eurosceptic half of her party. The Single Market decision should be up to parliament. Leaving the Single Market was not on the referendum ballot paper, so it is not the ‘will of the people’. It does not follow automatically from the Leave decision, as many Leave campaigners correctly assured us before the vote.

Parliament should decide on whether we leave the Single Market as part of leaving the EU, not Theresa May. That is what living in a parliamentary democracy is all about. If the government denies MPs the chance to vote for leaving the EU but against leaving the Single Market, then that is effectively a coup against our democracy. MPs should block approval of invoking Article 50 until they get the opportunity to vote, in a way that is binding on the Prime Minister, to stay in the Single Market.

** I made a mistake in the original version of this post: corrected figures and clarifying text are in italics. For more details see this post

[1] The chart also casts doubt on the argument that being in the EU has held back UK exports to the rest of the world. This share was falling before we entered the EU, but has stabilised while we were a member.  

Tuesday, 17 January 2017

Fake Economics and the media

If there is Fake News, is there such a thing as Fake Economics? I thought about this as a result of two studies that have received considerable publicity in the press and broadcast media over the last few weeks. Both, needless to say, involve Brexit. The first are two bits of analysis by ‘Change Britain’, saying Brexit would generate 400,000 new jobs and “boost the UK by £450 million a week”. The second is a more substantial piece of work by economists at the Centre for Business Research (CBR) in Cambridge, which was both very critical of the Treasury’s own analysis of the long term costs of Brexit and came up with much smaller estimates of its own for these costs.

Defining exactly what Fake News is can be difficult, although we can point to examples which undoubtedly are fake, in the sense of reporting things to be true when it is clear they are not. Fake News often constitutes made up facts that are designed for a political purpose. You could define Fake economics in a similar way: economic analysis or research that is obviously flawed but whose purpose is to support a particular policy. (Cue left wing heterodox economists to say the whole of mainstream economics is fake economics.) We can equally talk about evidence based policy and its fake version, policy based evidence.

The study by Change Britain seems to fit into that category. In looking at the impact on jobs of potential new export markets once Brexit has happened, it counts the jobs from any extra exports but ignores the jobs lost from extra imports. It adds the extra value of exports sold to the direct budgetary saving, which is a meaningless thing to do.

The CBR analysis is less obviously fake. However Ben Chu has gathered the views of some academics who are experts in trade theory, including Richard Baldwin (who has just written a definitive and widely praised book on the ‘new globalisation’) and AlanWinters, both hugely respected with immense experience, who pour some very cold water over the study.

My key point is that both of these studies were given considerable exposure in the media, and not just in the part devoted to pro-Brexit propaganda. Here is Larry Elliott in the Guardian on the CBR study. In all the cases I’ve seen the reporting has been uncritical, with no attempt to get the opinion of experts in the field. (The Guardian in their coverage of the ‘Change Britain’ report did note that the organisation was backed by pro-Leave campaigners, but it still published the claims without any criticisms of the analysis.)

It is not difficult to understand why this happens. It is a combination of two problems: lack of journalistic resources and the concept of old news. It is the latter that means a report has to be reported on the day of publication, leaving little time to get critical reactions (particularly from academics). But these factors do mean that the non-partisan mainstream media is wide open to fake economics. (Columnists like Elliott should be able to do better, but he did support Brexit.)

This is how the public, and to be honest, journalists themselves get a distorted view of the economics of Brexit. The impression is given that, as usual, economists are divided over the issue, whereas in reality academics are pretty well united in their view that Brexit will reduce UK living standards. (And of course it already has.as the depreciation leads to inflation and lower real wages.)

Journalist resources and culture are not going to change anytime soon. Which is why economists have to think seriously as a collective about how they can best counter fake economics. This has to involve doing something individual academics are not very good at: giving fast responses if journalists ask whether some new report is serious economics or fake economics. .