How do you access unbiased expertise: follow the money?

Anyone can claim to be an expert nowadays. How do we tell real experts from fake experts, and what does that even mean? And even with real experts, how do we tell which are the ones we can trust and which are telling you what they are paid to tell you? These are big questions, but I want to look at what seems like an increasingly popular method of judging whether expertise is biased, and that is to look at who funds the experts.

There are clearly occasions when this method makes sense. A medic who promotes a drug who receives income from the company that produces the drug, for example. You would also be right to be suspicious about any think tank that is not transparent about the sources of its funding, such as Adam Smith Institute, Centre for Policy Studies, Centre for Social Justice, Civitas, Institute of Economic Affairs, Policy Exchange or the TaxPayers’ Alliance. It is not clear to me why the broadcast media gives a platform to think tanks that do not disclose who funds them.

However when various academics and research institutions produced analysis suggesting negative long term effects from Brexit, some suggested that we should treat this finding with suspicion because they received EU research funds. I have also seen the IFS described as tainted by the fact that it receives some corporate income. In fact the IFS can be accused of being in hoc to all kinds of vested interests. When it published a report estimating that Brexit could lead to a increased budget deficit of £20-40bn, Vote Leave dismissed the IFS as a “paid-up propaganda arm of the European commission” because it received funding from the European Research Council (ERC). But it actually receives more funds from the Economic and Social Research Council (ESRC), which is funded by the UK government, so by the same logic it is a ‘paid up propaganda arm’ of the UK government.

The IFS example shows the danger of taking a naive approach to linking funding to positions taken. The idea that funding from the ERC or ESRC should influence the position taken by the IFS is absurd. Government research funding is dispersed through organisations like the ESRC in part to ensure that money is given to researchers on their merits (as judged by other academics) rather than because researchers might please the current government. Because the IFS is essentially an academic research institute there is no way that who funds any research (directly or indirectly) would influence the outcome of that research. If that started happening, the IFS would begin to lose its academic reputation and therefore its core funding from the ESRC.

This point is also true of academia as a whole. However being part of academia or a professional body does not preclude a pecuniary influence on any particular academic or groups of academic’s opinions, as our example of a medic funded by a drug company illustrates. When it comes to economics an even greater problem than money may be ideological or political bias. That means, unfortunately, that you cannot rely on every academic economist to give you a reasonable idea of where the consensus or plurality of opinion lies. And you cannot rely on finding some monetary link to indicate how much you can trust a particular academic economist.

So how do the public tell when views from economists can be trusted as genuine results of expertise and research untainted by bias due to money or ideology? It is a question that is increasingly asked, but I remain surprised that more people do not point to an obvious answer.

The solution to this problem is to use polls of experts to find out if a consensus on an issue exists. There are already some regular polls of selected academic economists (interest declaration: I am part of the CFM surveys of macroeconomists). Here is the latest IGM poll showing that not a single one of the 40+ panel members think imposing new US tariffs on steel and aluminum will improve Americans’ welfare. These polls are one reason I can claim that most economists do not support austerity. (Guess who was the only IGM panel member that did not think the Obama stimulus reduced unemployment.)

Invaluable though these polls are, they are selective, and a journalist or member of the public cannot be sure that the selection method did not bias the result. I have argued in the past that it would be in the profession’s interest for professional national bodies like the Royal Economics Society (RES) or AEA (American Economics Association) to conduct polls of its own members themselves. The pre-referendum Brexit poll is an excellent example of what could be done, but it was commissioned by the Observer newspaper and not the RES. I remain unclear whether this thought has occurred to either institution, and if it has why it has not led to action. Until it is done, the absence of such polls as a resource means academics cannot really complain when individual overworked journalists take insufficient account of true expertise. [1]

[1] An important caveat here. The existence of such polls is a necessary but not sufficient condition for journalists to acknowledge expertise: see the BBC's treatment of Patrick Minford's Brexit analysis, and ignoring the polls that already exist on issues like austerity and Brexit.