By Stephen Fisher and Alan Renwick
The UK will have a referendum on whether to remain in or leave the EU on 23rd June 2016. We have developed a method for forecasting the outcome based on current vote intention polls and analysis of opinion polls from previous referendums from the UK and across the world.
In the run-up to the 2014 Scottish Independence referendum we wrote about how across various referendums there has been a tendency for the eventual vote for change to be lower than it was in polls over one-month out from referendum day, and for even final polls to overstate support for change. But these observations were based on relatively small samples of referendums.
Now, as part of a broader academic project, we are analysing over 1,600 polls from 283 referendums in 41 democracies. For the purposes of forecasting the Brexit referendum outcome, we have used just referendums in the UK or on the EU. This still includes 848 polls from 45 referendums, and for the model specification we draw on the lessons from our analysis of the broader data set.
Despite the addition of many more referendums from many more countries, the patterns we previously found largely hold up. Support for change tends to decline as referendum day approaches, but not so much for referendums on the EU as opposed to domestic political reform. Even final opinion polls tend to show higher support for change compared with the eventual outcome. Most importantly, there is a lot of variation across referendums in the extent of these tendencies, so much so that there are plenty of cases that go in the opposite direction. The experience of previous referendums suggests that the eventual Remain vote is likely to be higher than that in polls currently, but not by much – just less than 3 percentage points – and the gap between the current polls and the result is only somewhat more likely than not to be positive for Remain rather than negative.
Previous referendums are perhaps more valuable in telling us by how much the eventual outcome might differ from current polls than for predicting the direction of change. Our forecast share of the vote for Remain has a big margin of error of + or – 14 percentage points.
A critical part of our forecasting method is how we combine recent opinion polls on referendum voting intention. There is a remarkably consistent 9 percentage point difference between online and telephone polls in the level of support for Remain. This is excluding Don’t Knows, who are much more prevalent in online polls, where Remain voters are correspondingly fewer. The reasons for this effect of the mode of interviewing are not clear. Sampling, prompting, interviewer effects and question wording may all play a role. We will continue to analyse this situation but for the moment we are generating a polling average based on the last six polls but benchmarked to the mid-point of online and telephone polls. In effect this means adding 4.4 to the Remain share in online polls and subtracting the same amount for telephone polls. The six most recent polls, as of 11th March 2016, were all conducted online, and showed an average of 51% for Remain, excluding Don’t Knows. After adjusting for the mode effect, our polling average is 55% Remain.
Combining that with the direction of change suggested by previous referendums produces a forecast share of the vote for Remain of 58%.
The + or – 14 point margin of error means that the eventual Remain vote could reasonably be expected to be anywhere between 44% and 72%.
Values closer to 58% are more likely, but there is still a reasonable chance Leave could win. Our estimated probability of a Leave win is 13% and so Remain have an 87% chance of winning.
Analysis of the historical data and development of the forecasting methodology remains a work in progress, so the character of the forecast might change in future. We are painfully aware that there are many valid considerations about the particularities of this referendum that our forecasting method does not reflect, and also there are reasonable doubts about how comparable, and so useful, the experience of polling at any other previous referendum is for this one. Nonetheless, we feel that the method is reasonable enough to make this first forecast.
Thanks to Jack Sheldon, Roberta Damiani and Johnny Runge for data gathering. We will write more about both our analyses of public opinion in the run-up to referendums and our forecasting method in due course.
27 thoughts on “First Forecast for the Brexit Referendum”
Does this take into account differing turnout? (e.g. young people, who are much more likely to support Remain, also being less likely to turn up to vote)
Yes I would like to know that as well. An important factor to take into account.
From the people who predicted on May 7 that Ed Miliband would be PM
They predicted Con 35% Lab 32%. So just 2% out which isn’t a bad performance at all
On the eve of the election, Ed Miliband was predicted as having 58% chance of being PM – the same as the prediction for Remain wining now….
To be fair, this website (which is a “forecast” rather than a “poll”) was predicting that Cameron would remain as PM after last May’s election a lot more than other forecasters, and with a lot more underlying analysis.
Could you clarify how you dealt with Don’t Knows given the previous findings from Canada that they tend to break for the status quo
I voted to join the EEC 40 years ago but then it was a trading block designed to compete with the USA and emerging eastern countries. It is not the same now as it was then. We will lose our identity and find ourselves on a par with the “pull” of Alabama in the USA. And do not forget that when the UK applied first time, De Gaule vetoed it because he did not want his political power diluted by the UK possibly favouring the other three or more importantly Germany. BUT it is a different situation now where minor states in collaboration can out vote the UK (Then send their people here to make their fortunes from our security system before returning home very well off (which I will pay for with less than should be rises in UK state pension which i subscibed to for 46 years
What good are predictions of you are using rigged results ie the #GE2015 ?
Applied I F Limited has done a politically independent national pro bono forensic investigation into Electoral Irregularites code named #QUIXOTE
BREAKING NEWS #VOTEGATEUK
VOTE RIGGING AT 2015 GENERAL ELECTION
DISCLOSURE OF EUREKA TEST
By Applied I F Limited which shows Government allegedly UNLAWFUL
via ELECTORAL LAW as a result of failure to disclose NUMBERS OF
A) REJECTED ( Spoilt ) Votes
B) Numbers of ISSUED POSTAL VOTES
C) Numbers of ISSUED POLLING STATION ( Walk-In ) VOTES on
http://www.parliament.uk Web Site
Applied I F Limited 🎯 #QUIXOTE
6 June 2016 11.26
Sent from my iPhone