In the heated discussion leading up to the Meaningful Vote scheduled for Tuesday the 11th of December the Express reported, from an interview on the BBC’s Andrew Marr show, that the ‘Brexiteer Gisela Stuart masterfully shut down Remain campaigner Gina Miller after she suggested there is now increased support for a second Brexit referendum’ (Bosotti 2018). Gina Miller cited a poll published in the Independent that said ‘People were... for a new referendum by 46 per cent to 30 per cent’ (Watts 2018), while Gisela Stuart cited research undertaken for Change Britain noting that “The public want their MPs to vote against a second referendum” by 51 per cent to 45 per cent (BMG Research 2018). Additionally the Change Britain research also claimed a ‘Canada Plus’ agreement was the most ‘strongly preferred’ outcome while the Independent said a ‘Majority of country now think Britain should remain in the EU’. Remarkably BOTH the Independent poll and the poll for Change Britain were carried out by the same company BMG Research. How can this be and how are Parliamentarians supposed to make sense of these diametrically opposed conclusions, and in so doing make what may be the most important decision of their political careers to guide the country forward for generations to come?

The Northern Ireland peace process was far too important to leave the public opinion research in the hands of partisan organisations and pollsters who would bias the questions, methodologies and analysis to fit their client’s agenda. In Northern Ireland a programme of independently funded academic polling research (Irwin 2012) was undertaken as a partnership between the Queen’s University of Belfast and the Joseph Rowntree Charitable Trust. Critically this research was also undertaken with input from all the parties to the negotiations to ensure objectivity so that the results would be taken seriously and acted on. Clearly Brexit now needs the same approach. So what has gone wrong with the polling undertaken by BMG Research and others, and how can it be corrected?

Firstly, with regards to support for a second referendum the result depends not only on when the poll was run but also on the question asked. For example Lord Ashcroft (2018) in his November poll asked ‘Should there be a second referendum, to decide between leaving the EU on terms agreed in the draft Brexit agreement, or remaining in the EU?’ resulting in 38 per cent ‘yes’ and 47 per cent ‘no’ because this question disenfranchises ‘leave’ voters. Conversely when asked ‘Should there be a second referendum, to decide between leaving the EU on terms agreed in the draft Brexit agreement, or leaving without a deal?’ the result is only 31 per cent ‘yes’ and 50 per cent ‘no’ because this question disenfranchises remain voters. However, in a Survation poll (Walters 2018) also run in November the result was 48 per cent in support of a ‘People’s vote – a referendum – asking the public their view?’ and only 34 per cent opposed. In Northern Ireland and around the world people generally like to exercise their franchise and critically the Survation question does not disenfranchise anyone. Implicitly both remainers and leavers are invited to express ‘their view’. Interestingly the BMG Research question gets a result somewhere in-between the Lord Ashcroft and Survation questions as they ask ‘If there is a vote, should your MP vote FOR or AGAINST another referendum on whether to leave or remain in the EU? with an additional option for their MP to abstain.

These very different results now make sense and the correct approach to dealing with this issue is to either have the stakeholders, the Parliamentarians collectively agree what is the correct question to ask or, alternatively, run the various alternate questions and then have a discussion as to why they produce different results. That is the discussion that should have taken place between Gisela Stuart and Gina Miller on the Andrew Marr show, but didn’t, and an opportunity to enlighten the public was lost. Statistics do not have to be lies they simply have to be understood. But what about the BMG Research result in the Independent that suggests the British public want to remain in the EU and their poll for Change Britain that suggests, given a choice, the British public would choose a Canada plus deal. What is happening here?

Regrettably, the polling organisations that have tried to differentiate the British public’s preferences for different Brexit outcomes have not used best practice in both the design and analysis of their questions, pioneered in Northern Ireland and tested in a dozen other countries around the world. Firstly the options used in Northern Ireland and elsewhere were drafted by constitutional lawyers who could write both accurate and clear proposals that could be tested against public opinion, while, at the same time not leaving any important options out (Irwin 2012, page 9). The eight options tested by BMG Research do not meet these standards, e.g. No Brexit and No Brexit Plus (Clarke and Johnson 2018). Secondly BMG Research used a method that does not allow the informant to separately evaluate every option on offer against all other options by, for example, asking for only a first and last preference. Similarly although YouGov (Curtis and Smith 2018) use a simple question that asked the informant to rank order just three options, which works well with the Alternative Vote (AV) system, they then go on to analyse the same data using the Condorcet method that is far from transparent to the average reader. They would have done better to use the tried and tested methods that worked in Northern Ireland and published in the Belfast Telegraph for public diplomacy purposes (Irwin 1996/2000).

The bottom line to all of this is that the British public and MPs are not enlightened by all this public opinion research but rather find themselves frustrated by a lack of clarity, objectivity and transparency that only leads to the further confusion of Brexit in the minds of the British public. Arguably, the British Parliament has not served the British people well in resolving Brexit. Regrettably the British public opinion industry has not helped in this regard as much as they could. They could and should have done very much better. Independent research of a higher standard is required.

References

Ashcroft, Lord, (2018) My new Brexit poll: good for Theresa May, bad for her deal, Lord Ashcroft Polls. Friday, 23 November. Available at: https://lordashcroftpolls.com/2018/11/my-new-brexit-poll-good-for-theresa-may-bad-for-her-deal/

BMG Research (2018) Change Britain/BMG Poll: Deal or No Deal Understanding the Public’s Preferred Brexit Outcomes, BMG Research, Posted 10/12/18 available at: https://www.bmgresearch.co.uk/change-britain-poll-dec18/

Bosotti, A., (2018) ‘UK still wants Brexit!’ Leave activist has Gina Miller FACE FACTS challenging Remain poll, EXPRESS, Monday 10 December. Available at: https://www.express.co.uk/news/uk/1056512/Brexit-news-Gisela-Stuart-Gina-Miller-UK-EU-withdrawal-latest-second-referendum-vote-May

Clarke, C., and Johnson, A., (2018) We don’t need to leave the EU to control immigration, Mrs May, The UK in a Changing Europe, 20 November. Available at: http://ukandeu.ac.uk/we-dont-need-to-leave-the-eu-to-control-immigration-mrs-may/

Curtis, C., and Smith, M., (2018) May’s Brexit deal leads in just two constituencies as it suffers from being everyone’s second choice, YouGov, 6 December. Available at: https://yougov.co.uk/topics/politics/articles-reports/2018/12/06/mays-brexit-deal-leads-just-two-constituencies-it-

Irwin, C., (1996/2000) Northern Ireland – Polls and Public Diplomacy, PeacePolls. Available at: http://www.peacepolls.org/cgi-bin/generic?instanceID=10

Irwin, C., (2012) The People’s Peace, CreateSpace, CA. Available at: http://www.peacepolls.org/peacepolls/documents/002539.pdf

Walters, S., (2018) British people back May’s Brexit deal: Exclusive poll shows most voters back PM’s plan as the best offer for the UK, Mail Online, 27 November. Available at: https://www.dailymail.co.uk/news/article-6435545/British-people-Mays-Brexit-deal-exclusive-poll-finds.html

Watts, J., (2018) Majority of country now think Britain should remain in the EU, poll reveals, Independent, Sunday 9 December. Available at: https://www.independent.co.uk/news/uk/politics/brexit-deal-theresa-may-uk-vote-economy-mps-remain-a8673926.html