Saturday, October 24, 2015

Could the Lib Dems win even fewer seats next year?

I was asked by The National yesterday for an opinion on how many seats the Liberal Democrats are likely to win at the Holyrood election next year.  I don't think what I said has made it into the paper, so I thought I'd briefly explore the point here, because it's an intriguing one.  The Poll of Polls last weekend had the party on exactly 6% on both ballots - meaning that in comparison to the 2011 result they're up a trivial amount on the list, and down just a couple of points in the constituencies.  So essentially nothing much has changed, and on the face of it they should be on course to at least hold their five current seats.  But the complicating factor is that nobody knows what impact the Alistair Carmichael affair has had on Lib Dem support in their traditional fortress of the Northern Isles, which provides them with a full 40% of their current representation.  It's not impossible that their iron grip on the Shetland and Orkney constituencies could be loosened this time around.

If they did lose either or both of those constituency seats, could they make up for it on the list?  This was the list result in the Highlands & Islands region in 2011 -

SNP 47.5%
Labour 14.5%
Liberal Democrats 12.1%
Conservatives 11.6%
Greens 5.1%

Of the eight constituency seats, the SNP took six, and the Lib Dems took the other two.  The SNP claimed an additional three seats on the list, while Labour and the Tories took two list seats each.  So superficially it might look as if the Lib Dems were safe enough - ie. they would have ended up with two seats in the region anyway, regardless of whether they had won the Northern Isles constituencies.  But of course the snag is that a significant minority of their list votes in the Highlands also came from Shetland and Orkney.  If they take a hit on the constituency ballot in the Northern Isles next year, it's highly likely that they'll take a hit on the list vote there as well - and any sort of slippage at all will render them highly vulnerable to losing one of their two seats in the region.  On the 2011 result, a 2% drop would cost them a seat, but in reality even a smaller drop than that would leave them requiring a lot of luck - they'd be relying on the Tory and Green votes not increasing very much.   Even the SNP could conceivably snatch the seat with an extra few points of support. (I'm excluding the possibility of a Labour increase, because that's probably less likely, but you never know!)

The counter-argument is that the Lib Dems could compensate for a declining list vote in the Northern Isles by growing their support in the rest of the Highlands & Islands region, and doubtless their more optimistic activists would point to a recent local by-election result as evidence that a recovery is underway in that part of the world.  But one swallow doesn't make a summer, and all that.  My own view is that the loss of either Shetland or Orkney would probably leave the Lib Dems with even fewer MSPs across Scotland than they managed to cling onto after their calamitous campaign four years ago.

Friday, October 23, 2015

Unveiling the Scot Goes Pop Poll of Polls for the EU referendum

I know this falls into the category of "he would say that, wouldn't he", but I always felt that the Poll of Polls I ran on this blog during the independence referendum campaign gave a much more meaningful indication of the direction of travel than John Curtice's Poll of Polls. The Curtice version was an average of the most recent few polls, regardless of which firms had conducted them, or what methodology had been used. That meant it sometimes gave the illusory impression that Yes or No were making progress simply because the newest update included a larger number of polls from Yes-friendly or No-friendly firms. By contrast, the Scot Goes Pop Poll of Polls only included the most recent poll from each firm, meaning that any statistically significant changes were more likely to reflect real movement on the ground.

Professor Curtice is sticking to his preferred method for his new EU referendum Poll of Polls, and if anything that's going to create even bigger problems this time, because the gulf between telephone and online polls is absolutely enormous at the moment. Telephone firms are suggesting there is a hefty lead for 'Remain', while online firms think it's either a statistical tie, or very close to that. Online polls are likely to appear more frequently, because they're cheaper to conduct, so any Poll of Polls that gives equal weight to all recent polls is automatically giving greater weight to the 'Leave'-friendly online data collection method. In fact, the current update of the Curtice PoP is almost entirely comprised of online polls, producing a result of Remain 54%, Leave 46% (with Don't Knows excluded). Unless there is some rational reason for concluding at this early stage that the online method is far more reliable (and there isn't), those figures don't meaningfully reflect the totality of current polling evidence. And because the exact weighting given to online polls will vary from update to update (sometimes it might rise to 100%, occasionally it might drop to 50%), future results will fluctuate in an almost random way.

So I thought it might be a good idea to once again run a Poll of Polls here that is designed to be better at picking up the trend. I'm not going to replicate the method I used for the independence referendum, because I think that might get too complicated - some firms will be regularly conducting both telephone and online polls, so I would have to decide whether to count "ICM (telephone)" and "ICM (online)" as separate firms. Instead, I'm going to produce three averages - one for all telephone polls conducted at least partly within the last month, one for all online polls conducted at least partly within the last month, and a composite 'headline' set of figures that give an equal 50/50 weighting to telephone and online. Obviously the latter average will be a bit artificial, but at least this way we'll get a sense of what the real state of play is if telephone polls are correct, or if online polls are correct, or if both types of poll are wrong by roughly an equal amount. Under the current circumstances, I'm not sure it's possible to do a whole lot better than that.

Should the United Kingdom remain a member of the European Union or leave the European Union?

50/50 ONLINE/TELEPHONE AVERAGE :

Remain 48.7%
Leave 37.2%

ONLINE AVERAGE :

Remain 43.8%
Leave 38.3%

TELEPHONE AVERAGE :

Remain 53.5%
Leave 36.0%


(The online average is based on six polls - five from ICM and one from YouGov. The telephone average is based on one poll from ComRes and one from Ipsos-Mori.)

As big as the gap between the two component averages looks, it could easily have been much bigger - the new telephone poll from Ipsos-Mori caused a surprise by showing a slump in the 'Remain' lead. That can't be explained away simply by the introduction of the new question, because they also asked exactly the same question that was posed in the firm's previous poll in June, producing much the same result. It could be that the swing is being exaggerated due to normal sampling variation, but unless either this poll or the last one was an outright rogue, it seems likely that it's picking up some kind of genuine shift.

Wednesday, October 21, 2015

Canadian TV fails to learn the lesson of the 2008 debacle

At this time last night I was watching a live-stream of the Canadian election results programme on CBC. It was mostly a pleasurable experience, with one of the nastiest right-wing governments in the democratic world being shown the door at long last.  The pro-independence and left-wing Bloc Quebecois also made a partial recovery, jumping from two seats to ten, which will nicely complicate the (bogus) narrative that the Quebec sovereignty movement is in relentless decline.  The main disappointment was that the Liberals unexpectedly won an overall majority, because that will probably turn Trudeau into a conservative on the subject of electoral reform.  As we know in this country, it's very hard to convince a leader who has just won a majority under a majoritarian system that it would be far better to make it almost impossible for anyone to win a majority again.

And I had one other little bugbear.  I really hoped that the Canadian broadcasters had learned the lesson of their 2008 debacle, when they nonsensically "projected a Conservative minority government".  What they meant by that, of course, was that the Conservatives would be the largest single party in a hung parliament.  But their loose use of language had serious repercussions a few weeks later, when the Liberals and NDP entered into a coalition agreement with Bloc Quebecois support.  Some people were outraged : "This is a coup!  Didn't we just elect a Tory minority government?"  Well, actually, no you didn't.  You elected a parliament in which the Liberals, NDP and Bloc held a majority between them, and therefore what was happening was entirely legitimate, and should have been considered unremarkable.  But the confusion was understandable given that TV networks had fed viewers the fiction that it's somehow possible to "elect a minority government".  That may well have played a part in the coalition agreement failing to stick.

I regret to say that they've learned nothing.  When the moment came to project a Liberal government last night, the CBC host added as an afterthought : "we're making no call on whether it will be a majority or minority government".  In which case they weren't in a position to project a Liberal government at all - merely that the Liberals would be the largest party.  If there's any chance of a hung parliament, you don't yet know for sure who will be forming the government - it's as simple as that.

So why did they do it?  It was probably an infatuation with the idea that an election programme is only complete when viewers can be presented with a clear-cut winner.  But the reality is that if voters decline to choose an outright winner on the night, the TV networks have no business choosing one for them.

Monday, October 19, 2015

If "SNP sources" are saying a second referendum cannot be held until Yes have been on 60% for a full year, they have utterly lost the plot

There. I've said it. As you know, I've had concerns recently that the SNP might be preparing to make itself the hostage of the polling industry. I've also been a tad worried that the party might be listening to siren voices like that of John Curtice, who if memory serves me right once suggested that a second referendum shouldn't be held until Yes had topped 60% in the polls for more than two years. (Although I naively thought the latter concern was a lesser one, because it was self-evidently such a ludicrous proposition.) My fears eased during the conference, because no specific target figures were mentioned - it was simply stated that a significant and sustained shift in public opinion would be a potential trigger for a referendum. That left plenty of leeway for common sense interpretations as the next parliamentary session progresses.

But now we suddenly learn that an "SNP source" has told the BBC that (barring Brexit) the party does not intend to hold a second referendum until Yes support has been at 60% for twelve months. That's almost as extreme as Curtice's suggestion. I hardly even know how to begin explaining just how daft this 'strategy' is.

1) The strategy doesn't inhabit the real world. I'm sure we all wish Scotland was like Norway in 1905, ready to euphorically link hands and vote for independence almost unanimously. We're not that fortunate, but everything is relative, because we are lucky enough (unlike civic nationalists in Wales and Northern Ireland) to live in a country where a majority is at least open to the idea of backing independence. However, that potential Yes majority is a relatively narrow one. Probably 40% of the population have such a strong emotional attachment to Britain that they are totally unpersuadable under any realistic circumstances. The 60% strategy therefore insists that practically every single person who is even theoretically persuadable should be firmly in the Yes camp for a full year. That is simply not going to happen.

Why should we even think that is a problem? In a democracy, 50% + 1 is sufficient. Obviously there are legitimate concerns about slippage in support once a referendum is actually underway, but if you ever want independence to happen, you have to work with what you've actually got, and what can realistically be achieved. 60% will not be attainable in anything close to the foreseeable future. Unless the SNP leadership is just cynically cooking up a mechanism for putting off a referendum indefinitely while allowing the grassroots to live in hope, the unofficial target figure should be considerably lower - probably more like 55% at the absolute most.

2) The strategy is driven by an extremely unsophisticated understanding of how public opinion is likely to shift during a referendum campaign. The Curtice suggestion seemed to be based on the hoary old myth that voters always swing dramatically back in favour of the status quo as a referendum approaches, and that you therefore need a mind-bogglingly enormous buffer before you can risk firing the starting gun. But as we've discussed before on this blog, the more important the issue being decided is, the less likely that this supposedly "iron law" will apply. There are several examples around the world of crucial constitutional referendums, not least our own vote last year and the Quebec referendum of 1995, in which there was actually a swing against the status quo over the course of the official campaign period. The reason is simple enough - the initial Yes vote is less likely to turn out to be 'soft' if it's an issue that people care about and have already thought about in quite a bit of depth.

So quality of support matters, not just quantity. I'd rather go into a campaign with a 55% Yes vote comprised of 51% 'firm' supporters and 4% 'soft', than have a 60% vote comprised of 40% 'firm' and 20% 'soft'. Presumably the reason for stipulating that the Yes vote has to be implausibly high for a full year is the belief that support can be assumed to be firm if it holds up for a long time, but that's entirely wrong-headed - look, for example, at the sustained lead Neil Kinnock had in the polls in 1989-90. A soft vote can very easily look consistent. You simply can't get a sense of how deep your support is by looking at headline voting intentions only - for the really useful information you have to drill down into the results of supplementary polling questions.

3) The strategy is looking for absolute safety which will never be available, even at 60%. If you catastrophise by looking at past examples of referendums where the Yes campaign has haemorrhaged support as polling day approached, the only rational conclusion to draw is that no level of Yes support is ever enough. I'm afraid we just have to accept that the electorate tends to behave unpredictably in referendum campaigns, and that it will never be possible to know the result in advance. We do not, thank God, live in North Korea.

4) The strategy hands far too much power to polling firms and their potentially questionable methodology. During the referendum campaign, there was a huge gulf between Yes-friendly and No-friendly pollsters, which simply couldn't be explained by margin-of-error effects. To this day, we have no way of knowing which camp was more accurate, because all of the results suddenly converged at the close of the campaign. But if, for the sake of argument, the Yes-friendly firms were closer to the truth, that means the methodology of No-friendly firms (most obviously YouGov's notorious "Kellner Correction") was artificially dragging down the average Yes vote by several percentage points. There's no reason to suppose that can't happen again, because a big divide has already opened up again between different pollsters (albeit we now have a completely different line-up of Yes-friendly firms).

So I can't deny it - I'm extremely disheartened by what we've heard today. The only consolation is that nobody in the SNP leadership has yet mentioned a target figure on the record, so there's still scope for them to quietly revise their position over the coming years as they realise how crazy it is. That might happen, for example, when Yes has been consistently hovering at 54% for a year or two, and people start scratching their heads and wondering aloud why that isn't enough.

Sunday, October 18, 2015

SNP lead by 32% in the first Scot Goes Pop Poll of Polls for the Holyrood election

There wasn't much point in updating the independence Poll of Polls after last week's YouGov poll, because the numbers hadn't changed at all.  But with just over six months to go until the Holyrood election, the time is now ripe to unveil a Poll of Polls for that contest.  The rules are much the same as for the independence PoP - just one poll from each firm is counted (the most recent one).  Only firms that have reported in the last three months are included in the sample - which means that ICM are missing from the familiar line-up of six.  The active pollsters at the moment are TNS, YouGov, Ipsos-Mori, Panelbase and Survation.

Constituency ballot :

SNP 53.4%
Labour 21.4%
Conservatives 14.2%
Liberal Democrats 6.0%

Regional list ballot :

SNP 47.4%
Labour 21.2%
Conservatives 14.0%
Greens 7.2%
Liberal Democrats 6.0%
UKIP 2.8%

No great surprises there.  The five firms are pretty consistent in their assessment of Labour's standing, but there are sharp disagreements on the fortunes of the SNP, the Tories and the Greens.  For example, the Tories are estimated to be as low as 12% on the constituency ballot by TNS and Ipsos-Mori, whereas YouGov have them as high as 19%.  So Ruth Davidson could be leading her party to a second unmitigated catastrophe in the space of twelve months, or she could be masterminding (ahem) a mini-recovery.  The average is obviously somewhere in between those two extremes, although it's closer to the lower end of the scale.

The SNP's showing on the list ballot is a cause for some mild concern.  For all the talk about how they're doing far better than last time, their average on the list is in fact only 3.4% better than the 2011 result, with a long period of hard campaigning still to go.

Three of the five polls in the sample were conducted before Jeremy Corbyn became Labour leader.  That's not as serious a deficiency as it might seem, though, because the evidence so far is that the state of play has barely changed at all since he took over.

Thursday, October 15, 2015

Sturgeon's road-map for the next referendum

Just a quick note to let you know that I have a new article at the International Business Times, which contains a bit more analysis of today's YouGov poll, and also discusses the increasing clarity from the SNP on the "material change of circumstances" that is necessary for a second independence referendum.  You can read it HERE.

Crucial YouGov poll suggests Corbyn and the Michelle Thomson affair have failed to dent the SNP's lead

The most recent YouGov poll of Scottish Parliament voting intentions was tantalisingly conducted between the 7th and 10th of September, just before the result of the Labour leadership election was announced.  If only it had been delayed for a few days, we'd have had our first indication of whether Scottish Labour had enjoyed a Corbyn bounce.  As it was, we had to wait a long time for the TNS poll last week, which suggested that little had changed.  Today's new YouGov poll shows much the same picture, and crucially the fieldwork is bang up-to-date - it was conducted between last Friday and Tuesday of this week.  That means the results, unlike those from TNS, can be taken as evidence that the Michelle Thomson affair has made no impact either.

Constituency ballot :

SNP 51% (n/c)
Labour 21% (-1)
Conservatives 19% (+1)
Liberal Democrats 5% (+1)

Regional list ballot :

SNP 45% (n/c)
Labour 20% (n/c)
Conservatives 19% (+1)
Greens 6% (n/c)
Liberal Democrats 5% (+1)
SSP 3% (n/c)
UKIP 3% (n/c)

(Note : London is a very long way away, so clearly the existence of RISE has yet to be noticed at YouGov HQ!)

Although YouGov and TNS are in agreement on the trend, there is still an important divergence between them on just how strong the SNP's position is.  TNS have the SNP 5% higher on the constituency ballot, and a full 7% higher on the list.  If YouGov are to believed, the SNP's overall majority at Holyrood is at more risk, because it would only take a few points' worth of slippage and/or polling error to take Nicola Sturgeon into the danger zone.  It's also worth noting that both YouGov and TNS agree that the supposed Green renaissance isn't really happening, so any SNP supporters who are still tempted to "lend" their list vote to the Greens ought to be aware of two things : 1) they are doing so at a time when polling does not indicate that the SNP's majority is completely secure, and 2) they are giving their list vote to a party that may well fail to take any seats at all in some or most regions.

Devastatingly for Labour, it appears that 21% of their rump vote from May does not plan to remain loyal to the party next May.  Intriguingly, the lost support appears to be moving disproportionately towards the Tories - 11% of Labour voters say they will vote Tory next year, and only 4% say they will vote SNP.  This lends weight to the theory that if Labour are slipping further, Corbyn could be to blame - "moderate" unionist voters may be deserting Labour for a more natural home, and left-wing voters are failing to offset that effect by "coming home" from the SNP.  In absolute terms, the number of SNP voters that have switched to Labour since the general election looks almost identical to the number of Labour voters who have moved in the opposite direction.

Of course, we know from past experience that voters behave differently in Westminster and Holyrood elections, which might explain some of the direction of travel.  But it's very hard to think of any reason why a "Holyrood effect" would be responsible for voters moving from Labour to Tory.  That said, Jim Murphy appeared to be very popular among some Tory supporters, so it could simply be that some Tories who were prepared to vote tactically for Labour in May are returning to the fold now that Murphy is no longer Scottish Labour leader.  Even in the pre-Corbyn YouGov poll, there were signs that Labour deserters were breaking slightly more for the Tories.

YouGov have also asked the independence question, again finding an unchanged position -

Should Scotland be an independent country?

Yes 48% (n/c)
No 52% (n/c)

So the Yes vote remains 3% higher than at the referendum, and as before, it appears the reason is that Yes have been slightly more successful in retaining their own voters, and have also been slightly more successful in attracting new support from the other side.  13% of No voters have drifted away from their previous position, and most of them haven't become Don't Knows, but are instead now in the Yes column.  There has been some movement in the opposite direction, though - 6% of Yes voters have moved directly to No, which explains why the net swing to Yes hasn't been considerably bigger.

The sharp divergence between 'real world' pollsters like Ipsos-Mori and volunteer panel pollsters like YouGov remains in place.  Given that there doesn't appear to have been any recent movement in public opinion, there's no reason to suppose that the next independence poll from TNS or Ipsos-Mori will show anything other than a clear Yes lead.

Tuesday, October 13, 2015

Fog on the Tyne is all mine, all mine

Scotland has jointly hosted the Rugby World Cup on no fewer than three occasions over the last quarter-of-a-century (1991, 1999 and 2007).  With my customary perversity, I didn't bother going to any of those, but instead waited until it was necessary to go down to Newcastle this year.  I bought the ticket an eternity ago, and almost forgot all about it - meaning that by the time I got myself organised, it was far too late to book accommodation, leaving me with no choice but to get there and back in one day.  I did the whole thing by public transport, and it was a hell of a trip - I walked out of my front door at 5.30am and didn't get back until almost midnight.  The fact that I only got three hours' sleep the previous night didn't help much either.

As I was travelling such a long way, I was determined to squeeze a bit of sight-seeing in while I was there.  So as soon as I arrived at the train station, I popped over to the Black Gate and Castle Keep, as you can see from these frankly life-affirming photos in which I strike classic tourist poses while sporting a variety of fetching hats.




But all too soon, it was time to head over to St James' Park for the afternoon's exquisite torture, as you can see from this frankly thrilling photo in which I strike a classic rugby supporter's pose while sporting just one fetching hat.


This blog's resident troll asked me if I encountered any anti-Scottish sentiment in Newcastle, of the sort I had to endure on my shambolic trip to Arran the other week.  The answer is no, although there was an intriguing incident when I got back on the train to Edinburgh.  The people getting off the train were presumably Newcastle locals who were coming back up from London, or Birmingham, or wherever, and they greeted the waiting Scotland supporters like old friends.  "Oh, congratulations!"  "How much did you win by?"  "Did you win?  Woo-hoo!"  An English chap standing behind me (and who I think possibly lives in Edinburgh) rather bitterly muttered : "You see, Scotland?  That's how it's done.  No need to take pleasure in others' defeats."

Hmmm.  I couldn't help wondering how he'd explain the row of English people sitting behind me at the game, who were shrieking with delight every time Samoa scored.  And they weren't alone - I got the impression that about 25-30% of the crowd were firmly behind Samoa.  (OK, there were some actual Samoans there, but not that many.)  I have no complaints at all about that - Samoa were the underdogs, and they were playing a fearless and attractive brand of rugby, so it was entirely natural for neutrals to support them.  But I can't help feeling that if Scottish people supported an opponent of England's for any reason whatever, that would be classed as "bigotry" or something.

Here are some more photos from the day.  As you can see, I wasn't short of reminders of home...




















Sunday, October 11, 2015

Sturgeon mustn't become a prisoner of the pollsters

I didn't see Nicola Sturgeon on the Marr show this morning, because I've been recovering from a truly epic journey to Newcastle and back to see Scotland's decisive pool match at the Rugby World Cup (more on that later).  But I gather she was more explicit than ever before that a substantial and sustained shift in public opinion could be a trigger for a second independence referendum.

I suppose in a sense this is to be welcomed, because for the first time it makes clear that the fabled "material change of circumstances" is an event that the Scottish people can have some control over themselves, and won't necessarily have to be something that the London government does or doesn't do.  But what troubles me is that the only measure we have of public opinion is polls.  That means apparent shifts in public opinion can be artificially generated by changes in polling methodology, but it also means that real shifts can be concealed by changes in methodology.  That's already happened to some extent - the real average increase in the Yes vote since last September is markedly higher than most polls have reported in their headline numbers.  The reason is that four of the six active pollsters have introduced weighting by recalled referendum vote, which in most cases hurts Yes.

We have, therefore, already seen a substantial and sustained shift in public opinion.  Perhaps it hasn't yet been substantial enough.  But the fact that we tend to underplay what has already been achieved should serve as a warning of the dangers of appointing the likes of Peter Kellner as our adjudicators.  It's not inconceivable, for example, that the next Yes surge could be hidden from view by a new incarnation of the notoriously convoluted (and secretive) 'Kellner Correction'.

Friday, October 9, 2015

SNP vote increases by 4.6% in Aird and Loch Ness by-election

Yesterday's by-election in Aird and Loch Ness saw the SNP and Lib Dems finish more or less level-pegging on first preferences (just 29 votes separated them).  But in contrast to the East Ayr by-election a few weeks ago where the SNP were fractionally behind on first preferences and were still able to win, it was inevitable that the Lib Dems were going to take this one on transfers, because there were a substantial number of unionist votes to be redistributed after the elimination of the third-placed Tory.

Aird and Loch Ness by-election result (first preferences) :

Liberal Democrats 33.5% (+21.2)
SNP 32.5% (+4.6)
Conservatives 15.2% (+8.3)
Independent - Fraser 9.5% (n/a)
Greens 9.3% (n/a)

The by-election was caused by the resignation of an SNP councillor (Drew Hendry), so the SNP were "defending the seat", but only in the most technical of senses - they finished in second place in the ward last time, with even the combined vote for their two candidates still placing them more than 9% behind the winning independent candidate.  So the headlines will scream "Shock Lib Dem Gain From SNP", but that's utterly meaningless - the SNP vote is up 4.6% and they remain in second place.  What appears to have happened is that the Liberal Democrats have claimed the lion's share of the independent vote from last time, allowing them to leapfrog into first place.  Without being aware of local factors, it's impossible to know how they pulled off that feat - it could be, for example, that their candidate is well-known and popular.

The other point that should be noted is that the increase in the SNP's vote is only slightly lower than the average increase they enjoyed in the seven by-elections last week (of which they won six).