Monday, August 11, 2014

Boost for Yes as the gap narrows by 2% among definite voters in new poll from No-friendly firm YouGov

As I pointed out in last night's post, YouGov are unusual in that they don't filter or weight their headline results by likelihood to vote.  However, the datasets for the new poll have been released, so we now know what the figures would have been if YouGov used the same method as Ipsos-Mori, and headlined the results for respondents who say they are absolutely certain to vote in the referendum.  The logic for doing so is that people typically overestimate their own likelihood to vote, and actual turnout figures tend to correlate quite closely with the number of people who tell pollsters they are absolutely certain to vote.  The percentage changes given below are from the last YouGov poll which was conducted in late June.

Should Scotland be an independent country?  (Definite voters only)

Yes 40% (+1)
No 60% (-1)

As always, it has to be borne in mind that YouGov are now by far the most No-friendly of the six BPC pollsters, almost certainly due to the artificial and highly secretive "Kellner Correction" which is used to suppress the reported Yes vote, so the size of the No lead has to be seen in that light.  

Among voters who say they have at least an 8 out of 10 chance of turning out to vote, the No lead is completely unchanged since the last YouGov poll at 61-39.  So there's really very little comfort here for the "No have been given a boost by the leaders' debate" narrative.  Admittedly there's no absolute proof that there hasn't been a post-debate bounce for No, because only half of the sample for this poll was interviewed after the debate.  But if by any chance there was a substantial bounce, that must mean that the pre-debate half of the sample was extremely favourable for Yes, possibly with the Yes vote approaching an all-time high for YouGov, because there's no other way that the overall figures would average out as showing a small swing to Yes among definite voters.  That in itself would be troubling for the No campaign, because if any post-debate bounce proves to be superficial and transitory, you'd expect the state of play to return to roughly where it was prior to Tuesday evening.

It may also be worth making the point that, due to YouGov's clear sympathies with the arguments of the No campaign, they'd have been likely to point it out if there were any significant differences between the two halves of the sample.

There's one uncanny similarity between the YouGov and Survation polls of recent days, which is that the No lead is actually slightly lower on the raw unweighted data than it is in the weighted figures.  That's reasonably unusual - generally the weighting lifts up the Yes vote, because groups that favour Yes (such as lower-income people) are under-represented in sampling and have to be upweighted.  This should perhaps set a few alarm bells ringing, because it might mean there is something strange about both polls that is suppressing the Yes vote.  In the case of Survation it was fairly obvious what was going on - there were implausibly huge swings to No among the small samples of young people and residents of the South of Scotland electoral region, who had been upweighted massively in the overall results.  But I'm struggling to spot such an obvious explanation in the YouGov datasets.

We've got used to the highly unusual disparity between different polling firms in this campaign, but we're also going to have to start facing up to the fact that this looks likely to prove to be a factor in the next Holyrood campaign as well - unless of course the firms that prove to be the most inaccurate in September subsequently put their house in order.  YouGov are currently showing a modest Labour lead for Holyrood (although that lead has actually narrowed since late June, which again flatly contradicts the "post-debate blow for Salmond" claim).  That contrasts with the other traditionally No-friendly pollster Ipsos-Mori, who are continuing to show a decent SNP lead.  The more Yes-friendly pollsters tend to show much bigger SNP leads.  So although it would be an over-simplification to say it's "YouGov versus the field" in terms of Holyrood polling, there's certainly an element of truth in that, and the explanation is most likely to be the Kellner Correction.  The fact that this disparity isn't just happening in referendum polling must surely place a big question mark over the credibility of YouGov's approach.

The most interesting of the supplementary questions in the poll asks whether there should be another independence referendum in the future if there is a No vote this year, and what the timescale for that should be.  A full 53% of respondents say there should be another referendum at some point in the next 30 years.  I must say that really surprises me - although I personally think people's tolerance for another referendum would be quite high in the long-run (after all we had a second devolution referendum just 15 years after the first one), I wouldn't expect them to realise that right now.  Most startlingly, 31% of No voters say there should be a second referendum.  What's going on here?  It's hard not to conclude that at least some of these people are soft No voters who are not at all sure they are doing the right thing, and would like the safety-net of thinking they might have a second bite of the cherry one day.  If so, there's every reason to think that many of them will be open to persuasion between now and September.

* * *

REQUIRED SWINGS

Swing required for 1 out of 6 pollsters to show Yes in the lead or level : 3.5%

Swing required for 2 out of 6 pollsters to show Yes in the lead or level : 4.5%

Swing required for 3 out of 6 pollsters to show Yes in the lead or level : 5.5%

Swing required for 4 out of 6 pollsters to show Yes in the lead or level : 6.5%

* * *

SCOT GOES POP POLL OF POLLS

This update of the Poll of Polls takes account of both the Survation and YouGov polls, and therefore the slight increase in the No lead is almost entirely caused by Survation - the YouGov figures make an absolutely negligible difference.

MEAN AVERAGE (excluding Don't Knows) :

Yes 42.8% (-0.7)
No 57.2% (+0.7)

MEAN AVERAGE (not excluding Don't Knows) :

Yes 36.5% (-0.5)
No 48.8% (+0.8)

MEDIAN AVERAGE (excluding Don't Knows) :

Yes 42.8% (-0.6)
No 57.2% (+0.6)

(The Poll of Polls is based on a rolling average of the most recent poll from each of the pollsters that have been active in the referendum campaign since September 2013, and that adhere to British Polling Council rules. At present, there are six - YouGov, TNS-BMRB, Survation, Panelbase, Ipsos-Mori and ICM. Whenever a new poll is published, it replaces the last poll from the same company in the sample. Changes in the Poll of Polls are generally glacial in nature due to the fact that only a small portion of the sample is updated each time.)

*  *  *

Those of you who read the comments section of this blog can't really have failed to notice that there has been an infestation of anonymous No-supporting trolls recently - some of them abusive, but none of them remotely interested in constructive debate.  A number of people have contacted me to suggest that I ban the trolls or mass-delete their posts.  I'm not going to do that.  One thing that makes the Yes campaign different (with a very few unfortunate exceptions like James Mackenzie) is that we believe in open debate, and we don't go around censoring our opponents in the way that Labour Hame, Vote No Borders or the Better Together Facebook page do.  I fully appreciate how irritating it is, though.  Heaven only knows where all these people have suddenly sprung from - they might be from the dark hordes at Political Betting, they might be "risk assessors" and risk assessor groupies who have followed me over from Twitter, or something more organised than that might be going on.

To answer a specific question that a couple of people have asked me, there's no need for anyone to post anonymously if they don't want to - simply select the "Name/URL" option when you comment.  If you don't have a website or profile of some description, just leave the URL section blank.

Setback for the No campaign as new YouGov poll fails to back up their complacent boasts of a post-debate polling boost

It's been a night of frustration for Blair McDougall, the No camp's embarrassment of a campaign chief.  He must have hoped that the new YouGov poll would replicate the post-debate increase in the No lead reported by Survation a couple of days ago, but instead it has shown no change whatsoever since the last poll from the firm several weeks ago.  Bear in mind that YouGov have in recent times overtaken Ipsos-Mori to become the outright most No-friendly pollster, largely due to the notorious "Kellner Correction" which artificially lowers the Yes vote, so the following figures should be seen in that light.

Should Scotland be an independent country?

Yes 39% (n/c)
No 61% (n/c)

On the figures that take account of Don't Knows there has been a 1% increase in the No vote, which is of no statistical significance at all -

Yes 35% (n/c)
No 55% (+1)

Now, to be fair, there are two ways in which the No campaign could argue that this poll is theoretically consistent with a substantial post-debate bounce for No, even if that's not showing up on the headline figures - but both are problematical for them.  The first way is to point out that, unlike the Survation poll, only half of the fieldwork actually took place after the debate, so it's possible that the post-debate part of the sample was much better for No.  The problem is that this would imply there must have been a swing to Yes in the pre-debate part of the sample, otherwise the overall Yes vote would be lower.  That's surely not something that McDougall Central would be comfortable with, because we know that debate bounces can recede very quickly.

The second way is to point out that the last two YouGov polls were probably understating the Yes vote, because they both showed swings to No at a time when other pollsters were detecting no such thing.  So it could be suggested that the Yes vote has actually fallen from 41-42% (with Don't Knows excluded), which is the high watermark YouGov showed in the spring.  But that would also be a problematical claim, because the No campaign were all too eager to insist that the changes shown in the last two polls were real, and they'd have to implicitly accept they were leading us up the garden path.

It's important to stress that YouGov are one of only two BPC pollsters (the other is TNS) who don't filter or weight their headline numbers by likelihood to vote.  However, like TNS, they do make additional turnout-adjusted figures available.  As far as I know, those figures haven't been released yet for this poll, so that'll be the first thing to look out for when the datasets appear, presumably tomorrow.  It's impossible to say whether the filtered results will be any different -  they weren't in the last YouGov poll, but in the last-but-one poll the No lead was a full 4% lower among respondents who say they will definitely vote.

It's been well-rehearsed that YouGov have acted in a thoroughly reprehensible manner since this long referendum campaign began.  When I or others raise question marks about the methodologies of various pollsters, it's sometimes asked : "Are you seriously saying that the pollsters are consciously biased?"  And generally the answer to that question is "no", but YouGov is a partial exception. I'd say they now occupy a no-man's-land somewhere between neutrality and outright pro-No bias.  Both Peter Kellner and Laurence Janta-Lipinski have published commentary on the referendum that has utilised familiar No campaign attack lines, and it's very hard to trust a firm capable of doing that to be scrupulously neutral in devising its methodology.

Nevertheless, just for once I can give a very small piece of credit to YouGov, because in this poll they have made two very sensible methodological changes, albeit arguably of the "too little, too late" variety.  They've followed in Panelbase's footsteps by introducing weighting by country of birth, which will have the effect of slightly reducing the No lead.  In this case it has only reduced what would otherwise have been a 62/38 split to 61/39, but once the hoo-ha over the debate fades away or goes into reverse, we may soon be back into a situation where a 2% or 4% decrease in the No lead will look a hell of a lot more significant.  Incidentally, if it's gradually becoming the new orthodoxy that weighting by country of birth is a wise idea, then it's highly likely that the No lead in the Survation poll should have been a bit lower.

YouGov's other change is to start interviewing 16 and 17 year olds, which is a ridiculously long-overdue step, because other pollsters have been doing it throughout the campaign.  It's very hard to understand how Kellner can try to pull rank on other pollsters when his own firm has been guilty of such an amateurish omission for so long.

Welcome though these changes are, neither of them can even begin to make up for the fact that the "Kellner Correction" remains in place, and the obsessive secrecy over the effect it is having continues.  Anthony Wells has a semi-detached relationship with YouGov that I don't fully understand, but his inside knowledge was sufficient to let us know instantly what the figures in this poll would have been if the new methodological changes hadn't been made.  And yet still no-one will tell us what the numbers would be if the "Kellner Correction" was removed.  When I asked Janta-Lipinski a few weeks ago, he initially tried to change the subject, before boasting about the firm's secretiveness and the fact that we weren't entitled to that kind of information.

More details on this poll, and a Poll of Polls update, can be found HERE.

Sunday, August 10, 2014

Reasons to be sceptical about the changes in the new Survation poll

I've been away all day, but I've finally had a chance to catch up with the way Survation are reporting the findings of their own poll, and quite frankly it's laughable.  It's obviously a matter of perception whether the No campaign can be reasonably said to have a "commanding" lead when Yes are on 43% - just 7% from victory.  But one thing that is undeniable is that it's a much lower lead than in countless polls we've seen in this campaign, especially up until a few months ago.

There's one particular line that contains a downright inaccuracy (I'm tempted to be a good bit more blunt than that) -

"This is the highest ‘No’ vote – and the biggest lead over ‘Yes’ – seen in a Survation poll since our first independence referendum poll in February."

The "first" poll they are talking about there was in fact their second - they are attempting to erase from history their first referendum poll in January which showed a much, much bigger No lead.  It's hard not to suspect that they are doing so to please their clients the Daily Mail, who were plainly keen to make the false claim that the leaders' debate had led to a record lead for No.  What possible justification can there be to pretend the January poll didn't happen?  Well, Survation have radically altered their methodology since then, and it's impossible to know for sure what the outcome of that poll would have been under the current procedures.  But it is possible to hazard an educated guess based on the raw unweighted data, which as it happens suggests that the No lead would have been slightly higher in January than it was in last night's poll.

The breathless way in which Survation report their finding that Darling "won" the debate verges on the idiotic.  The only credible way to gauge the winner of a debate is to conduct an instant poll immediately afterwards - if you wait until a day or two later (as Survation did), public perceptions will be hopelessly tainted by the media spin on who "won".  But hats off to the impressively high 28.3% of Survation's respondents who know their own mind, and who defied the media narrative by saying Salmond won the debate.

To turn to the headline voting intention results, there are two specific reasons to be sceptical about the supposed swing to No (over and above the possibility that it's largely an illusion caused by the standard 3% margin of error).  There are two groups of respondents who showed particularly big swings to No, and who had to be upweighted massively because Survation couldn't find enough people in those demographic categories.  Whenever that happens, it effectively increases the margin of error for the overall sample, and makes volatility from one poll to the next much more probable.  Indeed, I seem to recall saying in a post not too long ago that Survation's constant need to drastically upweight the youngest group of respondents really ought to be causing volatility, and it was surprising that it wasn't.  That has finally happened now, because since last week's poll the No lead among 16-24 year olds has increased from 5.1% to 34.6%.  The effect of that wildly implausible swing has been magnified in the overall results, because the 61 real respondents in that age group have been upweighted more than two-fold to count as 129 'virtual' respondents.  Self-evidently, there hasn't really been a 15% swing to No among young people in the space of one week, so it's likely that the weighting procedure has artificially generated at least part of the increase in the overall No lead.  Indeed, if we look at the other age groups (who haven't needed to be upweighted significantly), it's striking how similar this week's poll is to last week's - No have gained a little ground among three age groups, and Yes have gained a little ground among two.  But nothing of any great statistical significance.

The other part of the datasets where alarm bells start ringing is the regional breakdown for the South of Scotland.  Last week, Yes had an 11% lead in that region, whereas now they are behind by 24%.  Again, the impact of that turnaround has been magnified, because in both polls respondents from the South had to be upweighted roughly two-fold.  Now, to be fair, this week's results are actually more plausible than last week's - you'd expect the South to be one of the most No-friendly regions.  But the point is that the extreme upweighting of two such different figures has distorted the trend.

The best clue that No have been flattered in this poll lies in the unweighted data.  In the vast majority of polls, the weighting helps Yes, but in this one the No lead is slightly smaller on the unweighted figures.  Indeed, the No lead on the unweighted figures of this poll is smaller than the No lead was on the unweighted figures of the last-but-one poll from Survation.

What I draw from all of this is a) it's far from clear at this stage that there has been ANY post-debate bounce for No at all, and b) if there has been a bounce, the balance of probability is that it's smaller than Survation's headline numbers would suggest.

*  *  *

This supplementary question made me laugh -

"Do you believe the Scottish Government should draw up alternative options to a ‘currency union’ ahead of the referendum on September 18, 2014?"

What, like they did several months ago, in rather a lot of detail?  In next week's Survation poll -

"Do you think Clement Attlee would have been a better Prime Minister if he'd introduced a National Health Service?  Why oh why didn't he do it?"

Friday, August 8, 2014

Marking your card for tonight's Survation poll

There's a new Survation poll on its way tonight, but unless it appears very soon I'm not going to be able to cover it with any speed, because I've got an early start tomorrow and I'll be away all day.  (That should fuel the cynicism of our favourite No trolls!)  What we know so far is that it shows some kind of increase in the No lead since the Survation poll last week showing Yes still on an all-time high of 47% - that's obvious from Alan Roden's eagerness to talk about the poll so early in the evening, and by the usual assortment of thuggish No campaign staffers who have retweeted him.  So there are three broad possibilities -

1) This is a minor, margin-of-error increase in the No lead of no statistical significance, but the No campaign are latching onto it in an effort to generate an impression of post-debate "momentum".

2) This is a more substantial increase in the lead, but is caused by a more extreme form of 'margin of error noise', and is still of no great significance.  (A previous example is when ICM showed an increase in the No lead from 3% to 12% a few months ago, but in retrospect it's clear that nothing had happened.)

3) It's a substantial increase in the No lead, which is genuinely caused by a reaction to the debate.  If so, there is absolutely no cause for panic, because post-debate bounces are often built on candy-floss.  (Witness the Cleggasm, which was ultimately followed by the Liberal Democrats suffering a net loss in seats.)  Indeed, in this case, Darling's so-called "win" in the debate wasn't even real - the only instant poll on the night pointed to a draw.  So a bounce built purely on the spin the media have put on a debate is likely to recede even faster.

I'll update the Poll of Polls as soon as I can, although I suspect by then we may have even more polls from the Sunday papers.

How was it for you, Darling?

Just to let you know that I have a new article at the International Business Times about Tuesday night's Salmond v Darling debate, and Darling's attempt to sabotage it with a wall of noise about the currency non-issue.  You can read the article HERE.

Thursday, August 7, 2014

Concerns mount over the role of No-friendly pollster Ipsos-Mori in hand-picking the audience for the STV leaders' debate

Ipsos-Mori are not merely one of the two most No-friendly pollsters in this campaign. They've also played two other unique roles. Firstly, they've secretly carried out internal polling on behalf of the UK government and paid for by the tax-payer, the results of which were disgracefully shared with the No campaign, effectively meaning that the No campaign's private polling has been subsidised by the public purse. And secondly, in spite of the rather obvious conflict of interest, they were commissioned by STV to hand-pick an audience for Tuesday night's debate between Alistair Darling and Alex Salmond. The idea that nobody is entitled to raise the odd eyebrow about this is risible - can you imagine what the reaction would have been if STV had used Panelbase, a pollster which tends to produce Yes-friendly results and which counts both the SNP and Yes Scotland among its clients?

Since Monday, a number of specific allegations have been made about Ipsos-Mori's conduct, and other related shenanigans -

* Yes supporters who were originally selected for the audience were turned away at the venue, after being told that the paperwork had not been cleared by Ipsos-Mori. Some were reduced to tears. They were replaced by No supporters.

* Ipsos-Mori have pinned the blame on STV's own security.

* No campaigners were present at the queue, offering helpful "suggestions" for questions that audience members might like to ask Alex Salmond.

* Some of the No supporters in the audience were "bussed in" and have no vote in the referendum itself.

* At least one of the five-strong panel of "undecided voters" that appeared on ITV News after the debate to give their verdict is a known No campaign activist.

* Ipsos-Mori made determined efforts to contact a particular teenager by telephone, because they were short of people in his age group for their sample. When they finally made contact, they asked him for his voting intention, and immediately after he said he was voting Yes he overheard the interviewer being told to terminate the call and to use a "technical fault" as an excuse.


It's obviously impossible to know how much of this is true - the suggestions of audience members being bussed in from south of the border do seem rather fanciful. But given the sheer number of complaints that STV have apparently received, it does seem likely that there's at least some truth in the claims of audience members being turned away at the venue. And just from observation, a good number of the questions that were asked could easily have been scripted by No campaign staffers.

It goes without saying that it is incumbent on the BBC to ensure that there is no repeat in the second debate at the end of this month.

* * *

UPDATE : Thanks to the person who contacted me this morning and pointed me in the direction of a first-hand and on-the-record account of what happened on Tuesday from Neil Gillespie -

"A very interesting read on all the comments about the man who was refused entry to the live debate, the bullshit the fact that he's a NAT spreading propaganda, copied and pasted and that the whole thing was made up to deflect from Alex Salmond's poor showing. Well the reason why you wonder why I find this interesting is because I was that man.

A little background about myself:

I am a firefighter of 18 years, aged 42 married with four children. Professionalism, honesty and integrity are things that I hold in high regard. I was selected, along with a No voting friend of mine from Barrhead Main street by a representative from Ipsos Mori to attend Tuesday night's Debate. I was really looking forward to it. I had to get the night off as I was working. I received a text from the Ipsos Mori rep 20 minutes before the opening of 18:30 hrs asking if I had received a call from STV today. I hadn't. She replied to say that this would be a problem and that I wouldn't get in! I tried anyway. Here is a rough transcript of the conversation:

I was asked by a STV Rep for my Name.

I said Gillespie.

He said, John, we spoke today.

I said, No its Neil.

He replied, I don't have a Neil Gillespie. Who contacted you to attend this evening.

I said the Rep from Ipsos Mori Name.

He replied. You are the third person to mention her name. I'm afraid that your information was never passed on to us and as a result that you wont be getting in this evening.

I argued with him telling him that I had taken time off and that a mistake had been made.

I was still refused entry.

I had the Ipsos Mori Rep's Mobile number from her text to me and I called her to see what she had to say.

She stated that this was all bullshit and that she had given them the details the Thursday before. She said that she would phone her boss in London and find out what has happened.


I walked down the steps of the auditorium and felt deflated. I was gutted.

5 minutes later she phones me back.

This next bit took me back.

She said that all of the Yes voters and undecided persons that she had put through to attend the event were not contacted and instead STV had replaced them with their people, No people. This came from high up in STV.

I will repeat that as this is the important part.

She said that all of the Yes voters and undecided persons that she had put through to attend the event were not contacted and instead STV had replaced them with their people, No people.

This made my blood boil. I was and am still livid. I have spread this everywhere I can. Please share it, it needs done. Oh and one last thing, my No voting friend who was vetted at the same time I was, what happened to him...

He was in the audience, he got a call from STV, he was allowed to attend! So the bullshit response from STV stating that Ipsos Mori hadn't passed on the details is exactly what it says on the tin...Bullshit.

I have made formal complaints to STV and Ipsos Mori and I am still awaiting a reply from this. I wouldn't lie about this, I could lose my job if I was caught out lying about something as important as this. I will chat with anyone on here as to the post and any other referendum issues. I am a passionate Scot who loves his country and this is just another example of the lengths the powers in Westminster will go to, to win this referendum."

Wednesday, August 6, 2014

Wisdom on Wednesday : You may be interested to learn of some additional perks...

"Scotland, voting Yes in the referendum will consign the Tories to oblivion, you'll feel like Ripley blasting the Alien out of the airlock."

Comedian Frankie Boyle.

Tuesday, August 5, 2014

Yes campaign surge to new record high in sensational poll from traditionally No-friendly pollster Ipsos-Mori

Has the Glasgow 2014 effect worked its magic?  Since the campaign started, Ipsos-Mori has never shown a gap anything like as close as this -

Yes 40% (+4)
No 54% (n/c)

With Don't Knows excluded, it works out as...

Yes 42% (+2)
No 58% (-2)

The previous record high for Yes from Ipsos-Mori with Don't Knows excluded was 40% - and in all but one poll from the firm, the Yes figure has always been in the 30s.  When you bear in mind that Ipsos-Mori are one of the two most No-friendly firms, and traditionally show a much lower Yes vote than the average, this is a huge breakthrough for the pro-independence campaign - and could well translate to a neck-and-neck race among the more Yes-friendly firms.

*  *  *

A couple of hours on, and I've now had a look at the datasets.  The first thing to say is that the Yes campaign missed out on being rounded up to 43% by the absolute tiniest of fractions -

Yes 42.48%
No 57.52%

But even that is likely to be an underestimate, because for reasons that I simply cannot understand, Ipsos-Mori continue to ask respondents for their country of birth and then fail to weight by it - or if they are weighting by it, the target figures clearly bear no relation whatever to the 2011 census results, and it's hard to fathom where the extra English, Welsh and Northern Irish people are supposed to be coming from.  A full 14.3% of Ipsos-Mori's weighted sample were born in a part of the UK other than Scotland, which on the face of it is significantly too high.  The percentage of the sample who report that their national identity is either exclusively or predominantly Scottish is also suspiciously low at just under 50%.

It's important to stress that the methodological errors that Ipsos-Mori appear to be making had a bigger impact tonight than simply suppressing the Yes vote in this poll.  You see, the firm also selected the audience for STV's debate.  Did it seem to you that there were a disproportionate number of No voters in the audience?  Were you surprised that Darling sometimes seemed to receive greater spontaneous applause than Salmond?  Did it strike you that significantly more No-friendly questions were asked?  That's because the audience were hand-picked to be representative of what Ipsos-Mori think is the demographic balance of Scotland.  I saw a Yes supporter rather narkily suggest on Twitter that there were an awful lot of English accents - this is obviously a very delicate subject, but at the end of the day it's a simple and plain fact that if the audience were supposed to be demographically representative of the Scottish population, there should have been no more than about 10% who were born in England.  Yet due to Scotland apparently having completely different demographics over on Planet Ipsos-Mori, the figure is likely to have been considerably higher - and that will have been a deliberate and conscious choice.  Why do they do it?  Answers on a postcard, folks, because it's beyond me.

I gather that an instant poll conducted by ICM suggested that 44% of respondents thought that Salmond won the debate, and 56% thought that Darling won.  That gap isn't particularly significant, especially given the unusual difficulties of putting together a representative sample for a poll like that (ie. you have to choose between being representative of the Scottish population as a whole and being representative of only the people who watched the debate, because you can't do both).  Nevertheless, it does obviously have a little bit of importance in terms of bragging rights, and for my money there's no way on Earth that those numbers would have been produced if it hadn't been for the 'social proof' of the support Darling was getting from the hand-picked audience.  So Ipsos-Mori have got a lot to answer for - and so have STV for commissioning them.  It's been a long while since I praised the BBC, but their approach of using audiences that are strictly 50/50 divided between Yes and No, with a sprinkling of undecideds added in, has a lot to commend it.

Incidentally, the Yes campaign can take huge heart from one particular aspect of the ICM poll - of respondents who were undecided about their referendum voting intention before the debate started, more thought that Salmond won (54%) than Darling (46%).  The only reason that Darling had a slight lead in the overall numbers is that people who are already on the No side were more likely to have been impressed by their man than Yes supporters were by Salmond - and that may simply have been the problem of Yes voters having higher expectations of the First Minister.

Hand on heart, I burst into uncontrollable laughter when Colin Mackay said at the end that the real winner of the debate was Bernard Ponsonby.  STV's moderator is undoubtedly a man of considerable talent, but surely it's obvious to anyone that he was a big part of what was wrong with the debate tonight.  Claire Stewart said that she didn't hear enough vision - well, does it ever occur to her that her own colleagues might be predominantly responsible for that?  You can only set out a vision if you're given the space to do so, and tonight's format was only a very mildly watered down version of the bear-pit debates that have been repeatedly served up on Scotland Tonight.  I can only hope that the BBC aim for a more thoughtful and considered pace in their debate.  As for whether Ponsonby was actually guilty of outright imbalance, it's hard to say, but I do think he was bang out of order at the start.  It's perfectly reasonable to ask Alex Salmond about "poll after poll" showing a No lead (even though a great many of those No leads have been extremely slender).  But if you're being fair and even-handed, what you then do is challenge Darling about the fact that the No lead has dramatically narrowed in the new Ipsos-Mori poll to a record low.  Instead Ponsonby repeated the "poll after poll showing a No lead" line, and put it to Darling : "you can't lose, can you?"  I mean, what?  WHAT?  Had Darling hypnotised him or something?

*  *  *

This post is meandering around in a slightly chaotic way, but there are still two other important points to make about the Ipsos-Mori poll. Firstly, when undecideds are pressed further, they break for Yes by 29% to 23%. It's not possible to calculate what the headline figures would be if these undecided leaners were added in (because Ipsos-Mori use only definite voters for the headline numbers), but it seems a reasonable guess that it would increase the rounded Yes vote to 43%.

Secondly, the sample size for the poll was a completely normal 1006. That means the mystery of why so many people have reported being interviewed by Ipsos-Mori recently has not been solved. My guess is that more than one poll has been in the field, and that the other one is an internal poll for a No-supporting client - quite possibly the UK government using taxpayers' money. Perhaps there's another explanation, but we'll see.

* * *

REQUIRED SWINGS

Swing required for 1 out of 6 pollsters to show Yes in the lead or level : 3.0%

Swing required for 2 out of 6 pollsters to show Yes in the lead or level : 3.5%

Swing required for 3 out of 6 pollsters to show Yes in the lead or level : 4.5%

Swing required for 4 out of 6 pollsters to show Yes in the lead or level : 5.5%


* * *

SCOT GOES POP POLL OF POLLS

There's been a lot of interest in the fact that ICM's instant poll shows voting intention numbers of Yes 47%, No 53%, which on the face of it represents a whopping 8% decrease in the No lead since the last ICM poll. That's certainly encouraging, but unfortunately I can't include it in the Poll of Polls update because it wasn't a full-scale poll (it was demographically weighted, but by definition anyone who didn't watch the debate was excluded). However, even just taking into account the new Ipsos Mori-figures, the updated Poll of Polls still shows the No lead slipping back to just 11% when Don't Knows are included.

MEAN AVERAGE (excluding Don't Knows) :

Yes 43.5% (+0.4)
No 56.5% (-0.4)

MEAN AVERAGE (not excluding Don't Knows) :

Yes 37.0% (+0.7)
No 48.0% (n/c)

MEDIAN AVERAGE (excluding Don't Knows) :

Yes 43.4% (n/c)
No 56.6% (n/c)


(The Poll of Polls is based on a rolling average of the most recent poll from each of the pollsters that have been active in the referendum campaign since September 2013, and that adhere to British Polling Council rules. At present, there are six - YouGov, TNS-BMRB, Survation, Panelbase, Ipsos-Mori and ICM. Whenever a new poll is published, it replaces the last poll from the same company in the sample. Changes in the Poll of Polls are generally glacial in nature due to the fact that only a small portion of the sample is updated each time.)

Can someone please explain to STV how debates are supposed to work?

Try to imagine a tennis umpire saying something like this -

"Advantage Djokovic.  Ladies and gentlemen, Mr Federer is challenging the call, on the left-hand baseline.  The ball was called out.

Call stands.  Advantage Djokovic.  Incidentally, ladies and gentlemen, I've just heard from the commentary box that John McEnroe feels that the Federer backhand is under severe pressure, and that the Swiss player has it all to do if he's not going to be broken in this game.  Word is also coming through from Ladbrokes that the odds on a Djokovic win have tightened since I announced that the Federer backhand is under pressure.  Play."

Or how about the moderator of a US presidential debate saying something like this -

"Each candidate will be allowed a two-minute introductory statement, and a three-minute closing statement.  I will also ensure that the time they receive to answer my questions is roughly equal.  We do have an audience present but they have agreed to remain silent.  Governor Romney won the toss and chose to make his introductory statement first, but before we go to him, let's have a look at our exclusive Gallup poll!  It shows that 57% of Americans feel that Governor Romney is smug, arrogant and out-of-touch.  Looks like you're fighting a losing battle here, Governor Romney, but feel free to give it a go anyway.  The floor's all yours."

Are you starting to see the point?  That would never happen in a million, zillion years, but what STV are planning for this evening isn't far short of such lunacy.  First of all, they shouldn't be starting a debate with a poll, full stop.  Debates are supposed to provide a neutral environment and an entirely level playing field for both sides to make their case, and for viewers to weigh up the arguments without the intrusion of extraneous factors.  It defeats the whole purpose if the debate's moderator informs viewers right at the outset that one side is "winning", and it self-evidently unbalances the playing-field.

But it's even worse that that, because this is a very unusual campaign in respect of the polling landscape.  In their leaders' debate at the start of the 2011 Holyrood campaign, STV did exactly the same thing (and as you can see here, I criticised them for it at the time), but at least their poll was reasonably representative of what all the pollsters were showing in that campaign.  The only real outlier in 2011 was YouGov, who were far too Labour-friendly.  But this time around, there is a huge disparity between different pollsters, and by choosing Ipsos-Mori - one of the two most No-friendly pollsters - STV are making a hugely political decision with huge political consequences.  They may not have admitted that to themselves, but that's the position.

To put it in perspective, the highest Yes vote that Ipsos-Mori have found at any point during this campaign is just 40%.  All but one of the firm's polls have put it below 40%.  Contrast that with ICM, Panelbase and Survation, all of whom at various times have put Yes as high as 47% or 48%.  Even YouGov and TNS-BMRB have had Yes as high as 42% and 44% respectively.  So if Bernard Ponsonby starts the debate by pointing to the poll and echoing his words of last night that "Alex Salmond has it all to do because No have a big poll lead", what he'll really mean is "Alex Salmond has it all to do IF our own house pollster is the most accurate, but nobody knows whether they are".  Will viewers realise that they're only being given half the story (if that)?  Some will, but most won't.

I should emphasise that it's a very good thing that STV commission polls - if they weren't doing it, we'd have no telephone polls at all in this campaign, which would be extremely unhealthy.  But there's a time and a place for everything, and the time and place for polls is in a news programme, not in a debate that is supposed to help people decide how they want to vote, as opposed to telling them how they are supposedly going to vote.

*  *  *

One thing I'll be looking out for is the sample size of the Ipsos-Mori poll.  If it's a standard sample of 1000, it won't explain why we've heard so many people report that they've been interviewed by the firm recently, because that certainly hasn't happened during previous STV polls (but of course it did happen during the UK government-commissioned mega-polls).  I still have suspicions that there may have been more than one Ipsos-Mori poll in the field over the last few days - although if tonight's sample turns out to be 5000+, it would probably solve the mystery.

Monday, August 4, 2014

Road race and closing ceremony photos

I didn't intend to go to either the opening or closing ceremony, but somehow I ended up going to both.  This time they weren't mucking around, though - my £15 seat really did live up to its "restricted view" billing.  But it had its advantages - athletes were scurrying up and down the stairs beside me all evening, many of them from Team Scotland.  There were two women a few rows in front of me who were determined to get selfies with as many athletes as possible, so that gave me the opportunity to take a few snaps!

I dutifully bought a £2 saltire before I went in, and although it was a pain in the neck, I did my best to wave it at moments of maximum patriotic fervour, such as when Prince Imran declared Glasgow 2014 the best Games ever, and when Dougie MacLean sang Caledonia.  However, as I was in the ultra-cheap section, I have a feeling my efforts may have been in vain as far as the TV cameras were concerned...

I don't know how the ceremony came across on TV, but I must say that I didn't cringe at all this time (except maybe during the opening part of the Gold Coast presentation, and we can hardly take the blame for that).