Marking 20 years
of bold journalism,
reader supported.
Mediacheck
Federal Politics
Election 2015
Media

Four Reasons to Stop Sharing Nationwide Election Polls

They're misleading and unhelpful, so post riding-level data instead.

Heather Libby 16 Sep 2015TheTyee.ca

Heather Libby is a writer, designer, researcher and optimist living in Vancouver. This October she's leading a Tyee Master Class called "Memecamp! How to Create Content that Inspires Change." Sign up and learn more here.

This national election coverage is possible thanks to the generous financial support of Tyee Builders. Please consider joining.

I miss the cat pictures.

Only five weeks ago, my Facebook feed was awash in the usual social media nonsense -- pets, food, pop culture listicles and smiley kids with cake-smeared cheeks. Then the writ dropped and everything changed.

Friends who once Instagrammed artfully-arranged bowls of quinoa and veggies started mapping voter intention trends. Media junkies swapped Kim and Kanye for Nanos and Grenier. For a time, I was exhilarated. I thought the polls I shared and analyzed gave a sharp, factual clue of what could be expected of Canadians on Oct. 19.

There's just one problem. Hardly any of them actually do that.

Here's why I solemnly pledged to ignore all national polls in favour of local candidate-level data this election.

1. We don't vote for PM

Even though a third of America's eighth graders think Canada is a fascist dictatorship, we're actually a parliamentary democracy where voters don't pick prime ministers, political parties do. Only voters in the ridings of Calgary-Southwest, Papineau and Outremont are potentially casting ballots for the prime minister (and really, they're just electing a member of Parliament whose party has selected them as leader).

Unless you live in a swing riding that multiple parties are battling for, you'll probably never see a poll specifically asking which candidate voters in your area support. Why? Because polling all of Canada's 338 ridings individually is prohibitively expensive and time consuming. So, pollsters ask broad questions about which party or leader voters plan to support, then apply a proprietary methodology on that data to predict seat numbers.

Eric Grenier of ThreeHundredEight.com explains his projection method, based on the difference between results of the last election and current polls: "Put simply, if a party managed 20 per cent in a given region in the previous election and is now polling at 40 per cent in that same region, their results in each individual riding would be doubled."

This seems sensible, aside from two key points.

2. Regions aren't ridings

Regions aren't ridings, and sample sizes vary between polls. Of Canada's eight national polling firms (Nanos, Ekos, Ipsos, Forum, Innovative Research, Leger Marketing, Angus Reid and Abacus), seven use sample sizes of between 950 and 2,600 Canadians as a representative of our 35.7 million-person population. That excludes Angus Reid, which polled 6,226.

These numbers break down further by province or region (excluding the territories) according to population. In the latest Nanos Research poll, that's as follows:

Atlantic Canada: 106 persons
Quebec: 275 persons
Ontario: 330 persons
Prairies: 209 persons
British Columbia: 159 persons

Of those 106 Atlantic Canadians, there's no way to see what ridings are represented. A person living in Gander, Newfoundland looking for an idea of how his or her neighbours plan to vote may not actually see the voting intention of anyone living in the same riding -- or the same province, for that matter.

3. Demographic blind spots

Methods used to reach poll participants -- either by cold-calling telephone customers with live operators (Nanos Research), cold-calling telephone customers with an automated system (Forum Research and Ekos), or sampling internet users (Angus Reid, Ipsos, Abacus Data, Leger Marketing and Innovative Research) -- can exclude important demographics.

According to Angus McAllister of McAllister Opinion Research, landline polls oversample the elderly and grossly undersample young adults -- especially working couples with young kids and students. Online polls lack the sample density to track opinions at a riding level, and tend to oversample young adults and undersample the elderly. Mobile telephone polls are prohibitively expensive, often costing four times as much as landline polls per completed interview.

4. No historical context

The final issue is historical context: did the poll participant vote in 2011? Has their vote changed? Only Ipsos, Leger Marketing and Angus Reid specify that their participants are eligible to vote; all others simply say participants are Canadians 18 and older. Since 39 per cent of Canadians did not vote in 2011, knowing who did vote and for whom would help ground statements of votes lost or gained by parties in real data.

Understanding all of this takes a poll headline from "Major Federal Parties Gripped in Very Tight Three Way Race" to "Between Sept. 8 and 10, 1,200 Canadian telephone owners participated in a nationwide survey and said if an election were held that day, 30.8 per cent would vote Liberal, 30.8 per cent would vote Conservative and 29.9 per cent would vote NDP; we didn't ask about ridings, candidates, their motives or whether they're even registered to vote."

In other words, take results with several grains of salt -- especially if they've asked who voters prefer as prime minister. After all, the election is weeks away. Canadians may still change their minds in the voting booth as we saw in British Columbia in 2013, Ontario in 2014 and in the U.K. general election earlier this year.

Take the political poll pledge!

So, what's to be done? First of all -- and really, this goes without saying -- mark off some time on your schedule to vote on Oct. 19. Next: take the following pledge to help keep unhelpful opinion data off social media for the next 33 days.

Please raise your right hand and repeat after me:

Between now and Oct. 19, I pledge to only share polling data that reflects voter intention at the riding level. I know there's absolutely no reason to pay attention to nationwide polls of 1,000 random people, particularly if the poll asks whom they would vote for as prime minister. I accept that those polls are misleading and unhelpful. Instead, I pledge to help the party I support by ensuring I only promote data that is realistic and local, particularly if I live in a competitive riding. I shall not waver from my pledge, no matter what the CBC Poll Tracker says. Namaste.  [Tyee]

  • Share:

Facts matter. Get The Tyee's in-depth journalism delivered to your inbox for free

Tyee Commenting Guidelines

Comments that violate guidelines risk being deleted, and violations may result in a temporary or permanent user ban. Maintain the spirit of good conversation to stay in the discussion.
*Please note The Tyee is not a forum for spreading misinformation about COVID-19, denying its existence or minimizing its risk to public health.

Do:

  • Be thoughtful about how your words may affect the communities you are addressing. Language matters
  • Challenge arguments, not commenters
  • Flag trolls and guideline violations
  • Treat all with respect and curiosity, learn from differences of opinion
  • Verify facts, debunk rumours, point out logical fallacies
  • Add context and background
  • Note typos and reporting blind spots
  • Stay on topic

Do not:

  • Use sexist, classist, racist, homophobic or transphobic language
  • Ridicule, misgender, bully, threaten, name call, troll or wish harm on others
  • Personally attack authors or contributors
  • Spread misinformation or perpetuate conspiracies
  • Libel, defame or publish falsehoods
  • Attempt to guess other commenters’ real-life identities
  • Post links without providing context

LATEST STORIES

The Barometer

Do You Think Naheed Nenshi Will Win the Alberta NDP Leadership Race?

Take this week's poll