The Power and Pain of Polling
In North America, we poll on anything we can imagine. From toilet paper preferences to preferred political leaders. We poll and poll and use those results to make a host of decisions. Most of us either believe that polling results are completely useless or absolutely insightful. Sometimes they are both. After all, an insight into how I feel about something today is not necessarily an indicator of how I will behave tomorrow. So we poll again tomorrow to see if the answer has changed and if it has, we poll again in an attempt to determine what influenced that change.
The concept of public opinion as we understand it was first coined by French Foreign Affairs Secretary, Jean-Jacques Rousseau in 1774 and American newspapers started using polling techniques in the 1820s. However, polling in Canada didn’t really take root until the 1960’s. In 1959 the Quebec Liberal Party first used a poll to determine their election strategy for the 1960 election; by 1965 Canadian newspapers were well engaged in the practice of polling. Today, newspapers and political parties are strong adherents to the power of polling and most polling companies have an affiliation with either a newspaper or a political party. There is of course polling related to commercial ventures. These are lucrative activities and dominate the polling landscape. If you own a business, sell a product or service you’ve probably conducted polls of your own or reviewed existing polls about your customers, market or sector.
Despite the popularity of polling, there are always questions about the accuracy of polls. The methodology is often called into question if companies conducting similar polls get significantly different results. These differences are a reflection of the quality, tone and tenure of the questions asked. The answers are also influenced by who was asked. After all, if you were to poll a riding that has strong conservative roots, you are unlikely to obtain results that support Liberals and vice-versa.
In May 2013, folks in British Columbia were surprised to discover that they still had a Liberal government after the votes were counted in their provincial election. Their surprise and that of the pundits and pollsters came because polls had been clear that the New Democratic party was well in the lead.
“I haven’t trusted polls since I read that 62% of women had affairs during their lunch hour.
I’ve never met a woman in my life who would give up lunch for sex.”
Erma Bombeck, U.S. Humourist
More recently we saw shock move across the U.S. and the world when Donald Trump became the president of the United States. One pollster had been so certain of Hilary Clinton’s win that he had offered to eat a bug if he was wrong. One of the most popular approaches or survey techniques is to randomly select individuals and ask them a series of carefully crafted questions. The questions are generally created to avoid bias in the answer. The responses are then tabulated and reported on. While there are a number of ways of gathering information, the thing to consider when you look at polls is that no amount of data regardless of how accurately gathered will be worthwhile unless you can interpret results accurately. In effect, if the act of polling is a science, then the analysis of polls is an art. The ability to not only interpret but achieve insight into how respondents are likely to react is what makes good polling companies worth their weight in gold.
If you are unclear about what I mean, consider the difference between two questions:
- Do most Canadians want their elected officials to behave in a decorous fashion?
- Do most Canadians expect their elected officials to behave in a decorous fashion?
Although the questions appear to be almost identical, they will likely elicit completely different responses. What Canadian’s want and what they expect to get can be completely different things. Do you want your kids to listen to everything you say? Do you expect them to listen to everything you say? Understanding these distinctions is what real pollsters bring to the table.
What do you think about polling? Do you pay attention to polls? Do you participate in them?
- Polls might not be capable of predicting elections’: How everyone blew it on Trump’s huge upset
- BC pollsters revising methods after unexpected Liberal majority (globalnews.ca)
- Gallup’s 2012 election polling errors were only part of the problem | Henry Enten (guardian.co.uk)