This article is part 1 in a 6-part series on employee surveys. Read parts 2, 3, 4, 5 and 6.
In employee surveys (think of a Likert-type scale ranging from Strongly Disagree to Strongly Agree), 5-point scale types are what you most commonly find.
And in many situations, 5-point scales are just fine. (Psychological and sociological researchers use them to great effect.) However, in the world of employee surveys, the 5-point scale has a fatal flaw.
Five-point scales were designed for situations where the data has a reasonable chance of being normally distributed; where there are decent odds that as many people will score 1s as they do 5s.
For example, if you asked 1,000 random people to rate the statement, “Orange is a more fashionable color than green,” you’re going to get a wide variety of responses. Some people hate orange, while others love it. The same goes for green. And then there are the folks who feel so-so about both colors. You could ask any number of questions and get a similarly wide spread of statements (e.g., The Yankees are the best baseball team. The best condiment for hot dogs is mustard. Red is a good color for cars. I feel happy today.). In all these situations, a 5-point scale works just fine because the responses will be so varied.
But inside an organization, the 5-point scale loses its effectiveness. Inside organizations, 5-point survey results tend to be skewed and have less variability than the population at large. In other words, you won’t get nearly as many 1s as 5s.
Does your employee survey use a 5-point scale? Does it ask if your employees are “satisfied”? Chances are your employee survey is committing one of the “Deadly Sins of Employee Engagement Surveys.” Download our FREE white paper and find out now. Click here to learn more.
If you ask a group of employees at ACME Inc. to rate the statement, “ACME is a good place to work,” you’re not going to get very many low responses (i.e., 1s and 2s). That’s because if you truly thought ACME was an awful place to work, you probably would have quit already. By virtue of being an employee at ACME, you’re saying, “Well, it can’t really be all that bad because I keep showing up.”
When you survey people who have said the company is decent (judging by the fact that they show up every day), your survey results will be skewed towards Strongly Agree, and there won’t be much variability in the responses. In the majority of the 5-point employee surveys we’ve seen, there really isn’t a 5-point scale; it’s more like a 3-point scale. Can you really say you’re using a 1-to-5 point scale if all the responses come out 3, 4 or 5?
Nobody in their right mind is going to use a 3-point scale for an employee survey. It would essentially limit the choices to: “Everything’s Bad,” “Everything’s Great,” or “It’s So-So.” And in the real world, things aren’t quite so black-and-white. There’s a notable difference between the grades A and a B, or between an A and a B+, or even an A and an A-. If you’re comfortable grading your organization on Pass/Fail, which is kind of what you’re doing when you get this very low spread of data, then go for it. But when an employee quits, it’s probably not for an “everything’s bad” reason, like the manager is the Devil incarnate, none of the computers work, and all my coworkers are low performing losers. It’s likely to be a bit more subtle than that; something the data results of a 5-point scale won’t even begin to reveal.
If your employees aren’t giving 100%, wouldn’t you like to know just how far away they are from 100%? Do you really want to limit yourself to, “It’s 100% or nothing?”
When I’ve held the position of CEO, I always wanted to know just how far away from 100% we really were. That’s what told me how many resources to mobilize and what specific actions to take. There’s a big difference between missing your sales targets by 1% and missing them by 50%. With a 5-point scale (which de facto becomes a 3 point scale), you’ll never know which it is; you’ll only know you missed your target.
This isn’t the only bad news about 5-point scales. When you conduct employee surveys every year (or two), ceiling effects and restriction of range your ability to track your progress. Employee surveys often assess very subtle issues, and the interventions that follow often make numerically small, but very significant, changes. But if you’re only getting 3 different responses, how do you see progress? Can you really assess your changes if your scale doesn’t distinguish between decent, good and great?
The easy resolution is a 7-point scale, which will accurately assess your employees. Now, it’s true that because you’re assessing a biased pool of respondents, you will still see some skewing on a 7-point scale (you won’t get lots of 1s and 2s). In fact, what you’ll end up with is basically a 5-point scale.
Does your employee survey use a 5-point scale? Does it ask if your employees are “satisfied”? Chances are your employee survey is committing one of the “Deadly Sins of Employee Engagement Surveys.” Download our FREE white paper and find out now. Click here to learn more.
Read part 2, Employee Surveys: Don’t Ask Questions You Can’t Fix, now.