Leadership Barometer 104 Why Employee Surveys Fail

August 4, 2021

We have all been exposed to an employee satisfaction survey at some point in our working lives.  For some of us, the idea of filling out yet another QWL (Quality of Work Life) survey is about as appealing as having a root canal. 

I have witnessed a significant hit to morale in many groups as a result of these attempts by management to gather information. 

Let’s examine ten reasons why employee surveys cause problems and suggest some antidotes that can make a big difference.

  1. Questionable anonymity – Nearly all QWL surveys are advertised by managers as being anonymous. This is to encourage people to share information without fear of repercussion. Unfortunately, nearly all surveys these days are conducted electronically.

Most people are aware that anything online can be traced, if a smart IT technician is assigned to the case.  People simply do not believe the promise of anonymity, which lowers the validity of the data. 

One action that can help is to have a shop floor person (perhaps a known skeptic) participate in the data analysis phase, so he or she can verify personally that the managers do not know who said what. 

If you claim anonymity but are quietly keeping track on the side out of curiosity, then there is no hope for you, and you should get out of the leadership occupation immediately.

  1. Poorly worded questions – many managers believe that putting together a survey is a simple matter of writing a few questions about how people feel. Actually, survey design is a rather complex and exacting science.

There are numerous ways to present questions that will yield meaningless (or at least ambiguous) information. There are also some methods that will generally produce usable data. The cure for this problem is to have someone who is trained on survey questions actually construct the instrument. If you have not had at least one course in experimental research design, then it is best to leave the matter to someone who has.

  1. Long and tedious survey – It is not uncommon for QWL surveys to contain over 100 detailed questions. It is amazing that the designers of these surveys do not realize the obvious fatigue factor involved in completing one of these burdensome questionnaires.

A much more accurate reading can be obtained by keeping the number of questions to 20 or less.  This can be accomplished by paying attention and only asking important questions.  Leaving out the fluff can cut the time to take a survey by more than half.

  1. Management interprets the information as they please – It is frustrating to witness how managers wave away complaints or gripes on surveys as simple whining. Or they might shrug their shoulders and say, “there is absolutely nothing we can do about this issue,” so they consider the input as moot.

The antidote here is to not ignore input regardless of how painful it is or how frivolous it seems. All input needs to be considered valid and not assumed away with some convenient rationalization.

  1. “Nothing ever changes” – This is a common theme on the shop floor. “We take these stupid surveys, but nothing ever changes.” The antidote to this habitual problem is to actually take concrete actions based on the survey, then (and this is the part most managers forget) advertise that the changes are being made as a result of the QWL survey.

Rather than saying, “We are going to add a second brief afternoon break,”  say “As a result of your input in the recent survey, we are changing the break rules to allow a short second break in the afternoon. As always, we appreciate your candid feedback.”

If managers do not make a conscious effort to communicate that changes are the result of input, people will usually not make the connection.  Once a change is made and it becomes habit, people forget that there was a change, so the perception of “nothing ever changes” is common.

  1. Managers try to react but do the wrong thing – It is far better to let the shop floor people be involved in decisions of how to improve conditions based on survey results. It may take a little more time, but the quality of process changes will be far better if those impacted the most have a say in their invention. They will make the changes work rather than wonder and push back at the clueless inventions of upper management.
  1. Managers reacting to the vocal minority rather than the silent majority – This problem is common when surveys give the opportunity for open-ended comments. People on the fringe can give strong input, and managers might mistakenly interpret this to be the will of the majority.

The simple antidote to this problem is to verify that a strong message really does come from several individuals rather than one highly disgruntled outlier.

  1. Survey not tested for validity – For a survey to be useful, it needs to measure the phenomena it purports to measure. There are statistical techniques for determining if an instrument has validity.

You may not have the time or money to invest in a professional survey designer to test the validity of an instrument, but at least you should ask the question of whether you are actually getting valid information.

  1. No thought to reliability – The reliability of a survey is different from validity. For a survey to be reliable, it should produce a similar result if repeated and there have been no changes in processes since the last survey was taken.

If survey results are all over the map when nothing in the environment in changing, it is a sign that the instrument is not reliable (repeatable).

  1. Poorly communicated – When surveys are sent out, the cover letter explaining the purpose and process is a critical document. Many managers have an administration person whip out a paragraph of “management speak” like this.

  “It is vital that we know what people in our operation think in order to continually improve working conditions.  Please take the time to fill out this anonymous survey that will give us the information. Thank you.” 

Here is a different note where the manager took the time to set up the survey for success.

“We are going to re-do our strategic plan, and it is important to include your input before making changes. The attached survey will begin the process.  Before you take this survey, please reflect on the following points:

    • The survey really is anonymous – we will have shop floor people help with the analysis to verify no names are attached to the data.
    • We will summarize the data for you as soon as it is received.
    • We will use the information as the basis for a series of meetings (you are invited to participate) on how this business can be improved.
    • We will be making changes based on the results of this survey.
    • We are all part of making this organization a success.”

With an introduction like that, employees will know this survey will likely have some impact and their viewpoints matter.

It is critical to not waste credibility, time, and energy on a poorly designed and administered QWL survey. If the above 10 points are considered when designing an employee survey, it will produce results that can be the basis of solid organizational progress.

The preceding information was adapted from the book Leading with Trust is like Sailing Downwind, by Robert Whipple. It is available on www.leadergrow.com.

 

Robert Whipple is also the author of The TRUST Factor: Advanced Leadership for Professionals and, Understanding E-Body Language: Building Trust Online. Bob consults and speaks on these and other leadership topics. He is CEO of Leadergrow Inc. a company dedicated to growing leaders.


Trust and Solving Problems

July 18, 2015

When low trust teams have to tackle real problems, it can be a disaster. The interpersonal issues keep getting in the way.

If you can build high trust into the team dynamic, then the efficiency of solving problems goes up dramatically.

It is important to assess the level of trust on every team. I have developed a quick survey that can be very helpful at understanding the level of trust on your team. If you would like access, just drop me a line.

There are numerous other surveys available online if you just do a quick search.

I sit on several Boards of Directors, and one of them is a pretty low trust group. When a problem comes up, it seems the team is always tiptoeing around the interpersonal issues.

We can discuss things for an hour and not get close to the real problem at hand. We quite often end up putting “BandAids”® on the symptoms hoping the problem will resolve itself.

We all know the world does not work that way.

Another BOD I sit on is a particularly high trust group. They solve problems quickly and efficiently because they get to the heart of the issue fast without playing games with each other.

One hallmark of high trust groups is that they solve problems quickly and with high quality solutions while having fun. Low trust groups often fail to solve the real problem and frequently have to deal with a lot of acrimony.

Exercise for you: Take the time today to do an assessment of the trust level on your team. This is especially important if your team seems to struggle at times. Make sure all members of the team take the instrument and share the data.

If trust is lacking, then get a commitment to do something about it.

Putting up with interpersonal issues that result from low trust is a sign of mediocrity. You can move to excellence simply by investing some time and energy into raising the trust level. It is not impossible, and your team will become much more efficient.

The preceding was derived from an episode in “Building Trust,” a 30 part video series by Bob Whipple “The Trust Ambassador.” To view three short (3 minutes each) examples at no cost go to http://www.avanoo.com/first3/517


How Trust Helps Solve Problems

April 18, 2015

Leadership SolutionsThe level of trust in a group has a profound impact on the ease with which they solve problems.

I sit on several Boards of Directors, and one of them is a pretty low trust group. When a problem comes up, it seems the team is always tiptoeing around the interpersonal issues.

Low trust groups often fail to solve the real problem and frequently have to deal with a lot of acrimony, often unrelated to the problem.

This low trust group can discuss things for an hour and not even get close to the real problem at hand. We quite often end up putting “BandAids” on the symptoms hoping the problem will resolve itself. We all know the world does not work that way.

It is very frustrating because we waste a lot of time and energy with low output.

Another BOD I sit on is a particularly high trust group. They solve problems quickly and efficiently because they get to the heart of the issue fast without people playing games with each other. One hallmark of high trust groups is that they solve problems quickly and with high quality solutions while having fun.

The quality of solutions is higher because people are not afraid to voice creative ideas. They don’t need to protect themselves from ridicule. Brainstorming possible actions is spontaneous, light, and often comical.

It is important to assess the level of trust on every team. There are numerous surveys available online if you just do a quick search. As an alternative, I have developed a quick survey that can be very helpful at understanding the level of trust on your team. It is available at the following link

https://www.surveymonkey.com/r/ZZGQVD3 .

Take the time today to do an assessment of the trust level on your team. This is especially important if your team seems to struggle at times. Make sure all members of the team take the instrument and share the data.

If trust is lacking, then get a commitment to do something about it. Here is a link to several articles about trust on my Leadergrow Website

http://www.leadergrow.com/articles/categories/17-trust

Putting up with interpersonal issues that result from low trust is a sign of mediocrity. You can move to excellence simply by investing some time and energy into raising the trust level. It is not impossible, and your team will become much more efficient.


Don’t Do A Survey

February 26, 2012

In most organizations, when managers want to know how people are feeling, they do a QWL (Quality of Work Life) survey to find out. I there are more direct ways to identify what people are thinking. By simply discussing the need for a survey, the most insightful data is already spilled all over the table. To mop it up, you need to improve the level of trust in your organization.

Taking an employee engagement survey usually does not reveal trust weaknesses or their causes because in low trust environments people will either not be totally honest or be turned off by yet another survey to gather data.

Most people believe the data will sit in a desk drawer anyway, and it will not provide real change. How many times have you heard employees say, “They keep doing these satisfaction surveys, but nothing ever changes around here”?

Taking a survey feels like progress to a management team with their hearts in the right place. They believe they can dig in and really understand the problems in depth, but I believe there is a far easier and more accurate way to get the data in most cases.

In an environment of high trust, the information about what is working well and what needs to change is as ubiquitous as the air we breathe. People do not need to fill out boxes in a computerized screen to identify the most pressing needs. Improvement opportunities will be offered up continuously, and action can be taken immediately, not after 11 staff meetings to discuss the 27-page summary of the employee satisfaction survey.

The illusion of progress made by taking a survey happens in nearly every organization because managers are not thinking of alternative methods. Besides, the survey gives managers something to talk about and point at to demonstrate they care and are trying to understand.

A better way to make progress is to identify which management behaviors are causing people to hold back the truth out of fear for their job or something else. Rather than contemplating an employee satisfaction survey, Management should be asking themselves questions such as:

1. How can we change the culture to eliminate the need to take surveys in the future?

2. How can we modify the way we interact with people so we always know what is on their minds when problems are small and can be easily resolved?

3. How can we get more time in the workplace to chat with people rather than be cooped up in our offices composing e-mails, or sitting in boring meetings?

4. How can we continually test our understanding of what is happening in the hearts of people by listening and watching their body language?

5. Why do we have an insular management team? When we look around the room, why do we not see more workers in our meetings?

6. Why do the people think our values are not consistently practiced? We say people are our most valuable asset, but do we always make decisions that support that ideal?

7. Why are our goals not fully understood or supported by the people doing the work?

If management energy is focused on creating a real environment where people are not playing games with each other in order to survive, then improvement ideas will flow like water down a mountain stream. If the culture is frozen by fear, the resulting ice makes it necessary to have a blast from a survey in order to move the water, and the data will not be accurate due to fear or apathy.

The survey blast does not change the underlying cause and thaw things out to a more fluid state. It only temporarily provides questionable data so there is an appearance of progress. If managers and leaders would ask questions like the ones above and seek to gain information in those ways, the progress will be far easier to achieve and more robust.


Few Employee Surveys Work

January 30, 2011

We have all been exposed to an employee satisfaction survey at some point in our working lives. For some of us, the idea of filling out yet another QWL (Quality of Work Life) survey is not nearly as appealing as having a root canal. I have witnessed a significant hit to morale in many groups as a result of these attempts by management to gather information. Let’s examine why employee surveys cause problems and suggest some antidotes that can make a big difference.

1. Questionable anonymity – Nearly all QWL surveys are advertised by managers as being anonymous. This is to encourage people to share information without fear of repercussion. Unfortunately, nearly all surveys these days are conducted electronically. Most people are aware that anything online can be traced, if a smart IT technician is assigned to the case. People simply do not believe the promise of anonymity, which lowers the validity of the data. One way to give slightly more confidence in the integrity of the process is to include a statement such as this at the end of the form, “You do not have to type your name on this survey because it is anonymous. We will pay no attention to who you are if you do not sign the document. However, some people do wish to be contacted personally to give further input that might not be adequately covered on the survey. For that reason, there is a line to give your name if you wish. Someone will get back to you.”

Of course, no statement by management is going to convince the die-hard skeptics, but this explanation will assist most people. Another action that can help is to have a shop floor person (perhaps a known skeptic) participate in the data analysis phase, so he or she can verify personally that the managers do not know who said what.

If you claim anonymity but are quietly keeping track on the side out of curiosity, then there is no hope for you, and you should get out of the leadership occupation immediately.

2. Poorly worded questions – many managers believe that putting together a survey is a simple matter of writing a few questions about how people feel. Actually, survey design is a rather complex and exacting science. There are numerous ways to present questions that will yield meaningless (or at least ambiguous) information. There are also some methods that will generally produce usable data. The cure for this problem is to have someone who is trained on survey questions actually construct the instrument. If you have not had at least one course in experimental research design, then it is best to leave the matter to someone who has.

3. Long and tedious survey – It is not uncommon for QWL surveys to contain over 100 detailed questions. It is amazing that the designers of these surveys do not realize the obvious fatigue factor involved in completing one of these burdensome questionnaires. A much more accurate reading can be obtained by keeping the number of questions to 20 or less. This can be accomplished by paying attention and only asking important questions. Leaving out the fluff can cut the time to take a survey by more than half.

4. Management interprets the information as they please – It is frustrating to witness how managers wave away complaints or gripes on surveys as simple whining. Or they might shrug their shoulders and say, “there is absolutely nothing we can do about this issue,” so they consider the input as moot. The antidote here is to not ignore input regardless of how painful it is or how frivolous it seems. All input needs to be considered valid and not assumed away with some convenient rationalization.

5. “Nothing ever changes” – This is a common theme on the shop floor. “We take these stupid surveys, but nothing ever changes.” The antidote to this habitual problem is to actually take concrete actions based on the survey, then (and this is the part most managers forget) advertise that the changes are being made as a result of the QWL survey. Rather than saying, “We are going to add a second brief afternoon break,” say “As a result of your input in the recent survey, we are changing the break rules to allow a short second break in the afternoon. As always, we appreciate your candid feedback.” If managers do not make a conscious effort to communicate that changes are the result of input, people will usually not make the connection. Once a change is made and it becomes habit, people forget that there was a change, so the perception of “nothing ever changes” is common.

6. Managers try to react but do the wrong thing – It is far better to let the shop floor people be involved in decisions of how to improve conditions based on survey results. It may take a little more time, but the quality of process changes will be far better if those impacted the most have a say in their invention. They will make the changes work rather than wonder and push back at the clueless inventions of upper management. It is better to have workers inside the tent piddling out, than outside the tent piddling in.

7. Managers reacting to the vocal minority rather than the silent majority – This problem is common when surveys give the opportunity for open-ended comments. People on the fringe can give strong input, and managers might mistakenly interpret this to be the will of the majority. The simple antidote to this problem is to verify that a strong message really does come from several individuals rather than one highly disgruntled outlier.

8. Survey not tested for validity – For a survey to be useful, it needs to measure the phenomena it purports to measure. There are statistical techniques for determining if an instrument has validity. You may not have the time or money to invest in a professional survey designer to test the validity of an instrument, but at least you should ask the question of whether you are actually getting valid information.

9. No thought to reliability – The reliability of a survey is different from validity. For a survey to be reliable, it should produce a similar result if repeated and there have been no changes in processes since the last survey was taken. If survey results are all over the map when nothing in the environment in changing, it is a sign that the instrument is not reliable (repeatable).

10. Poorly communicated – When surveys are sent out, the cover letter explaining the purpose and process is a critical document. Many managers have an administration person whip out a paragraph of “management speak” like this. “It is vital that we know what people in our operation think in order to continually improve working conditions. Please take the time to fill out this anonymous survey that will give us the information. Thank you.” Here is a different note where the manager took the time to set up the survey for success.

“We are going to re-do our strategic plan, and it is important to include your input before making changes. The attached survey will begin the process. Before you take this survey, please reflect on the following points:
• The survey really is anonymous – we will have shop floor people help with the analysis to verify no names are attached to the data.
• We will summarize the data for you as soon as it is received.
• We will use the information as the basis for a series of meetings (you are invited to participate) on how this business can be improved.
• We will be making changes based on the results of this survey.
• We are all part of making this organization a success.”

With an introduction like that, employees will know this survey will likely have some impact and their viewpoints matter. It is critical to not waste credibility, time, and energy on a poorly designed and administered QWL survey. If the above 10 points are considered when designing an employee survey, it will produce results that can be the basis of solid organizational progress.