- Words are often used in different ways by different people; your goal is to write questions that each person will interpret in the same way.
- A good question should be short and straightforward.
- A questionnaire should not be too long, use plain English and the question shouldn't be difficult to answer.
- Only through careful writing, editing, review, and rewriting can you make a good questionnaire.
- Survey items have two separate parts: the question and the answer. The distinction is important. A good question not only asks for information clearly, but elicits useful responses.
The following provides you with guidelines for conducting your surveys:
Remember your survey's purpose
All other rules and guidelines are based on this one. There was a reason you decided to spend your time and money to do your survey, and you should ensure that every question you ask supports that reason. If you start to get lost while writing your questions, refer back to this rule.
Write a short questionnaire... Above all, your questionnaire should be as short as possible. When drafting your questionnaire, make a mental distinction between what is essential to know, what would be useful to know and what would be unnecessary. Retain the former, keep the useful to a minimum and discard the rest. If the question is not important enough to include in your report, it probably should be eliminated.
If in doubt, throw it out
This is another way of stating the first rule, but it is important enough to repeat. A question should never be included in a survey because you can't think of a good reason to discard it. If you cannot come up with a concrete research benefit that will result from the question, don't use it.
Use simple words... Survey recipients may have a variety of backgrounds so use simple language. For example, "What is the frequency of your automotive travel to your parents' residents in the last 30 days?" is better understood as, "About how many times in the last 30 days have you driven to your parent's home?"
Stay focused - avoid vague issues
If you ask "When did you last see a movie?" you might get answers that refer to the last time your respondent rented a video, when you are really interested in the last time the respondent went out to a movie theater.
Consider too, "Please rate your satisfaction with the service you have received from this company." This is a fine general question, but will not likely lead to any specific action steps. Particular elements of service must be probed if responses are to result in specific recommendations.
If a question can be misinterpreted, it will be
"What time do you normally eat dinner?" will be answered differently by people living in different regions; "dinner" can refer to either the midday or the evening meal. Be clear, concise, always beware of imprecise language and avoid double negatives. Identify even commonly used abbreviations to be certain that everyone understands.
Start with interesting questions... Start the survey with questions that are likely to sound interesting and attract the respondents' attention. Save the questions that might be difficult or threatening for later. Voicing questions in the third person can be less threatening than questions voiced in the second question. For example, ask:
"How do your colleagues feel about management?" rather than "How do you feel about management?"
Include only one topic per question (avoid "double-barreled" questions)
How would you interpret the responses to "Please rate your satisfaction with the amount and kind of care you received while in the hospital." or, a question asking about speed and accuracy? If you want to be able to come up with specific recommended actions, you need specific questions.
Make sure the respondent has enough information
Asking respondents "How effective has this company's new distribution program been?" may not be as effective as "Recently, we implemented a new, centralized distribution system. Did you know this?" Followed by "Have you seen any positive benefits resulting from this change?" It can be beneficial to break down questions that require background information into two parts: a screening item describing the situation which asks if the respondent knows about it, and a follow-up question addressing attitudes the respondent has about the topic.
Avoid leading questions
It is easy, and incorrect, to write a question that the respondent believes has a "right" answer. "Most doctors believe that exercise is good for you. Do you agree?" is an example of a leading question. Even the most well-meaning researcher can slant results by including extraneous information in a question. Leading questions can be used to prejudice results.
Leading questions demand a specific response. For example: the question "Which day of the month is best for the newly established company-wide monthly meeting?" leads respondents to pick a date without first determining if they even want another meeting.