Topic: survey methodology


6 Ways to Pretest Your Survey Before You Send It

Running your survey through a series of tests to check for potential problems can save you a lot of headaches down the road and ensure that you get the data that you want. In this post we discuss six different strategies for testing surveys before starting your data collection.

Read More
Using Attention Checks in Your Surveys May Harm Data Quality

Thinking of checking up on respondent attention mid-survey to make sure that you’re getting good data? Think again. In this article, we highlight how new findings from our Qualtrics Methodology Lab are helping us to revisit and refine advice that is commonly given to survey researchers, namely the use of attention check questions to ensure […]

Read More
Survey Speeding, Part 2: Designing Surveys to Avoid Harm

Previously we highlighted some of the concerns surrounding people that appear to respond very quickly to surveys. While concerns about survey speeding are valid, there are indications that the solution is not to simply throw out these respondents from your dataset.   Despite the evidence that speeders don’t really appear to be doing that much […]

Read More
Survey Speeding, Part 1: Is It Harmful or Harmless?

If you’ve ever looked at completion times for individual questions or an entire questionnaire, you’ve probably noticed that there can be a lot of variation. Some respondents are slower than you expect, some are in your expected range, and some are faster than you expect. If the fast completion times trouble you in particular, you’re […]

Read More
4 Easy Ways to Optimize Your Survey for Mobile Devices

Think of all the tasks we use our phones or tablets for these days—from filling out applications, to coordinating travel arrangements, to catching up on favorite shows. When you ask people to take an online survey, you should expect that a significant portion of your respondents will complete the survey on a mobile device.

Read More
3 Reasons Why Shorter Surveys are Not Always Better

Shorter surveys generally have higher completion rates and take less time to complete. As a result, many survey designers attempt to make their surveys as short as possible. However, in many cases, asking fewer questions might actually hurt your ability to get the insights that you need from your data.

Read More