Skip to main content
Loading...
  • Customer Experience
    Customer Experience
  • Employee Experience
    Employee Experience
  • Brand Experience
    Brand Experience
  • Product Experience
    Product Experience
  • Core XM
    Core XM
  • Design XM
    Design XM

Response Quality Functionality

What's on This Page:


Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!


About Response Quality Functionality

Response Quality is a lot like ExpertReview, but instead of assessing the quality of your survey, Response Quality tells you the quality of the data you have collected. It can also help you filter for this data, making it easier for you to clean your data at the end of your research.

Qtip: Response Quality can assess poor completion rate, poor completion rate within a 24 hour window, bots, duplicates, and requests for sensitive data. For more on how responses are flagged, see Response Quality.

Enabling Response Quality Detection

Response Quality will check  the survey’s completion rate and respondents’ speed without any additional settings being enabled. However, in order to detect bots, duplicates, or sensitive data, Response Quality must be paired with other Qualtrics features.

Fraud Detection

Survey security section with the options described in the following paragraph listed

In order to detect duplicate or bot responses, you need to have access to Fraud Detection. At any time during data collection, you can enable the appropriate Survey Options:

Sensitive Data

In order to detect whether or not survey responses contains sensitive data, your Brand Administrator has to have set up a Sensitive Data Policy. Sensitive Data Policies are brand-specific standards that determine when a survey question violates respondents’ rights to privacy. Sensitive data can include anything from Social Security Numbers to Phone Numbers; the parameters are determined by your organization’s administrators, not Qualtrics.

Viewing Response Quality

Response Quality can be viewed by going to Data & Analysis and selecting Response Quality. The percentage you see will be the percentage of high-quality responses you’ve collected. The color will correspond not just to percentage of flagged responses, but the severity of those flagged issues.

Data and analysis tab along top highlighted. A few rows lower to right, response quality button with highlighted percentage

Once inside, issues are sorted from most to least severe, with checks that your respondents passed appearing at the bottom of the list. You can use the menu to the left to view items by severity.

Image of the severity of the flagged issues in ExpertReview

Each issue comes with a description, the number of responses that were flagged with this issue, and a link to a support page that explains the issue further in depth.

Image of the response descriptions

Filtering Out Poor Quality Responses

You can filter out all the responses you collected that have been flagged, so that you only see results from high quality data. To start, select Filter Out Poor Quality Responses.

Image of the ExpertReview filter

Now that you’ve used this filter, it will be saved, so you can use it later or apply it to Results and Advanced-Reports.

Opening a saved expert review filter

This filter can be managed like other saved response filters.

Qtip: Responses are excluded from these filters for matching any of the poor Response Quality parameters. To filter by a particular issue, see Filtering Response by Issue.

Filtering Responses by Issue

You can easily filter so you only see responses that have been flagged for selected issues. This means you can look at your flagged responses and determine what you’d like to do with them.

  1. Select the issue(s) you’re interested in isolating.
    image of selecting and filtering flagged responses
  2. Click View Responses.
  3. You will now see responses flagged for the selected issue.
    Filtered responses. Shows number of filtered responses up top
  4. If you decide you want to remove these responses, you can click the Select All checkbox, With Selected, and then Delete.
    Along left are selection boxes and with selected menu

    Attention: Remember that once responses are deleted, they cannot be retrieved. As an alternative, you can filter out flagged responses and reuse filters as needed.
Qtip: Now that you’ve filtered by this issue, the filter will be saved and you can apply it to Results and Advanced-Reports. This filter can be managed like other saved response filters.