Unmoderated User Testing Question

About Unmoderated User Testing Questions

The unmoderated user testing question type allows survey participants to record and upload a video or audio recording that answers questions about the prototype or live website that they are presented with.

Enabling the Unmoderated User Testing Question

Before you can use this question type, you need to have the right user permissions. A Brand Administrator can give you the permissions you need. Remember that you must have a UX license before you can use this feature.

• You need the Unmoderated User Testing permission to create this type of question.
• You need the Access Data & Analysis: Audio & Video permission in order to view and edit responses to the question.

Setting Up an Unmoderated User Testing Question

Attention: The Allow respondents to finish later setting must be enabled from the Responses section of the survey options before collecting data.

1. Add a new question.
   
   Qtip: Add page breaks before and after the unmoderated user testing question.
2. Select Unmoderated User Testing from the drop-down.
3. Select the Source.
   
   • Prototype
     Qtip: Prototypes can be from Figma, AdobeXD, or InVision.
   • Website
     Attention: When the source is a website, respondents must use the Google Chrome or Microsoft Edge browser.
   • PDF
   • Google Doc
4. Insert the link for your prototype into the Link box.
   Qtip: Links must be complete and begin with “https://”.
5. Add the tasks that you would like the participant to complete during the testing question.
   Attention: While there is no limit for the number of tasks, the session is limited to 20 minutes. Be sure that the number of tasks can be reasonably completed within that time.
   Qtip: It may be a good idea to add an informative task at the end. For example, one that tells participants to wait until their video uploads and then return to the survey.
6. To require respondents to use the front facing camera to record their answer, enable Require front facing camera. This feature is disabled by default.
7. Select a randomization option, if you’d like.
   • Randomize all but first: Randomize all tasks except for the first one.
   • Randomize all: Randomize all tasks.
   • Randomize subset: Randomize some of the tasks. If you select this option, you will also select which tasks you would like to randomize from the drop-down below.
8. Navigate to Survey options.
   
9. Enter the Responses section.
10. Turn on Allow respondents to finish later.

Respondent Experience

When you get to the unmoderated user testing question, you will see a question prompt along with a Go to study button. Click this button to get started.

Review the instructions and confirm that you are willing to share your screen. When you’re ready, click Share screen. Your browser will ask you for permission as well.

Attention: Your browser may ask you for permission to access your microphone and camera. Click Allow to give Qualtrics permission to these features. If you do not allow access to your microphone and/or camera, you may receive a “NotAllowedError” that will prevent you from recording a video or audio response.

Check that your microphone is working correctly before clicking Continue. If the front facing camera is required, you will also be prompted to check your video. To change the default microphone / camera, use the drop-down.

The respondent experience is slightly different depending on the prototype being studied. For information on specific prototypes, see the subsections below.

Respondent Experience for Prototypes

Tasks will be displayed on the right underneath Study Tasks. Follow the instructions for each task by engaging with the prototype. To hide the task pane, click the icon in the upper-right corner.

Click the pause button to pause the recording. To view the timer, click the stopwatch icon.

When you’ve completed your tasks, you will be prompted to click Finish and Save. Once your recording has been saved, you will return to the survey. Click Next page to continue.

Data & Analysis

Your responses from the unmoderated user testing question will be in the Audio & Video Editor in the Data & Analysis tab. From here you can view transcripts, make clips from audio and video responses, build highlight reels, and leverage AI-driven insights to identify themes in your video responses. For more information, see Audio & Video Editor.

Troubleshooting

If you receive the NotAllowedError, your browser or computer settings are preventing Qualtrics from accessing your camera or microphone. Enable your browser or computer permissions before using the unmoderated user question.

Google Chrome Settings

1. Go to the Chrome settings.
   
2. Go to the Privacy and security settings.
   
3. Click Site settings.
4. Enable site permissions for Camera, Microphone, and Pop-Ups.
   

Mac OS Settings

1. Go to system settings.
2. Go to the Privacy & Security settings.
   
3. Enable permissions for Camera, Microphone, and Screen recording.

FAQs