x

Choice Randomization

Home > Basic Building > Question Options > Choice Randomization
Basic Building

Learn how to randomize answer choices within a question.

Randomization is used to control answer choice presentation bias. To learn more about your randomization options, visit the Randomize Questions and Randomize Blocks pages.

Step-By-Step

To use Choice Randomization:

  1. Select the question with the answer choices you will be randomizing.
  2. Click on the Purple Gear Box that appears to the left of the question. Select Randomization.
  3. Select a randomization option.
    • No Randomization: The default option. Does not randomize the answer choices.
    • Randomize the order of all choices: Randomizes all choices for respondents.
    • Present only __ of total choices: Randomly displays a specified number of choices from the total choices available.
    • Advanced Randomization: Allows for more randomization options. Move choices in or out of randomization options using left/right arrow buttons.

      1. Fixed Display Order: Shows the choices in the order that they will appear and shows if a choice is randomized.
      2. Randomize Choices: Randomizes order of all choices moved into this area.
      3. Randomize Subset: Allows you to specify a number of choices to be randomly chosen by the system and displayed (2 of 4, 3 of 7, etc.).
      4. Undisplayed Items: Allows you to specify certain choices you don’t want displayed at all (sometimes useful when using Carry Forward).
      5. Evenly Present Elements: Allows you to choose a subset of choices to present randomly, yet evenly, so that the same amount of people will see each answer choice.

      • If using Advanced Randomization, be sure to click the Save button.

  4. Click the Close button once you are finished setting up the randomization.
  5. After you’ve set up simple or advanced randomization for your answer choices, you will see a Randomizer icon to the left of the question designating randomization is being used on that question.

More Information

qtips
  • Fixed Display Order is used to predetermine the order of some answer choices. For example, if a choice should always appear last, even when you are randomizing other choices, then you can move that answer choice to the bottom of the list in the Fixed Display Order. You can move answer choices up or down in the list by using the up/down arrows to the left.
  • You can download the randomization order on the Download Data page. Select Export Randomized Viewing Order data in the View Results tab when downloading data. The display order will appear in the last column of your data file and will be separated by a bar (|) if multiple choices were displayed.