Block Randomization

Introduction

With a randomizer in the Survey Flow, you can randomly present question blocks, Embedded Data, and other Survey Flow elements. For example, in academic research, you could use a randomizer to assign participants to either a control block of questions or an experimental block of questions.

Adding a Randomizer

Any items in your Survey Flow can be randomized. This randomization can happen at any point in the flow.

blocks under

In this example, after the Demographics block, respondents will be presented the Product Satisfaction, Customer Service, and Corporate Image blocks in a random order.

To set up randomization, first you’ll add the Randomizer, and second, you’ll choose the items you would like to randomize.

To add a Randomizer:

  1. In the Edit Survey tab, click Survey Flow.

    Survey Flow
  2. In your Survey Flow, click Add Below, or Add a New Element Here.

    Add new element
  3. Click Randomizer.

    Randomizer
  4. Qtip: If the Randomizer isn’t created exactly where you want it in the Survey Flow, don’t worry. You can move elements in the Survey Flow by selecting the item and pressing or .
  5. Move the elements you want to randomize so they are under the Randomizer. For more information on how to move elements in the Survey Flow, see Moving Elements within the Survey Flow.

    blocks under
  6. Qtip: Elements included under a Randomizer are grouped together, so moving your Randomizer in the Survey Flow will also move the elements within it.
  7. Enter the number of elements you want to present. To indicate that all of the elements should be shown the same number of times, select Evenly Present Elements.

    evenly present elements
  8. This Randomizer will evenly show 2 of the 3 blocks to each respondent.

Editing Counts

When Evenly Present Elements is selected, you can click Edit Count to view how many times each element has been displayed.

edit count

These numbers should be roughly the same, but you can override the counts if you need to temporarily give preference to a specific element. For example, if you set one question block to “5”, while the others are set at “15”, this first question block will be displayed 10 times in a row to “catch up” with the other blocks and ensure even presentation.

reset counts

Here you will also see the option to Reset All Counts back to 0, or to Restore All Counts to what they were before you changed them.

Advanced Randomizer Options

In addition to Blocks, the Randomizer can be used to randomize other elements in the Survey Flow. You can also use Branch Logic to nest multiple elements (like Blocks, End of Survey Elements, and Embedded Data) under a Randomizer.

Using the Randomizer with other Elements

Other elements in the Survey Flow can be randomized just like Blocks. One example is Embedded Data. You can use the Randomizer to randomly assign specific Embedded Data labels to each respondent.

ED Example

In this survey, each respondent is randomly assigned to a Condition. If they are assigned to Condition 1 they view the Control block, and if they are assigned to condition 2 they view the Experiment A and Manipulation Check A blocks.

Using Branch Logic

To nest multiple elements under a Randomizer as a set, you can use Branch Logic. Even if you don’t want to conditionally present the items, you’ll need to use a Branch to group them together.

Branch Logic

In this survey, respondents are shown the Demographics block, and then randomly assigned to one of the two branches. If they are assigned to the first branch, they are shown Apparel and Shoes & Accessories and then directed to the end of the survey. If they are assigned to the second branch, they are shown Home & Garden and Electronics.

To nest multiple elements under a Branch:

  1. Add a Branch. add a branch
  2. Add a condition that will always be met, such as “If the Introduction question is Displayed“. For more information on setting logic conditions, see Using Logic. condition
    Qtip: You might ask, “Why add a condition? I’m just trying to group items together in the randomizer.” Grouping is handled using Branches, and Branches require a condition. Simply pick a condition that will always be true, such as the first question of the survey having been displayed, and you’ll be set.
  3. Move elements that belong in a set under the Branch.

    Branch Logic
Google+