Home▸ Survey Platform▸ How to Use the Survey Platform

Why are my survey conditions not displaying evenly?

lcrismanlcrisman Community Member Qubie ✭
in How to Use the Survey Platform

Why are my survey conditions not displaying evenly?

in How to Use the Survey Platform

I'm conducting a survey with 3 experimental conditions, and I have it set to display them randomly, but that isn't what's happening--24 participants have completed the study, but only 4 of them were in Condition 2. I've attached screenshots of my survey flow; i

survey flow pt 2.PNG
survey flow pt 1.PNG

f anyone has any ideas as to why this is happening, I'd love some advice. Thanks!

Tagged:

Answers

  • TomGTomG Raleigh, NCCommunity Member Wizard ✭✭✭✭✭
    edited January 19

    A couple of things:

    1. Maybe the respondents assigned to C2 are abandoning at a higher rate for some reason. Check your in-progress responses (if they haven't been deleted).
    2. Maybe, due to changes and testing, the block counts didn't start at the same place (zero) when you launched the survey. Click on 'Edit Count' to check.
  • lcrismanlcrisman Community Member Qubie ✭

    It does seem as though C2 was abandoned at a higher rate, though not at the stage at which the conditions differ, so I'm not sure why that would be. The count indicates equal presentation to participants.

    One thing I'm worried about is that the survey timers might be glitching on participants, particularly those in C2--I have timers set so that people have to stay on certain pages for a certain amount of time to watch videos. It generally seems to be working fine, but once or twice, during previews, it hit a snag, leaving me unable to move forward even after enough time had elapsed. Have you ever encountered that?

    Regardless, thanks for your help. I'm really hoping to find some concrete difference in the survey setup that could explain this--something I could fix--but I guess it could be chance at this stage. If anyone thinks they'd know what to look for in terms of survey design, I'd be happy to send over a more detailed copy of what I've got.

  • TomGTomG Raleigh, NCCommunity Member Wizard ✭✭✭✭✭

    @lcrisman ,

    A couple of more thoughts:

    1. The issue may be the video timers since it was a known issue going in. I don't know anything about the specifics of your videos or timers, but generally, it is better to use a video ended event rather than a timer.
    2. If you collected meta info, you could take a look at that to see if there is a correlation between browser type(s) and adbandons. It could related to a incompatibility with specific browsers/devices.
Sign In to Comment