Fraud Detection

About Fraud Detection

Some of the biggest threats to data quality are bots and cheaters. Often bots will complete surveys en masse, or a person will take surveys on behalf of someone else multiple times. Thankfully, ExpertReview tracks these patterns, so you can ensure your surveys are collecting only the highest quality of data.

With ExpertReview Fraud Detection, you can do the following with responses identified as fraudulent:

1. Discard them, preventing them from being counted against auditable responses or quotas.
2. Redirect these responses for analysis separately.
3. Flag these responses so they can be filtered, reported on, etc.
4. Analyze the number of fraudulent responses you’ve received, breaking them down by duplicates and bots.

You can also prevent email scanning software from inadvertently submitting a survey response to begin with.

You can enable Prevent Ballot Box Stuffing, Bot Detection, Email Scan Roadblock, and RelevantID all in the same survey.

Prevent Ballot Box Stuffing

When enabled in your Survey Options, Prevent Ballot Box Stuffing allows you to detect duplicates and keep them from making their way through the survey. During the first survey session, Prevent Ballot Box Stuffing places a cookie on the browser. If the same respondent comes back on the same browser and device, without having cleared their cookies, they are flagged as a duplicate.

Once enabled, you can choose one of Prevent Ballot Box Stuffing’s four modes:

• End survey and display default message: Once a respondent is determined to have already taken the survey, the respondent is sent out of the survey and we display the standard end of survey message. Since the survey ends before the respondent can fill it out, you will not have any data this duplicate respondent might produce.
• End survey and display custom message: Once a respondent is determined to have already taken the survey, send the respondent out of the survey and display a special end of survey message. You can either write this message by clicking Load a Saved Message, your Library, and then New Message, or you can use an End of Survey message you saved in your library in the past. Since the survey ends before the respondent can fill it out, you will not have any data this duplicate respondent might produce.
• Redirect to a full URL: Once a respondent is determined to have already taken the survey, immediately redirect them out of the survey to a URL. Since the survey ends before the respondent can fill it out, you will not have any data this duplicate respondent might produce.
  Qtip: This feature is not available for free accounts.
• Continue Survey and set embedded data field: Duplicate respondents will not be sent out of the survey, but their responses will be recorded and be assigned a value under the field Q_BallotBoxStuffing.

Q_BallotBoxStuffing

When you select Continue survey and set embedded data field, respondents will not be sent out of the survey, but their response will be recorded and be assigned a value under the field Q_BallotBoxStuffing. Here’s how you interpret this field:

You can report on or analyze Q_BallotBoxStuffing without adding it to the Survey Flow. However, in order to set up logic based on this field (such as screening out possible bots), you must add this Embedded Data field to your Survey Flow.

Bot Detection

Bot Detection allows you to track which responses are likely bots by adding a field to each response called Q_RecaptchaScore. Every response is rated on the probability that the respondent was a bot, which you can then use to filter out data or build reports.

Enabling Bot Detection

1. Go to Survey Options.
   
2. Select Bot Detection.
   
3. Click Save.
4. After your survey is completed and before you are ready to distribute to respondents, click Publish.
   
   Qtip: Save this step for when you are done setting up your survey!

Q_RecaptchaScore

When you enable Bot Detection, this activates the field Q_RecaptchaScore, which can be used in reporting to indicate whether a response is more likely a bot or a human. This field uses Google’s invisible reCaptcha technology.

You can report on or analyze Q_RecaptchaScore without adding it to the Survey Flow. However, in order to set up logic based on this field (such as screening out possible bots), you must add this Embedded Data field to your Survey Flow.

Email Scan Roadblock

When enabled in your Survey Options, Email Scan Roadblock allows you to prevent email scanning software from inadvertently starting a survey session when a survey link is included in the email. While this feature is designed to stop email scanning software from opening emailed links, it will apply to links of any type, regardless if they were distributed via Qualtrics or a third-party system.

How Email Scan Roadblock Works

Bot Detection is used to determine whether or not a roadblock should be placed at the start of a survey, preventing the email scanning software from starting a survey session. If a bot is detected, a start page will be shown instead of the first question in the survey. If a bot was incorrectly detected, the customer can click the Next button and be able to continue taking the survey. The Look and Feel of the survey start page will be consistent with what has been selected from the rest of the survey.

Enabling Email Scan Roadblock

1. Go to Survey Options.
2. Select Email Scan Roadblock.
   
   
3. Click Save.
4. After your survey is completed and before you are ready to distribute to respondents, click Publish.

RelevantID

Relevant ID improves fraud detection by assessing respondent metadata to determine the likelihood that the same respondent is answering over and over; Relevant ID does not necessarily check the content of the responses for duplicates, since respondent can answer multiple times while giving different answers. This feature has three fields associated with it that you can report on: Q_RelevantIDDuplicate, Q_RelevantIDDuplicateScore, and Q_RelevantIDFraudScore. These fields are calculated using RelevantID technology. This technology checks if the respondent is cheating by taking the survey multiple times or whether a survey taker is fraudulent by analyzing a user’s browser, operating system, and location to provide a fraud score.

Enabling RelevantID

1. Go to Survey Options.
   
2. Select RelevantID.
   
3. Set the timeframe during which Relevant ID resets and will not flag a response that seems to be a duplicate from a previous session. Your options are 1 week, 30 days, 3 months, 6 months, or 1 year.
   Qtip: This setting is helpful if you need to let the same respondents retake a survey after a period of time. This way, if you are flagging and possibly screening out duplicate respondents with Relevant ID, you do not have to change your Survey Flow setup when it comes time for the respondents to retake the survey.
4. Click Save.
5. After your survey is completed and before you are ready to distribute to respondents, click Publish.
   
   Qtip: Save this step for when you are done setting up your survey!

Q_RelevantIDDuplicate, Q_RelevantIDDuplicateScore, and Q_RelevantIDFraudScore

You can report on or analyze these fields without adding them to the Survey Flow. However, in order to set up logic based on these fields (such as screening out fraudulent responses), you must add this Embedded Data field to your Survey Flow.

Adding Fraudulent Detection Fields to the Survey Flow

You can report on or analyze Fraud Detection fields like Q_RelevantIDDuplicate, Q_RelevantIDDuplicateScore, Q_RelevantIDFraudScore, Q_RecaptchaScore, and Q_BallotBoxStuffing simply by having the correspondingSurvey Option enabled, without adding them to the Survey Flow.

However, in order to set up logic based on these fields (such as screening out possible bots or fraudulent responses), you must add these Embedded Data fields to your Survey Flow.

1. In the Survey Options, turn on Prevent Ballot Box Stuffing (Continue Survey and set embedded data field), Bot Detection, and / or RelevantID.
   
2. Once your Survey Options are saved, go to the Survey Flow.
3. Click Add a New Element Here.
   
4. Select Embedded Data.
5. Select the name of the Embedded Data, click the blue dropdown, highlight Survey Metadata, and select the desired Fraudulent Response Metrics.
   
6. Move the Embedded Data to the top of the Survey Flow.
   
7. Click Save Flow.

Qtip: Use these Embedded Data fields and the values below to redirect fraudulent respondents using Branch Logic.