Skip to main content
Skip to article
  • Qualtrics Platform
    Qualtrics Platform
  • Customer Journey Optimizer
    Customer Journey Optimizer
  • XM Discover
    XM Discover
  • Qualtrics Social Connect
    Qualtrics Social Connect

Filtering Inbound Data (Connectors)

Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!

About Filtering Inbound Data (Connectors)

You can filter the data you import into XM Discover. This allows you to only import the data that meets your filter conditions.

There are 4 different types of data filters:

  • Connector filters: Connector filters are available for all data connectors. They allow you to define an expression that is either true or false which determines if data is imported.
  • Record limits: Record limits allow you to set a maximum number of documents imported in 1 job.
  • Source filters: Some connectors also allow you to add a source filter, which allow you to set up additional filters specific to that data source.
  • Query configurations: Some connectors allow you to add a specific query that the data must match to be imported.

Connector Filters

Connector filters are available for all data connectors. They allow you to define a Boolean expression that determines if data is imported.

You can access a job’s connector filter when setting up the job for the first time, or by selecting Data Filter from the job options menu.

  1. Select Apply Connector Filter.
    clicking edit to add a connector filter
  2. Click Edit.
  3. Build your filter expression. When building your expression, only use Boolean functions. See the Building Expressions support page for more information on creating expressions.
    building a connector filter expression

    Example: In the above image, the expression “ISBLANK(LinkedTicketID)” was created, which evaluates the “LinkedTicketID” field for a value. Therefore, only data with a empty value for “LinkedTicketID” will be imported.
    Qtip: Use the “ISBLANK” and “CONTAINS” functions for connector filters.
  4. Test your expression by entering sample values in the Test Value field and then clicking Test. The result will appear next to the Test button.
    Qtip: Since you’re creating a Boolean expression, the result should be either “true” or “false.”
  5. When finished building your expression, click Save.
  6. Choose what you want to do with data that matches the expression:
    choosing to include or exclude data that meets the conditions

    • Included: Records that match the expression will be imported.
    • Skipped: Records that match the expression will not be imported.
  7. Click Save.

Record Limits

By default, there is no limit to the number of documents that can be processed in a single job run. Record limits allow you to set a maximum number of documents that can be processed in a single job.

You can access a job’s record limits when setting the job up for the first time, or by selecting Data Filter from the job options menu.

Then, enter a number in the Specify Record Limit box. To remove the limit and process all documents, enter “All” in this box.
the specify record limit box

Qtip: The record limit applies to each individual job run. For example, if the limit is set to 1,000, then the job will run at whatever schedule you set, and will stop after pulling 1,000 records. For conversational data, the limit is applied based on conversations rather than rows.

Source Filters

Some connectors allow you to further filter their incoming data by specifying what data should be included or using one of the preconfigured filters.

The following connectors support source filters:

  • Brandwatch inbound connector
  • CFPB inbound connector
  • Safer Products (CPSC) inbound connector
  • Social Studio inbound connector
  • Synthesio inbound connector

You can access your source filter when setting up a job for the first time, or you can edit the source filter for an existing job by selecting Data Source Filter from the job options menu. Follow the steps below to build your filter:
adding a data source filter

  1. Select the field you’d like to filter on.
  2. Select an operator for a filter condition. Choose “is” to include the values you specify, or choose “is not” to exclude the values you specify.
  3. Specify 1 or more values to use for the filter.
    Qtip: If you have multiple values for a condition, they are separated by an implicit “or,” meaning a record needs to have only 1 of these values to meet the filter criteria.
  4. You can add conditions by clicking the plus sign ( + ) or remove conditions using the minus sign ( – ).
    Qtip: If you have multiple filter conditions, they are separated by an implicit “and,” meaning all conditions must be true.
  5. Click Save.
Qtip: Depending on the data source, you may have a dropdown menu to choose data filters defined via that data source instead.

Query Configurations

Some connectors let you set up a search query to load only the data that matches the query. This allows you to control which documents get uploaded into XM Discover via these jobs.

The following connectors support query configurations:

You can access the query configuration when setting up a job for the first time, or you can edit the query configuration for an existing job by selecting Query Configuration from the job options menu.
an example query configuration filter for a QSC job

You can then set up the query for your job. The specific instructions for setting up a query vary depending on the inbound source. For example, QSC inbound queries allow you to select a filter from QSC, while Twitter inbound queries allow you to manually define a search term that must be included in the data. See the documentation for your inbound connection for specific instructions.