Loading...
  • Customer Experience
    Customer Experience
  • Employee Experience
    Employee Experience
  • Brand Experience
    Brand Experience
  • Product Experience
    Product Experience
  • Core XM
    Core XM
  • Design XM
    Design XM

Scorecard Widget (EX)

What's on This Page:


Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!


Qtip: This page describes functionality available to Engagement, Lifecycle, and Ad Hoc Employee Research projects. For more details on each, see Types of Employee Experience Projects.

About Scorecard Widgets

A Scorecard widget displays data for categories that you set up in the Categories section of your dashboard Settings. It will show a bar for each statement in your category that displays the percentage of respondents that had favorable, neutral, or unfavorable responses (the responses that fall into these categories are determined by the Scales section of your dashboard Settings).

For example, for the statement (“My team takes time to celebrate our successes”) in the example below, 81% of the respondents responded favorably. For the category “Sense of Recognition,” on average, 63% of the respondents responded favorably for all of the statements within that category.

Example of a scorecard widget, with categories expanded to show individual statement scores

Field Type Compatibility

The Scorecard widget uses scoring categories as the data source. These are set up in the Categories section of your dashboard settings. These categories need to be comprised of fields that are mapped as a Number Set field type.

Note that the data displayed in the widget is dependent on the scales that you set in the Scales section. Be sure to adjust these scales differently if you would like your Favorable, Neutral, or Unfavorable scores to be calculated differently.

Widget Customization

For basic widget instructions and customization, visit the Widgets Overview support page. Continue reading for widget-specific customization.

Basic Setup

To set up your Scorecard widget, you will first need to define your Source. This is the survey from which the data will be pulled. You will have more than one option here only if you have added additional sources in your Dashboard Data. You can select multiple sources at a time if you are set to the Horizontal Bar visualization.

You will also need to select one or more categories that you would like displayed in your widget. These categories are set up in your Categories section of your dashboard Settings.

Source and Categories options on the editing pane of a Scorecard widget

The order of the items listed in the categories is determined by the order the fields are mapped in your dashboard data.

Collapse on Load

If you have a category that has several statements included in it, you can choose to collapse the category by default upon a dashboard loading. You can apply this option to multiple categories and will always be able to expand the category with this option.

Collapse on Load option on the editing pane of a Scorecard widget

Visualization

You can choose a Histogram or Horizontal Bar view. If you choose Horizontal Bar, you will then be able to specify your desired number of decimal places and add multiple Sources.

Qtip: Qualtrics recommends using a Horizontal Bar view in order to display your data in the most concise format.

Visualization and Decimal Places options on the editing pane of a Scorecard widget

Display Options

image of a scorecard widget's display options

  • Show Response Counts: Displays the total number of responses accounted for in each statement.
  • Show Action Planning: Will display a plus (+) sign the individual can click to add an action plan that they can later edit in the Action Planning Editor widget.
    Attention: The Action Planning Editor widget is only available for brands using the legacy action planning experience. For customers using the new Guided Action plans, head to the Action Plans tab instead.
  • Show Average: Displays the average of all responses for a statement or category. This number is based off of a question’s recode values. With this option turned on, you can specify your desired number of decimal places for the mean.
  • Disable Column Sorting: Will not allow a dashboard user to sort the columns on the widget.
  • Show All Percents: Rather than only show the percentage for the favorable engagement, selecting this option will display percentages for neutral and negative engagement, too.

Comparisons

You can add both benchmarks and comparisons as comparison data in your Scorecard widget.

Loading comparisons

In order to add a comparison to the widget, you will have to ensure that you have at least one benchmark added in your Benchmark Editor or at least one comparison added in your Comparisons section of your dashboard Settings.

Note than you can add multiple comparisons, if you would like.

Metric

The metric is another field that determines how the numbers along the x-axis are calculated. You can either present results based on engagement or average.

  • Favorability: Base your data on favorability. This is calculated as an engagement score, the percentage of participants who rated favorably on the set scale. For more on setting favorability scales, see Scales.
  • Average: Base your data on the average value. In a Heat Map, that means you see the average of everyone’s score in a group. You can only switch the metric to average once Show Average is enabled in the widget’s display options.
    Qtip: Depending on the number of scale points, it may be difficult to get a large range for average. Consider adjusting your value ranges to include decimals.

Display As

Once your comparison is added and you’ve decided on the metric, you can display the comparison data as +/- Delta Base Value (displays the difference between your survey data and your comparison data) or as the Base Value (displays the actual value of your comparison data).

Significance Testing

When displaying comparisons or benchmarks on your widgets, you’ll see a lot of changes from one group to another. But are these changes to be expected, or are they representative of something deeper? How can you decide what changes demand your attention? Thankfully, you can flag whether a difference is statistically significant.

Enabling Significance Testing

a scorecard widget being set up to use statistical testing

  1. Add a comparison or benchmark to your widget.
    Qtip: To use significance testing, you must set your widget to display number values as +/- Delta.
  2. Choose your display Metric. You can choose either Average or Favorability.
    Qtip: Don’t see the option to select a metric? Make sure Show Average is first enabled in your widget’s Display Options. If the Metric dropdown is not visible, then the display metric is Favorability.
  3. Select Enable Significance Testing.
  4. Select your Confidence Level.

Types of Significance Tests

The type of significance testing that is being performed varies based on your chosen metric and whether you have added a benchmark or a comparison.

Favorability Average
Comparisons A two proportion z-test. Here, we are comparing proportions of favorability for two populations.

Qtip: For statistical tests that are set up with comparisons, the test will be performed with the comparison as it is configured, and will not attempt to remove any overlap between the samples being compared. For example, if your comparison is a subgroup vs. the company overall, the company overall includes the subgroup as well.
An independent samples t-test. Here, we are comparing two different distributions of scores: the current project’s survey results against the comparisons’ survey results.

Qtip: For statistical tests that are set up with comparisons, the test will be performed with the comparison as it is configured, and will not attempt to remove any overlap between the samples being compared. For example, if your comparison is a subgroup vs. the company overall, the company overall includes the subgroup as well.
Benchmark One sample test of binomial proportions. Here, we are comparing expected proportion (a benchmark) to the experimental proportion of the binomial question: is this favorable or unfavorable. One sample t-test. Here, we are comparing the benchmark mean (which is a single value) to the current survey’s results, which is a distribution of values.
The sample size for categories is the average number of responses across the items in the category.

Qtip:
Only benchmarks that are comparisons with Top Box / Bottom Box can be added to this widget.

Understanding Significance in a Widget

The Confidence Interval indicates how confident you would like to be that the results generated through the analysis match the general population. Higher confidence levels raise the threshold for a difference to be considered statistically significant, meaning only the clearest differences will be marked as such.

Once you have enabled significance testing, only the changes that are significant will appear in color, with arrows to indicate the direction of the change. Insignificant changes will be in gray.

Scorecard widget with the styling described on the comparison column

FAQs