From QualtricsWiki

Contents 1 View Results 1.1 View Reports 1.1.1 Basic Operations and Report Generating 1.1.1.1 Report Customization 1.1.1.1.1 Adding Graphs 1.1.1.1.2 Adding Tables 1.1.1.1.3 Adding Notes 1.1.1.1.4 Statistics Table 1.1.2 Report Publishing 1.1.2.1 Copy Report 1.1.2.2 Public Reports 1.1.2.3 Export Results 1.1.3 Advanced Analysis 1.1.3.1 Filters (Subgroups) 1.1.3.2 Filter by date 1.1.3.3 Drill Down 1.1.3.4 Response Sets 1.1.3.5 Analysis Options 1.1.3.6 Report Options 1.2 Responses 1.2.1 Result sorting and search 1.2.1.1 Panel Search 1.2.2 Result Deletion 1.2.3 Result View 1.2.4 Result Import 1.2.5 Retake Survey 1.3 Cross Tabs 1.3.1 Edit Cross Tabulations 1.3.2 Export Cross Tabulations 1.3.3 Printing 1.4 Download Data 1.4.1 CSV 1.4.1.1 Text Import 1.4.2 SPSS 1.4.3 XML 1.4.4 HTML

View Results

View results is the most important part of Qualtrics. This is where you work with the data that you have collected. In the view results tab there are several subsections: View Reports, Edit Results, Download Data, and Cross Tabulation. There is also a survey statistics page under the text "More." All of these subsections are found on the gray toolbar directly below the blue tabs and the "Current Survey" select drop down box.

On the right hand side of this gray bar you will see either two or three numbers. The number on top is the number of surveys started. The second from the top (often the bottom number) is the number of completed surveys, and the bottom or third from the top is filtered responses. These numbers represent only the data you have actually collected for this survey regardless of what or how many panels have been used.

The difference between surveys started and surveys completed are the partial completes that have been collected. These are the respondents in your data set who never fully completed the survey, and so partial responses have been collected from them.

Filtered Responses are the number of responses shown that match the filter you have place on your survey, (done in the View Reports section).

In this area you will also see the percentage of surveys that have been completed. Again, this number does not have to do with invitations, only with surveys started and surveys completed.

View Reports

Basic Operations and Report Generating

1. New report
   • Multiple reports can be generated and customized to give you multiple views and analysis of your data.
   • New reports generate reports based off of the initial report - or the original view of reports.
   • To create a new report click on the new report tab found directly above the report itself.
2. Copy report
   • If you want to keep the changes to one report but make further changes in another report use the copy report function.
3. Showing/Hiding questions
   • If you do not want certain questions to appear in your report - because they are not pertinent to the particular report - you can un-check the question text located on the left hand scroll box and the questions will be removed from the report you are working on.
   • To add the question back, merely check the grayed question.
   • To navigate to a particular question, click on the question text itself in the left hand side question scroll box.

Report Customization

Each question can be customized by adding tables and graphs or by using the more button.

Adding Graphs

• The Add Graph button is located in the upper right hand corner of every question display. Clicking will add a bar graph.
• By hovering over the graph, many different graph types may be selected.
• In the upper left hand corner of the graph's menu bar are the graph options.
  1. Data sources - allows the graph display to be in percentages, count, or mean.
  2. Show values - the exact value will be displayed with its corresponding graph bar, point, or area.
  3. Show/Hide Columns - you can select which columns will be displayed in the graph.
  4. Export Graph - you can export the graph to Word or Excel.
  5. Remove Graph - this can also be accomplished by clicking the (X) in the upper right hand corner.

Adding Tables

• The Add Table button is located next to the Add Graph button.
• By hovering over the table, the table options are displayed.
  1. Show/Hide Columns - you can select which columns will be displayed in the table.
  2. Sort by - this can also be accomplished by clicking on the column header.
  3. Export Table - you can export the table to Word, PowerPoint, or Excel.
  4. Decimals - this allows you to select how many decimals will be displayed by the table.
  5. Remove Table - this can also be accomplished by clicking the (X) in the upper right hand corner.

Adding Notes

• The More button, located next to the add table button, allows you to enter a comment about a question, table, or graph.
• To remove the note, just click on the text as if to edit it and delete all of the text.

Statistics Table

• Qualtrics computes means, standard deviations, and other statistics depending on the question type.
• This feature is also located under the more menu of each question.

Report Publishing

Copy Report

Using this option, one can copy the currently viewed report's formatting (edits for the tables and graphs, etc.). Useful for generating multiple reports that need to follow certain formatting.

Public Reports

Public Reports generate a link to a Qualtrics generated website, which displays the particular report that you choose to make public.

• A Qualtrics account is not needed to view a public report which makes this a popular method of distribution.
• Public reports will only show what is shown in the report. If you wish to restrict access to certain data, simply remove it from the report and no one looking at the public report will be able to access it.
• Public reports are dynamic, meaning that they update themselves as data comes in.
• To publish a public report:
  1. Click the public report button on the gray bar at the top of the report.
  2. In the dialog box select "turn on public report."
  3. Your link will be generated, and you can copy and paste it to distribute. By clicking the link you will see exactly what your public report will look like.
  4. You may also password protect the report in this dialog box as well.
  5. To exit, click the close button.
• Public Reports that are currently live will display a check mark next to the Public Report button.

Export Results

You may export your reports to Word, PowerPoint, or Excel.

• By clicking one of those icons (shown above) the export will begin.
• Qualtrics communicates best with Office 2007. If you are using Office 2003 you may want to download the compatibility pack. You are prompted to do this by the yellow box. The yellow box is not a warning or an error, it is merely informative and appears every time you download from Qualtrics.
• If your download dialog box does not open, check for your download blocker which will appear as a yellow bar across the top of your browser window.

Advanced Analysis

Filters (Subgroups)

1. Click directly on an answer choice within report.

• The easiest way to filter is to go to the desired question and click on the answer choice that you wish to filter your responses by. The page will reload and the filter status will appear at the top of your report.

You can also do more specific filtering and subgroups. Qualtrics can filter data and generate reports based on question responses or embedded data. These are called Subgroups within Qualtrics.

2. At top of report (Subgroup filter):

1. Above your report there is a blue button: Click on this button to create a filter.
2. Use the drop downs to select either questions or embedded data and then the answer choice or ED value.
3. Click the "+" button to the right of the row of logic to add another row with an "AND" or "OR" operator.
   • "AND" means that row of logic will be tied to the row above it, and both rows of logic need to be met in order for the response to qualify for that filter.
   • "OR" means either that row of logic or the one above it need to be met, but not necessarily both.
4. Click on the Apply changes button to view the report with your subgroup applied.

3. Create Subgroup and Name it

• To create subgroups if you wish to have them saved for later use.

1. Click show filters above the bank of questions on the left hand side.
2. Next to subgroups click new.
3. Give the Filter a name by clicking "Rename" at the top of the window.
4. In this dialog box you can apply logic to filter the data (in the same fashion as is done in the above method at the top of the report).

• The filter appears as a red bar across the top of the report.
  • You may remove it from the report by clicking the "X" on the label.
• Saved filters may be edited by hovering over the filter in the left hand bank, and clicking the "Edit" button that appears.

Filter by date

If you want to filter by a date you can do that by:

1. clicking on show filters... above the question list on the right.
2. By Date Range click on the drop down and select the date filter that you want.

Drill Down

The Drill Down feature allows you to separate all questions according to an answered question or embedded data value. In other words, if you wanted to see the responses for males as opposed to females and you asked that question in the survey, you could Drill Down by that question, and all the questions in the survey would display answers separated into columns for males and females. To Drill Down:

1. Click the Drill Down button on the left hand bank of questions.
2. The screen will go gray and you will be prompted to click on a question by which to Drill Down.
3. Scroll through until you find the desired question and click on it.
   • Some question types do not support the Drill Down feature (such as open ended text). These questions will be highlighted in red as you hover over them.
4. To remove the Drill Down, click the (x).
5. To Drill Down by embedded data, the embedded data must be included in the survey flow, and those fields will appear at the end of all the questions.

Response Sets

Response sets can be compared to collecting responses in two different buckets. These are helpful if you are using the same survey but wish to track different results separately. For example, if you distribute your survey through a mailing and by posting a generic link on a website, but wish to track the different types of distribution independent of each other, response sets can accomplish this.

Analysis Options

In the Qualtrics reporting suite you can recode values, rename variables, or ignore certain variables in the analysis. All these options can be found in the more menu, under Analysis options.

• Recode values - changes the value assigned to a particular answer. For example, if you wish to have data come back on a scale, but do not want the respondent to see a scale, you can present the options of the scale randomly, and then assign values on the back end.
• Rename Variables - if you wish to see answers differently in the reports than how the respondent will see them, you can rename them here.
• Do not include in analysis - this feature will remove all data from a certain answer and not include it in any of the percentages calculated, or statistics. For example, if you have a N/A answer in a question that you wish to count as a non-response, you can remove it from analysis with this feature.

Report Options

Under the Report Options button (found below the Microsoft Office export buttons) you can:

• Rename the report
• Change the number of questions per page
• Change the way questions are numbered
• Change the number of decimal places
• Change the matrix counts from count to percent
• Change the graph colors
• Delete the report

Responses

Result sorting and search

You can search through results by several categories. Use these to find or delete responses within a certain range, coming from a certain place, from a certain mailing, or test surveys.

1. Type - Search by responses coming from an IP address, a Panel, Survey Preview, or imported responses.
2. Date - Search responses between dates.

Panel Search

You can also search for specific Panel members. Search by name, email, or external data reference.

Result Deletion

Often, results need to be deleted due to survey previews, tests, or resetting the survey, etc.

Deleting responses:

1. To delete a few responses, click on the check mark next to the responses to delete, or select an entire page by clicking the "All" button.
   • Click the "Delete" button. You will be asked to confirm the request.
2. You may clear out all responses or all of a particular type of response by selecting an option under the Advanced Options drop down. You will be asked to confirm the response deletion.
   • Delete Survey Previews: This will delete responses that came into your data set due to using the Survey Preview button/URL.
   • Delete Survey Tests: This removes responses generated by the Test Survey feature found on the Edit Survey page under Advanced Options -> Test Survey.
   • Delete Imported Responses: This removes all responses that were imported into the main data set using the Import Responses option found in the same Advanced Options drop down on the Responses page.
   • Delete All Responses: This removes all data from your survey.

Result View

By clicking on the response ID in the Edit results section, a pop-up window will be displayed in which the answers to the survey for a particular respondent will be displayed.

Result Import

For a more detailed explanation, please see our Results Import page.

Answers to a survey can be imported directly into Qualtrics by using the Qualtrics reporting suite. This is helpful if you are combining surveys from different languages, combining identical surveys, or when it is necessary to download data, manipulate it, and re-upload the clean data into the system. To import results:

1. Click the import button.
2. Click the example button - this will download a template formatted in the way that Qualtrics can read it.
3. Populate (Copy and paste) your data into the fields in the example and save as a csv file.
4. In the Qualtrics pop-up, browse your computer, and upload the now saved csv file.
5. Click import.
6. Verify in Qualtrics that the import is correct.

Retake Survey

You can capture links to modify or retake a response. You will be provided a link which you can either redistribute to the respondents or use yourself.

To do this, scroll down the "Edit Results" page to see all the responses. Notice the last column ("Actions") and select the drop-down menu. Then you'll see the option to "Retake Survey" or "Retake Survey as New Response."

The first option allows you to modify an existing response. If you do this, you'll see the response as it was initially submitted. The second option would replace the existing response with a new one. When you select either of these options you are provided a unique link which either you or the respondent can access.

Cross Tabs

To create a Cross Tabulation within Qualtrics:

1. Click on Create a New Cross-Tabulation button
   
2. Select which questions you want displayed in banners (columns), and which questions you want to display in stubs (rows).
3. When finished selecting questions for banners and stubs, click Create Cross-Tabulation button.

When viewing the Cross Tabulation, there are various options available...

1. Row/Custom Selector - Highlights within the cross tab where the mouse hovers. If you click on a cell, it will highlight the cell's corresponding row and column.
2. Custom Highlighter - Will highlight particular cells that are clicked.
3. Grabber Tool - Can click and drag the page to move the page and cross tabulation around

• Under the Data Options button (located on the right hand side of the screen), you can turn on or off the following:

1. Frequencies
2. Expected Frequencies
3. Actual - Expected
4. Row Percents
5. Column Percents
6. Show Banner Means
7. Show Stub Means
8. Show Recoded Values

• You can also use the data highlighter to automatically highlight cells based on the criteria that you specify.
• Means are calculated for banners and stubs. Each mean is calculated based on recode values for each question answer.
• Multilevel drill-downs are weighted as the product of the recode values for each level.

Click here for information on The Use and Interpretation of Cross Analysis.

Edit Cross Tabulations

Banners and Stubs can be added to an existing cross tabulation...

• On the main cross tabulations page, click the Actions drop down arrow to the right of the specific cross tabulation and select "Edit Cross Tabulation". Check the boxes of the questions preferred for the Banners and/or Stubs.
  • This is the best option if needing to add multiple Banners and/or Stubs to the cross tabulation.
• If viewing an existing cross tabulation, click either "Add Stub" or "Add Banner".
  • This will open a window that allows the selection of one banner or stub at a time for that cross tabulation.

Banners and Stubs can be removed from an existing cross tabulation...

• On the main cross tabulations page, click the Actions drop down arrow to the right of the specific cross tabulation and select "Edit Cross Tabulation". Uncheck the boxes of the questions not needed for the Banners and/or Stubs.
  • This is the best option if needing to remove multiple Banners and/or Stubs from the cross tabulation.
• If viewing an existing cross tabulation, hover the mouse over a banner or stub, click the drop down arrow to the right of the banner or stub, select "Delete Stub" or "Delete Banner".

Filters or Subgroups can be applied to cross tabulations.

• Click "Add Filter" to the top right of the cross tabulation
• The setup process is the same as is used in Skip, Display, and Branch Logic. The item selected in the drop down to the left will affect the options available in the drop downs to the right.
  • These filters or subgroups are independent of the filters and subgroups within the Qualtrics Reports.
  • One subgroup is allowed per cross tabulation.

Export Cross Tabulations

There are currently two options for exporting cross tabulations:

1. PDF
2. Excel spreadsheet (.xls)
   • Note: If exporting to Excel, a warning will appear that the file is in a different format than the one specified. The file is still safe to open and use. It was set up like this in order to provide the necessary formatting to create the Excel export.

Printing

To print a cross tabulation, export it as a PDF or Excel spreadsheet and print from the PDF reader or from Excel.

• The PDF export, by default, will fit the entire cross tabulation onto one page, so it may be an easier option for printing, depending on the size of the PDF.

It is also possible to print using the browser's built-in printing ability (Ctrl+P or File->Print).

• This will remove most of the formatting from the page, but some text from the top of the web page might still be visible. If this is the case, then the option above will provide a cleaner export (export to PDF or Excel and print).

Download Data

Download the data into a csv file, SPSS, XML, or HTML document by just clicking on the icon or the text.
In Internet Explorer, make sure to look for your download blocker which will appear as a yellow bar across the top of the browser window.

CSV

Qualtrics will download a csv file which can be opened in Microsoft Excel. Excel is the most convenient program for viewing data, and from an Excel csv file you can go into other statistical modeling software.

Note* Excel 2003 has a column limit of 256 columns. Some surveys may have more variables than this. The data will be stored in the csv file, but cannot be displayed in Excel 2003. If this is the case you will need to find another program to view the data (SPSS, SAS, STATA, Excel 2007).

Text Import

If the downloaded CSV file is not displaying cleanly in Excel, you will want to use the Text Import Wizard (you can also try using Text to Columns, found under the Data menu, which is very similar to what is described below...). Follow the instructions below...

1. Download the exported CSV file.
2. Open Excel.
3. Open a new file.
4. Click the Data menu option.
5. Click "From Text" button.
   • In Excel 2003...
   1. Click "Data" menu.
   2. Select "Import External Data".
   3. Select "Import Data".
   4. Continue below with Step 6.
6. Select the file you downloaded.
7. In Text Import Wizard, make sure "Delimited" is selected and Press Next.
8. Check the delimiter characters that you know are in your file.
9. A file from Qualtrics should be using Commas.
10. You can try other delimiters, it selecting Comma doesn't help it display correctly.
11. Proceed to Next Step and Finish.
12. Your excel file will be ready with your data displayed correctly.

SPSS

You can now download your data into SPSS using the one step .SAV file download (File -> Open, like you would open a file in any other program).

Troubleshooting
Having problems with international characters?

• SPSS Version 16 or Newer
  • Close any open datasets then go to the SPSS "Edit" menu and choose "Options". In the general tab under "Character Encoding for Data and Syntax" choose "Unicode." Press the "OK" button.
• SPSS Version 15 or Older
  • Qualtrics encodes international characters using the unicode UTF-8 character set. Unfortunately, old versions of SPSS do not support unicode. You may want to considering upgrading to a newer version of SPSS.

XML

XML is used for putting your data into a database. This is the Extensible Markup Language (XML) format of the raw data, which is a general purpose markup language for easy interpretation.

HTML

This is a HyperText Markup Language format of the raw data. This format shows the data in one large table when opened by a web browser.