From QualtricsWiki

Contents 1 View Results 1.1 View Reports 1.1.1 Basic Operations and Report Generating 1.1.1.1 Question Customization 1.1.1.1.1 Adding Graphs 1.1.1.1.2 Adding Tables 1.1.1.1.3 Adding Notes 1.1.1.1.4 Statistics Table 1.1.2 Report Publishing 1.1.2.1 Public Reports 1.1.2.2 Report Export 1.1.3 Advanced Analysis 1.1.3.1 Filters 1.1.3.2 Drill Down 1.1.3.3 Response Sets 1.1.3.4 Analysis Options 1.2 Edit Results 1.2.1 Result sorting and search 1.2.1.1 Panel Search 1.2.2 Result Deletion 1.2.3 Result View 1.2.4 Result Import 1.3 Advanced Analysis 1.3.1 Generating Cross Tabs 1.3.2 Printing 1.4 Download Data 1.4.1 CSV 1.4.2 SPSS

[edit] View Results

View results is the most important part of Qualtrics. This is where you work with the data that you have collected. In the view results tab there are several subsections: View Reports, Edit Results, Advanced Analysis, Download Data, and also a survey statistics page under the text "more." All of these subsections are found on the gray toolbar directly below the blue tabs and the "Current Survey" select drop down box.

On the right hand side of this gray bar you will see either two or three numbers. The number on top is the number of surveys started. The second from the top (often the bottom number) is the number of completed surveys, and the bottom or third from the top is filtered responses. These numbers represent only the data you have actually collected for this survey regardless of what or how many panels have been used.

The difference between surveys started and surveys completed are the partial completes that have been collected. These are the respondents in your data set who never fully completed the survey, and so partial responses have been collected from them.

Filtered Responses are the number of responses shown that match the filter you have place on your survey, (done in the View Reports section).

In this area you will also see the percentage of surveys that have been completed. Again, this number does not have to do with invitations, only with surveys started and surveys that have been completed.

[edit] View Reports

[edit] Basic Operations and Report Generating

1. New report
   • Multiple reports can be generated and customized to give you multiple views and analysis of your data.
   • New reports generate reports based off of the initial report - or the original view of reports.

1. Copy report
   • If you want to keep the changes to one report but make further changes in another use the copy report function.
2. Deleting questions
   • If you do not want certain questions to appear in your report - because they are not pertinent to the particular report - you can un-check the question text located on the left hand scroll box and the questions will be removed from the report you are working on.
     

     

     Description
   • To add the question back, merely check the grayed question.
   • To navigate to a particular question, click on the question text itself in the left hand side question scroll box.

[edit] Question Customization

Each question can be customized by adding tables and graphs.

[edit] Adding Graphs

• The Add Graph button is located in the upper right hand corner of every question display. Clicking will add a bar graph.
• By hovering over the graph, many different graph types may be selected.
• In the upper hand left corner of the menu bar are the graph options.
  1. Data sources - allows the graph display to be in percentages, count, or mean.
  2. Show values - the exact value will be displayed with its corresponding graph bar, point, or area.
  3. Show/Hide Columns - you can select which columns will be displayed in the graph.
  4. Export Graph - you can export the graph to word or excel.
  5. Remove Graph - this can also be accomplished by clicking the (X) in the upper right hand corner.

[edit] Adding Tables

• The Add Table button is located next to the Add Graph button.
• By hovering over the table, the table options are displayed.
  1. Show/Hide Columns - you can select which columns will be displayed in the table.
  2. Sort by - this can also be accomplished by clicking on the column header.
  3. Export Table - you can export the table to Word, PowerPoint, or Excel.
  4. Decimals - this allows you to select how many decimals will be displayed by the table.
  5. Remove Table - this can also be accomplished by clicking the (X) in the upper right hand corner.

[edit] Adding Notes

• The More button located next to the add table button, allows you to enter a comment about a question, table, or graph.
• To remove the note, just click the (X) in the right corner.

[edit] Statistics Table

• Qualtrics computes means, standard deviations, and other statistics depending on the question type.
• This feature is also located under the more menu of each question.

[edit] Report Publishing

[edit] Public Reports

Public Reports generate a link to a Qualtrics generated website, which displays the particular report that you choose to make public.

• A Qualtrics account is not needed to view a public report which makes this a popular method of distribution.
• Public reports will only show what is shown in the report. If you wish to restrict access to certain data, simply remove it from the report and no one looking at the public report will be able to access it.
• Public reports are dynamic, meaning that they update themselves as data comes in.
• To publish a public report:
  1. Click the public report button at the top of the page.
  2. In the dialog box select "turn on public report."
  3. Your link will be generated, and you can copy and paste it to distribute. By clicking the link you will see exactly what your public report will look like.
  4. You may also password protect the report in this dialog box as well.
  5. To exit, click the close button.
• Public Reports that are currently live will display a check mark next to the Public Report button.

[edit] Report Export

You may export your reports to Word, PowerPoint, or Excel.

• By clicking one of those buttons the export will begin.
• Qualtrics communicates best with Office 2007. If you are using Office 2003 you may want to download the compatibility pack. You are prompted to do this by the yellow box.

The yellow box is not a warning or an error, it is merely informative and appears every time you download from Qualtrics.

• If your download dialog box does not open, check for your download blocker which will appear as a yellow bar across the top of your browser window.

[edit] Advanced Analysis

[edit] Filters

Qualtrics can filter data and generate reports based on question responses or embedded data. To create a filter:

1. Click show filters above the bank of questions on the left hand side.
2. Click new.
3. Give the Filter a name.
4. A dialog box will open where you can apply logic to filter the data.
5. The filter appears as a red bar across the top of the report, you may remove it from the report by clicking the (x).
6. Filters may be edited by hovering over the filter in the left hand bank, and clicking the edit button that appears.

[edit] Drill Down

The Drill down feature allows you to separate all questions according to an answered question or embedded data value. In other words, if you wanted to see the responses for males as opposed to females and you asked that question in the survey, you could drill down by that question, and all the questions in the survey would display answers separated into columns for males and females. To Drill down:

1. Click the Drill down button on the left hand bank of questions.
2. The screen will go gray and you will be prompted to click on a question by which to drill down.
3. Scroll through until you find the desired question and click on it.
   • Some question types do not support the drill down feature (such as open ended text). These questions will be highlighted in red as you hover over them.
4. To remove the drill down, click the (x).
5. To drill down by embedded data, the embedded data must be included in the survey flow, and those fields will appear at the end of all the questions.

[edit] Response Sets

Response sets can be compared to collecting responses in two different buckets. These are helpful if you are using the same survey but wish to track different results separately. For example, if you distribute your survey through a mailing and by posting a generic link on a website, but wish to track the different types of distribution independent of each other, response sets can accomplish this.

[edit] Analysis Options

In the Qualtrics reporting suite you can recode values, rename variables, or ignore certain variables in the analysis. All these options can be found in the more menu, under Analysis options.

• Recode values - changes the value assigned to a particular answer. For example, if you wish to have data come back on a scale, but do not want the respondent to see a scale, you can present the options of the scale randomly, and then assign values on the back end.
• Rename Variables - if you wish to see answers differently in the reports than how the respondent will see them, you can rename them here.
• Do not include in analysis - this feature will remove all data from a certain answer and not include it in any of the percentages calculated, or statistics. For example, if you have a N/A answer in a question that you wish to count as a non-response, you can remove it from analysis with this feature.

[edit] Edit Results

[edit] Result sorting and search

You can search through results by several categories. Use these to find or delete responses within a certain range, coming from a certain place, from a certain mailing, or test surveys.

1. Type - Search by responses coming from an IP address, a Panel, Survey Preview, or imported responses.
2. Date - Search responses between dates.

[edit] Panel Search

You can also search for specific Panel members. Search by name, email, or external data reference.

[edit] Result Deletion

Often, results need to be deleted. If you were testing the survey before launching it, you'll need to remove your test responses so they will not interfere with the real data. Also, you may find responses that you determine to be invalid that you wish to clear out of the data. In some cases you may want to re-use the survey, clear out all responses, and start over. There are two methods to deleting responses:

1. If you are only deleting a few responses, click on the check mark next to the responses you want to delete - you may also select an entire page to delete - and then click the delete button. You will be asked to confirm the request.
2. You may clear out the entire data set by selecting the delete all button in the right hand corner. You will have to confirm the request by typing in delete and submitting the confirmation.

[edit] Result View

By clicking on the response ID in the the Edit results section, a pop-up window will be displayed in which the answers to the survey for a particular respondent will be displayed.

[edit] Result Import

Answers to a survey can be imported directly into Qualtrics by using the Qualtrics reporting suite. This is helpful if you are combining surveys from different languages, combining identical surveys, or when it is necessary to download data, manipulate it,and re-upload the clean data into the system. To import results:

1. Click the import button.
2. Click the example button - this will download a template formatted in the way that Qualtrics can read it.
3. Populate the fields in the example and save as a csv file.
4. In the Qualtrics pop-up, browse your computer, and upload the now saved csv file.
5. Click import.
6. Verify in Qualtrics that the import is correct.

[edit] Advanced Analysis

Qualtrics also facilitates the generation of cross-tab reports.

[edit] Generating Cross Tabs

1. Click the add button.
2. Select the rows that you want displayed, and the columns with which they will be tabulated.
3. Click the button to generate the report.
4. When the report is generated, you may close the window, and the report will be saved in Qualtrics for you to view again.

[edit] Printing

After the window is closed, you will see a list of all the cross-tabs you have for this particular survey. Next to each of them is a print icon that will open up the cross tab window, and print the report from your browser.

[edit] Download Data

Download the data into a csv file, SPSS, XML, or HTML document by just clicking on the icon or the text.
In Internet Explorer, make sure to look for your download blocker which will appear as a yellow bar across the top of the browser window.

[edit] CSV

Qualtrics will download a csv file which can be opened in Microsoft Excel. Excel is the most convenient program for viewing data, and from an Excel csv file you can go into other statistical modeling software.

Note* Excel 2003 has a column limit of 256 columns. Some surveys may have more variables than this. The data will be stored in the csv file, but cannot be displayed in Excel 2003. If this is the case you will need to find another program to view the data (SPSS, SAS, STATA, Excel 2007).

[edit] SPSS

Instructions on Importing Survey Data into SPSS