Qualtrics Blog » Miscellaneous

Archive for the 'Miscellaneous' Category

Ethical Issues for Online Surveys

Thursday, March 19th, 2009

While conducting survey research, most academic and private sector organizations will adhere to the code of ethics and practices established by the American Association of Public Opinion Research (AAPOR). This code calls for honesty, respect, and integrity in dealing with respondents, clients, and the public.

In this code of ethics, respondents should be given the content, sponsorship, and purpose of the survey so that they may make an informed judgment about whether they wish to participate. Any assurances, such as confidentiality or anonymity, must also be kept by the researcher.

Additionally, researchers are called to disclose fully to those who sponsor surveys the limitations and shortcomings of the survey and to avoid use of methods that deliberately introduce bias into the results. A survey report should include information on who sponsored it, who conducted it, exact wording and sequencing of questions, description of the population and how a sample was selected, sample sizes and sampling tolerance, and the method place and dates of data collection.

This information is seldom available in published research reports or media summaries, but should be obtainable with a phone call or letter to the sponsor of the survey. Today, online survey software has made this process of gathering the ethical information extremely easy. With a good survey software program, one can provide the relevant information and adhere to the code of ethics and practices with ease.

Qualtrics Releases "Worry Index" Study

Thursday, February 19th, 2009

This week Qualtrics Labs, Inc. published a study regarding an ongoing study dubbed the "worry index." The worry index stems from survey research conducted by Qualtrics that measures America's feelings on key social, economic and political issues. The report entitled "American Optimism for Future Trumps Worry Over Economy," was picked up by a number of traditional and online news sources that were surprised by the relative optimism of Americans in this time of economic crisis. Among other findings, the latest worry index indicated that "34 percent of Americans who believe their overall quality of life will improve in the next year, compared with 17 percent in February 2008."

For the sake of our national and world economies, let's hope that their hope is more than a hunch.

Tracking Presidential Candidates With Google Trends

Monday, September 17th, 2007

Google's Trends tool is an interesting way to gain a bird-eye perspective on the upcoming 2008 Presidential candidates. "Trends" shows an approximation of search volume for any given search term as compared to another. In the case of presidential candidates, you can see how much each candidate is being searched for on Google in comparison with other candidates.

For example, let's look at a few of the Republican candidates, in no particular order. Only four candidates are shown here for simplicity sake, and Hillary Clinton is included for reference.

Picture 7-1

The above graph shows search volume for each presidential candidate's name in the first row, and how many times those names are being referenced in the news (or, what Google considers to be "the news") in the second. Although this data should not be considered concrete real world data, you can still draw some interesting conclusions.

One of the more interesting candidates to watch has been Ron Paul, who has surged in search volume with almost no accompanying news coverage. This is probably due to the fact that Ron Paul does very well with social websites such as Digg, Slashdot, Reddit, etc. but not as well with the general media. It is interesting to note that each Republican candidate started out with mediocre search volume at the beginning of the year, but candidates like Ron Paul and Fred Thompson have surged recently.

Here is a chart of the Democratic candidates, again in no particular order. Ron Paul is included here for comparison purposes so you can easily reference between the two charts.

Picture 8

Opposite to the Republican graph, leading Democratic candidates like Hillary Clinton and Barack Obama peaked at the beginning of the year and have since fallen.

The data can be further broken down by region for even more interesting information.

Picture 9

We can see here that people in Washington D.C. search more for Hillary Clinton, while people in Illinois search for Barack Obama more.

Further comparisons can be made by pitting the two political parties directly against eachother in Google Trends. Here we compare Clinton, Obama, Paul, and Thompson - the four candidate who have shown the most movement in search volume throughout the year.

Picture 10

Here is a breakdown of the above graph by city:

Picture 11


Here we see that the popular search goes to Paul in Austin, TX and to Obama in Chicago, IL. Compare this to the election results from 2004:

 Maps 2004Election

Perhaps it should already be obvious, but both data sources show Texas being heavily Republican while Illinois is heavily Democrat. This just goes to show the extent to which search volume trends correlate to real world election results. Again, none of the information should be taken as concrete because there are several reasons why search data could skew one way or the other, but the data is interesting nonetheless.

For comparison, here is a record of searches performed before the 2004 election for George Bush and John Kerry.

Picture 12


The overall closeness of the search volume for each candidate seemed to predict accurately the closeness of the final vote. Unfortunately data is not available for the 2000 election. It would be interesting to see how far apart search volume is in a race that wasn't quite as close.

There are many conclusions you can draw from this data, but the most important is that the election in 2008 could still go to anybody. It will certainly be interesting to watch how search volume correlates to real world election results.

Resources:
Google Trends Republican Candidates
Google Trends Democrat Candidates
Google Trends Republicans vs. Democrats

Technorati Tags: , , , , , , , , , , ,