Number Chart Widget (CX), can't replicate the change number during checks | XM Community
Solved

Number Chart Widget (CX), can't replicate the change number during checks

  • 25 September 2020
  • 18 replies
  • 84 views

Userlevel 5
Badge +11

Hi All,

Regarding the Number Chart Widget and the ability to see a change value. I've read the support page countless times (https://www.qualtrics.com/support/vocalize/widgets/chart-widgets/number-chart-widget/) and tested and tested but I still can't replicate the change numbers it displays.

If anyone else has had the same problem but managed to work out how it works, I'd be grateful for a reply with a few examples.

My scenario is that I want to see YTD vs previous month, last 30 days vs month ago and last 14 days vs a week ago (ie they overlap by a week). When it says a week ago, is this 14 days previous week? is this like a shift back by 7 days or by a whole week starting on the Sunday so it might not be a whole week if you are half way through the week.
image.pngI exported my responses and understand the value is about the number of responses but still couldn't replicate the change numbers.

Many thanks in advance

Rod Pestell

icon

Best answer by LaurenK 9 November 2020, 15:21

View original

18 replies

Userlevel 7
Badge +13

Hi Rod_Pestell! We reached out to our Support team about this one and they let us know that the dates function on a rolling basis. So, if it says a week ago, it would be information on the last 7 days (shift back 7 days). They otherwise recommended reviewing the following Qtip on this Support page:
"Show Change Since is a rolling calculation because the included data is relative to the current date. For example, let’s say you configure the widget to Show Change Since 1 week ago. If you look at the widget on January 8, the displayed numerical value will show you how the data has changed since January 1. If you then look at the widget on January 31, the displayed numerical value will show you how the data has changed since January 24."
If you have any additional questions, be sure to reach out to our wonderful Support team! 😀

Userlevel 5
Badge +11

Hi LaurenK , thanks for the reply.  I believe that is what I was trying to prove in my initial reply but couldn't get it to work.  Would you care to try and replicate and prove that it is working by exporting some data and showing it working in Excel?  let's keep it simple at first by just looking at count but then try it with average.  I would also suggest you also try looking at a year aswell as week as I'm not so sure if rolls back day by day or whole time periods (ie weeks / months / years).  I think what would be good is in the widget settings, like other filter windows do it tells us the date range that it is using.  That would remove all the guess work then!

Thanks

Rod Pestell

Userlevel 7
Badge +13

Hi Rod_Pestell, and thank you for clarifying! It sounds like something may not be working as intended, and so I'd highly recommend reaching out to our Support team, as they will be able to further troubleshoot this for you and assist!

Badge +2

Hi,
I am having this issue, I can't replicate the change number that it is displaying. Wondering if you ever found a resolution to this Rod_Pestell ?
Thanks
Karen

Userlevel 5
Badge +11

Hi kwinskin,
I raised a support ticket at the time but it was very strange, I couldn't explain it well enough and wasn't able to replicate / get to the same number in excel either... the reply from support didn't get us anywhere so I gave up and decided to do my own custom metric change. This was some time ago so maybe its worth raising a ticket and see what they come back with.
Thanks
Rod Pestell

Badge +7

LaurenK We are also having this issue - trying to understand what dates are included in the "show change since" calculations. As Rod_Pestell stated, it is very difficult to understand given that there are no facts given about the comparison (e.g,, number of respondents or dates included).
Is everything rolling? If I look at the data on January 8, is the data showing all responses as of January 8 vs all responses as of January 1, or
is it showing all data collected through January 8 vs data collected Jan 1 through January 8?
Or is it something else?
kwinskin

Userlevel 7
Badge +18

I find it much easier to just do custom metrics like Rod_Pestell . This give me the flexibility now to show the change vs prior month, prior quarter, and prior year. And I just put in into table widget with conditional formatting.
I do wish there was an easier way of accomplishing this instead of having to create 3 custom metrics for each KPI I need to compare.

Badge +7

It just occurred to me - perhaps the "show change since" is not using the value that is displayed and is doing a rolling calculation using two numbers we can't see?

Userlevel 5
Badge +11

HI LaurenK ,
Could we pick this up again? Can I ask you to test it out yourself as perhaps a fresh pair of eyes might help before we raise another ticket with Qualtrics support on this.
Thanks
Rod Pestell

Userlevel 7
Badge +30

Hello Rod_Pestell!
Lauren does not work on the XM Community team anymore, but I'd be happy to help here.
I can escalate this internally and see if we can get a definitive answer for you and the others on the thread about intended functionality and potential solutions, if need be.
This might take a few days; I appreciate your patience in advance!

Userlevel 5
Badge +11

Hi Michael_Cooksey Thanks for letting me know - I'll try to remember that.

Hope to hear back soon on this. An idea.... when you hover over some of the fields in the textiQ table which shows sentiment changes over the last 30 days, it shows a description of the date range it's comparing. If we had this in the number widget I think it would help use understand what it's comparing. There is a slight problem though as the coders made it so that it's short hand, ie two digits for day and month and not used the month in name form and so it's a little difficult to tell if the first two digits are day or month. I'm in the UK you see and our date format is dd/mm/yyyy, not mm/dd/yyyy! :D
Thanks

Rod Pestell

image.png

Userlevel 7
Badge +30

Thanks for the additional intel, Rod_Pestell! I did raise your issue to the escalation team and I know they are looking at things and carefully reviewing your notes.
I also just passed along your latest comments!

Userlevel 5
Badge +11

Hi Michael_Cooksey, just to let you know I've raised a ticket as they need a ticket raised to get some support behind this it seems. SE_7E6F92B5154C4B4D
Thanks and fingers crossed we can get some clarification and documentation around this change value.
Thanks
Rod Pestell

Userlevel 7
Badge +30

Thanks, Rod_Pestell! The Product Expert I escalated the issue to tells me they will make sure this issue is handled with the utmost care!

Badge +7

We have had several discussions about these calculations with our TAM team. And the defintions and explanation really need to be improved. Essentially, the comparison is a Look back based on the filters and criteria you select in the "show change since". The vocabulary used in the widgets needs to be improved. and the comparisons need to be explained in the help. We had no less than three conversations about it and I am quite certain less than half the participants in those conversations could explain it to others. It should not be this hard.

Badge +1

Has anyone have any answer to this question? It seems like I am on the samme boat as you all and would appreciate a definitive answer on the “Show Change Since”. I am trying to understand the time frame used when doing the change calculation. The support page provides little to no information on it

Userlevel 7
Badge +30

Hello @DharmilRathod -- thank you for the “ping” on this thread. 

I see there have been a couple of comments here about this functionality in addition to yours, so let me see if I can bring in a product specialist to give me some insights that I might be able to relay back to everyone on this chain. 

This may take a few days, so I appreciate everyone’s patience while I try to get some definitive answers to clarify functionality. Thank you! 

Userlevel 7
Badge +30

Hello, @DharmilRathod, @dmckiernan, @Rod_Pestell, @InessaG, @kwinskin -- 

Ok, I asked one of our product specialists to do some investigating into expected behavior for this feature and I am going to post directly below (in italics) exactly the info I was given. I hope it is useful for you all and anyone else who visits this thread in the future: 

In the simplest terms, the "Show Change Since" option shows the change in the full lifetime value since a certain date. So, if you select "One Month Ago" for the time frame, it will look at the current lifetime value, then subtract the lifetime value as of 1 month ago, and that makes the difference. Here is a screenshot of the example I built out, showing specific values to hopefully make it easier to understand:

 

 

In this example I am using the average value of a metric.

  • The first widget shows what the client would see: The lifetime average, with the difference underneath
  • The second widget shows the lifetime average of this metric as of one month ago (I created this just by adding a filter to the widget to show data up to one month ago to the date: given I took the screenshot on Nov 2, one month ago was Oct 2)
  • The third widget again shows the current lifetime average, just to confirm

The difference calculated in the first widget is the "Current Lifetime Average" - "Lifetime Average 1 Month Ago" = "Difference". Using the specific values in the widgets: 3.364 - 3.375 = 0.011. Hopefully that clears up what exactly the widget is doing.

Now, there were also questions about what the date ranges were for the various options:

The first few options are "Yesterday", "One Week Ago"..."Twelve Months Ago". These options all look back a set amount of time:

  • "Yesterday" compares to the Lifetime Value as of Yesterday,
  • "One Week Ago" compares to the Lifetime Value one full week ago (as in 7 days ago),
  • "12 months ago" compares to the Lifetime Value as of 12 months ago (ie. the same date as today, but one year ago).

The "One Month Ago" option is highlighted in my example above, the other date options are "Month to Date", "Quarter to Date", and "Year to Date". These values, as opposed to going back a set amount of time, instead go back to the start of the selected interval. "Month to Date" compares to the Lifetime Value as of the start of the current month (so on Nov 2, it compares to the Lifetime Value at end of Oct 31). "Quarter to Date" compares to the Lifetime Value as of the start of the current quarter (so on Nov 2, it compares to the Lifetime Value from the end of Q3, or end of Sep 30). The "Year to Date" acts similarly, comparing it to end of Dec 31 from the year prior.

As a quick note, since you asked about bugs: I checked the current status, but wasn't able to find any active bugs related to "Number chart" or "Show Change Since".

Leave a Reply