Hello Community,
As many, I am pulling year end numbers. I am finding up to a 15% difference between Community Analytics (higher) and the Admin>Metrics>User> Registration report.
Important to note, we are a private community. You can't find the Community in an SEO search. You can't register for the Community unless you have a login to one of our products. This can't be bot traffic.
Have others seen this issue? Which report do you trust?
Thanks for insight.
Melissa
Hi @mhock!
The most accurate numbers will be from the admin user report (not the one in admin metrics or LSI). The admin user report gives you exact numbers - since it’s a list of all the registered users. You can export it and sum up in excel, or filter to the registration dates you are interested in and count the number of pages of results.
Not sure why the LSI report or the admin metrics ones would be different other than that they may handle partially-completed registrations differently? But I do have high confidence in the admin user report.
Cheers! Happy new year!
Thank you for the reply. Any chance you could supply the path to that one? I only know the two I listed. I use the User Report. See screenshot below:
Ah, yes, @mhock , we're using the same report. I was thinking there was another report under Metrics > Metrics that was called 'User report' too. My bad!
We are also encountering this problem. Community Analytics and Admin Metrics show one number for Completed Registrations. However, pulling a User Report from Admin Metrics shows a different number when filtering on the registration date for a given month.
@mhock - did you ever figure out why the numbers were different?
The best place to find registration numbers is in Community Analytics (LSI). In LSI we have recently released a new feature 'Bulk member report' download using which you can also download user reports (similar to the one in Admin-Metrics). Once you download this report, you can filter using the registration date field and get the actual users who registered during that time period. You need to be granted a new community role 'AdvancedAnalyticsUser' to access this report. Please see more details in this release note and this page (How to enable the new role)
There is one reason for the discrepancy between the bulk member report and the completed registration metric. The reason is given below.
We are planning to fix this variance in the 20.5 release. @NickH
In case you are comparing with Admin-metrics, there is another reason for variance, that is timezone. LSI is reporting in UTC time zone. In the Admin metrics, the metrics are reported based in your time zone.
Hi @JosephA - thanks for the information. This is helpful to know.
Are we able to somehow reconcile the numbers by doing a combo of completed / abandoned / reconciled registrations from Admin Metrics? Our community is relatively new and the month we went live we're seeing a 30+ user discrepancy between the user reports and LSI/Admin Metrics.
Also, won't the bulk member export / user reports not include any deleted users and their activity?
Finally, we are wondering what is the equivalent source to using the Bulk Data API? Could we compare the numbers there to what's in Admin Metrics?
Thank you!
@lilim , Bulk member report in LSI will have all the users who have completed the registration process. It also includes deleted users, however, in the case of deleted users, we would have already deleted their Personally Identifiable Information (PII) like name, email, etc permanently (so those fields will be blank).
LSI provides 2 aggregate metrics - Completed Registrations, Partial registrations. LSI is the best source for metrics and member bulk download data. LSI is also the source for Bulk Data API data.
Hi @JosephA - thanks for the response.
We are attempting to use LSI and the Bulk Member export for the registration breakdown. We want to see not only new users within a given timeframe, but if they were employees or not.
However, applying the filter in LSI always brings back no results.
With the bulk member export, we are seeing an issue with the date field not displaying in a consistent format. Is there a suggestion for the best way to format this data?
Thank you!
@lilim , Completed Registrations and Partial registrations metrics cannot be filtered using Role/Rank. The role is typically assigned after registration so filtering this metric using role may not really provide much value. (Feel free to correct me here)
I checked the second issue where the bulk download date field is displayed in different formats in the excel file. The CSV file downloaded doesn't seem to have this issue. We will investigate the reason behind this.
You had asked me to start a new post on registrations. When I started I found this one from January 2020. It looks like my original post about the discrepancy wasn't answered. Instead I was told, use a different report.
You mentioned you may have insight. Would love to have that here.
Thanks in advance.
Have you checked if the discrepancy is due to CHA being in UTC vs the Admin Metrics being presented based on your profile's TZ (/t5/user/myprofilepage/tab/user-preferences)? I see a small discrepancy each day since I'm on Eastern time. Switching to GMT --- Iceland (not UK) helped get my CHA and Admin report counts to match completed registrations.
The Admin → Metrics → Metrics tab ↓ User Reports ↓ Registrations counts include completed and partial registrations. The exported CSV filtered on registration date in Admin → Metrics → User Reports tab will only show completed registrations. Only mentioning it just in case that's part of the discrepancy too.
With the above TZ adjustment, I do see a discrepancy in the User Reports export. My two counters show one number, but the CSV export contains 4 fewer names than I expect to see, despite the report now being in GMT.
I feel like the problem is somewhere in timezone matching for user account timestamps and our own account's timezone setting.
If you still have a case with support, then I hope this helps narrow it down. If nothing else, hopefully it will help explain the differences you're seeing and maybe provide a way to get them to match up better.
Thank you @Drew_C for the very thorough answer. I am going to make the TZ change on my profile to see if that can help at all.
@CarolineS wrote:The most accurate numbers will be from the admin user report (not the one in admin metrics or LSI). The admin user report gives you exact numbers - since it’s a list of all the registered users. You can export it and sum up in excel, or filter to the registration dates you are interested in and count the number of pages of results.
<<< Dont mind this post, I just test this platform 🙂 >>>
---------------------------------------------------------------------
My Ideas, please vote:
Welcome to the Technology board!
Curious about our platform? Looking to connect on social technology? You've come to the right place!