I am sitting in the Toronto airport this morning after what feels like a whirlwind trip to Toronto. I don’t think I have even been here 24 hours and it is time to go home. What a great city – although a bit of sun shine would have been nice.
Last night’s panel at the inaugural E-Metrics Summit in Toronto was a success. Andrea Hadley, a WAA founder and the point-person for WAA Canada did a great job of setting up the conference kick-off. The panel was moderated by Chris Williams and my co-panelists included Brent Bernie, President of comScore Canada, Paula Gignac, President of IAB Canada and Judah Phillips, Director of Analytics at Reed Publishing.
The topic focused on how web analysts should use audience measurement reports, data from ad-servers and web analytics tools to perform their job. The conflicts that arise from combining these tools to answer business questions were the focal-point for our discussion. Knowing that the three data resources will never foot to each other, when and why do you use each tool? And how do you explain to your internal constituents (usually your manager, other data consumers or the CMO) the variances that exist – and WILL NEVER be resolved?
Here is what we learned:
· Web Analytics tools give you that granular data of what is going on within your own site. If you know that your site is tagged correctly and that you are filtering your data appropriately, there is a ton of valuable information that can be gleaned from your web analytics tool. This is your tactical weapon for understanding how visitors are traversing your site and the only way to compare your SEM, SEO, display advertising and affiliate programs side by side.
· Ad server data provided by your agency or direct relationship with a publisher dictates how transactions are made between an advertiser and a publisher. Impression and click data is going to vary from what your web analytics tool is telling you (whether your tag sits side by side with the ad tag or you are measuring clickthroughs from a campaign code). This is due to three primary issues:
o Latency – the ad tag will fire long before your web analytics or widget analytics impressions or views are captured. This is due to the simple fact that there is an order of operation for how these requests are made – milliseconds can make a huge difference in the order of operation when we know that many visitors leave pages before they ever fully load. There is nothing we can do about this except to educate and understand that it exists.
o Filtering – variances between how tools filter are never well documented or understood by the marketers or management that rely on their output. At a high level, you have robots and spider lists, IPs (internal, external or extraterrestrial), HTTP status codes, odd-behavioral rules, page names and content types to filter by. No two vendors do it exactly the same and good luck in asking them to clearly define what those rules are.
o Environment hazards – there are a ton of what I like to call “Environmental Hazards” that contribute to the variances between data sources. Some tags are blocked by internal or corporate firewalls and spyware software these days can target ad servers as well as web analytics tools. Keeping up with the existing and emerging hazards is like keeping up with the Kardashians. One would like to be fully in the know – but it just is not going to happen.
· Audience measurement tools like comScore allow you to evaluate your site against your competitors. Because they are based on panel data, they won’t provide you with the in-depth analysis that your web analytics tool will provide, but it WILL let you know how you stack up against the competition. Audience measurement tools also provide deep insights into demographics like age, gender, household income and geography.
So where does that leave the analyst? Bottom line – understand what each data source offers. These are all tools in your tool chest to perform your job. They each serve a specific purpose and can answer discrete business questions. One thing that panelists were all in agreement on is that you have to keep it simple. You can confuse your executive management and the managers that you support very quickly if you take them into the weeds – so don’t. If they question the numbers, and they will, educate them at a high level on the merits of each source. Keep it at the bullet level – and make sure you know your stuff and can deliver the message with confidence. Because if you don’t understand it yourself, they won’t understand it either.
Off to catch my flight!