“Data-Driven Thinking” is written by members of the media community and contains fresh ideas on the digital revolution in media.
Today’s column is written by Auren Hoffman, CEO at SafeGraph.
People say “data is the new oil.” But unlike oil, the quality of data is extremely difficult to measure.
In my experience, most marketing data is between 10% and 20% accurate. Data that is less than 10% accurate generally doesn’t perform. Data that is better than 20% accurate has decreasing audiences to sell. For every percentage point more accurate than 20%, the revenue for the marketing data seller declines by 1%.
So marketing data companies have had a very strong economic incentive to keep their data accuracy between 10% and 20%. The exception to this is a system like Google Search. Buying people who searched for specific keywords is incredibly accurate and Google makes up for the fact that it has a small audience for each keyword by holding an auction for each impression. Because the data is scarce and temporal, Google can command a premium for the data.
Almost all marketing data is less then 20% accurate. Even gender is usually only 75% accurate in most platforms. Accuracy drops dramatically as you move to other standard demos, such as age, income, presence of children or marital status. Even very temporal data sets, like auto intenders, tend to be of very poor quality.
This is true with internet data, mobile data and even old-school mailing list data. Pretty much all marketing data is less than 20% accurate.
The historical reason that data never got better than 20% accurate is that it worked. Let’s say you bought a mailing list of “motorcycle enthusiasts.” Even if only 15% of people on that list really loved motorcycles, your direct mail campaign may still perform really well.
For instance, if you buy location-based ads on people that have been to Burger King recently, you are going to end up targeting 80% to 90% of people who were driving past Burger King, at the store across the street from Burger King or even 200 meters away from Burger King. The segment has historically still performed because 15% accuracy is a lot better than throwing darts.
Facebook Will Cause Data Companies To See A Reckoning
Facebook is changing everything. If you want to target men on Facebook, it is probably 99% accurate for the humans who see the ads. (There is, of course, still a very big bot problem everywhere on the internet.) And while age, marital status, home location, etc. are not perfect on Facebook, it is an order of magnitude better than the targeting you can get anywhere else, outside of Google Search and a few other players.
Facebook ads perform better than pretty much all other display ads because the data is better. That doesn’t mean you should move all your ad spend to Facebook, as sometimes the ads are more expensive, but it does mean Facebook is putting a lot of pressure on marketing data vendors.
Facebook is allowing more data targeting across many other news, information and properties outside the Facebook walled garden. When that happens on a larger scale, we should see huge shifts in ad budgets.
Measuring Data Quality
One of the biggest problems with marketing data quality is that it is incredibly difficult to measure. It is really hard to have a great truth set that is large enough to measure other data sets. Ideally, you’d want a truth set that has all representative data on 1% of the population, but that is going to be really hard to come by.
Moat, Integral Ad Science, DoubleVerify, White Ops and other companies have done a great job measuring things like viewability and bot traffic. And some companies are starting to do a good job on ad effectiveness and attribution. But there is no company focused on grading and rating marketing data.
For marketing data to survive, we’ll need an independent auditor of data quality. That will need to be a company that only measures and grades – it cannot sell data because no one will trust it if it is both the batter and the umpire. To the best of my knowledge, that company does not exist today, but I would love to invest in a great founder who is starting one.
Follow Auren Hoffman (@auren) and AdExchanger (@adexchanger) on Twitter.
