Home Publishers How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

SHARE:

Shadow Blocklist
When Google’s DSP DV360 stopped buying on the tech site XDA Developers, revenue dropped 30% overnight.

The site soon realized it was on a “shadow blocklist,” where buyers don’t reveal why they stop bidding on a site, to prevent nefarious publishers from skirting the rules.

It took almost six months of guesswork and methodical changes before DV360 started bidding again. To this day, XDA Developers still doesn’t know exactly what change flipped the switch back on.

XDA Developers is a 20-year-old site featuring content and popular forums about mobile devices. Because of its tiny staff, it outsources its ad management, said CEO Josh Solan.

“Our core competency is making content,” Solan said. “We have no expertise in banner ads or header bidding and all the other things there.”

The first time XDA Developers ended up on a blocklist in 2017, it didn’t notice for weeks. Mysteriously, the buying eventually returned. Then it happened again. When it happened for the third time, in October of 2019, XDA Developers jumped ship to a different ad management firm, PubGalaxy.

PubGalaxy accepted the challenge of getting Google’s DSP buying on XDA Developers again. “We would never expect a website like that to have that issue – a website that’s not visibly doing something wrong or shady,” PubGalaxy head of marketing Boris Shterev said.

When XDA Developers’ seller account (it uses Google Ad Manager) switched over to PubGalaxy, one of the first things the two companies discovered was that the site had racked up years of “page-level violations” that it never knew about.

Google sends these violations to the company managing the advertising account, explained Mirela Kolarova, manager of yield and account management teams at PubGalaxy. Since the previous ad management firm never told XDA Developers about the violations, it couldn’t fix them.

PubGalaxy suspected that these outstanding violations were being factored into how the site was being judged programmatically.

These “page-level violations” tended to come from its forums, and ranged from dead hyperlinks to a picture posted of a girl in a bikini, Solan said. The site demonetized most of these old pages as a precaution, and fixed violations by deleting certain content and fixed broken links.

After seeing all the violations, Solan realized that having the site’s forums and news articles on the same URL exposed the site to more advertising volatility than he’d like. Despite extensive moderation, user-generated content attracts violations. But he can’t separate the site into two URLs now without taking an even worse hit on its SEO.

Instead, he and PubGalaxy focus on resolving the one to two new issues that crop up every week.

PubGalaxy continued down a checklist of issues. It implemented Fraudlogix and analyzed bot traffic coming to the site. Nothing unusual. Did the site have an issue with click spam, or where users could accidentally click on an ad? It did not. Was the setup of its mobile site leading to bad ad experiences on phones? No – in fact, it had a fully responsive mobile site and served different ads on desktop and mobile.

PubGalaxy compared XDA Developers with other sites it worked with, and tried to pinpoint commonalities between those that were being blocked to those that weren’t. Yet, the sites on the “shadow blocklist” looked identical to those that weren’t on it.

Then PubGalaxy first asked contacts at agencies to buy on XDA Developers and see what they saw, including how the site was classified. No issues. Finally, it used its own DV360 account to buy on XDA Developers. There, it discovered that 90% of the site wasn’t available to bid on – yet another mystery.

PubGalaxy continued down the rabbit hole.

It zeroed in on the blind spots, such as the ads on XDA Developers’ site that PubGalaxy couldn’t see. For example, its commenting system provider and its affiliate partner each sold ad units and took a revenue share.

Like XDA Developers’ former ad management firm, these partners were receiving violation notices but weren’t letting the site know, leaving them unresolved. Plus, their very presence potentially amplified all of XDA Developers’ violations.

“If there are three different instances of the same thing, and they are feeding violations into the same company, it might not register as the same violation, but as three violations,” Shterev said.

XDA Developers decided that “free” services through an advertising revenue share were no longer worth it. It now pays both its affiliate partner and commenting tool for its ad-free option. The day after it removed one of its service providers’ ad units and its associated ads.txt files, DV360 started bidding again.

Was it a coincidence, or did PubGalaxy finally home in on the issue?

No one knows for sure. “It’s impossible to pinpoint,” Shterev said. “Most likely, it was a large number of small things.”

Must Read

Meta’s Expenses Are Growing Faster Than Its Revenue, Thanks To Lawsuits And AI

A combination of layoffs, lawsuits and AI operating costs set back Meta’s Q2 earnings, despite increased revenue.

Omnicom Investors Cheer IPG Sell-Off, Despite Weak Ad Spend In Q2

Omnicom is halfway through a major sell-off of IPG agencies. Its future looks healthier as it prunes lower-growth firms, including eliminating certain specialist firms and overlapping agencies in certain countries.

Hundreds of emails, depositions and other documents have been unsealed in the lead-up to the Google antitrust trial, providing a fascinating look at how Google talked about its own products when no one else was watching – especially tools to counteract the rise of header bidding.

Why PubMatic Ditched Its Prebid Web Wrapper, But Never Its SDK

Earlier this month, PubMatic shelved its Prebid integration wrapper, known as OpenWrap Web, and announced it would begin recommending Playwire as an offloading-onboarding partner for the 250-odd publishers that use its wrapper.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters
Gareth Glaser, Co-Founder & CEO, Gamera

Google’s Buyer Direct Could Beat Agentic Ad Tech At Its Own Game

Agentic AI shows promise for direct deals. But if Google has its way, Buyer Direct could put an end to all sorts of agentic direct sales opportunities while they’re still in the cradle.

How Warner Bros. Discovery Is Creating Value Out Of Dead Air With Pause Ads

Streaming publishers are banking on pause ads to bolster revenue with a more user-friendly ad experience. With programmatic standardization still pending, Warner Bros. Discovery is taking a stab at advancing the capabilities behind its own pause ad formats.

Peacock Hits Profitability As Comcast Prepares To Spin Off NBCU

Peacock hit what Comcast Co-CEO Mike Cavanagh called “meaningful profitability” for the first time in Q2, just as Comcast decided to let it leave the nest.