Home Publishers How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

SHARE:

Shadow Blocklist
When Google’s DSP DV360 stopped buying on the tech site XDA Developers, revenue dropped 30% overnight.

The site soon realized it was on a “shadow blocklist,” where buyers don’t reveal why they stop bidding on a site, to prevent nefarious publishers from skirting the rules.

It took almost six months of guesswork and methodical changes before DV360 started bidding again. To this day, XDA Developers still doesn’t know exactly what change flipped the switch back on.

XDA Developers is a 20-year-old site featuring content and popular forums about mobile devices. Because of its tiny staff, it outsources its ad management, said CEO Josh Solan.

“Our core competency is making content,” Solan said. “We have no expertise in banner ads or header bidding and all the other things there.”

The first time XDA Developers ended up on a blocklist in 2017, it didn’t notice for weeks. Mysteriously, the buying eventually returned. Then it happened again. When it happened for the third time, in October of 2019, XDA Developers jumped ship to a different ad management firm, PubGalaxy.

PubGalaxy accepted the challenge of getting Google’s DSP buying on XDA Developers again. “We would never expect a website like that to have that issue – a website that’s not visibly doing something wrong or shady,” PubGalaxy head of marketing Boris Shterev said.

When XDA Developers’ seller account (it uses Google Ad Manager) switched over to PubGalaxy, one of the first things the two companies discovered was that the site had racked up years of “page-level violations” that it never knew about.

Google sends these violations to the company managing the advertising account, explained Mirela Kolarova, manager of yield and account management teams at PubGalaxy. Since the previous ad management firm never told XDA Developers about the violations, it couldn’t fix them.

PubGalaxy suspected that these outstanding violations were being factored into how the site was being judged programmatically.

These “page-level violations” tended to come from its forums, and ranged from dead hyperlinks to a picture posted of a girl in a bikini, Solan said. The site demonetized most of these old pages as a precaution, and fixed violations by deleting certain content and fixed broken links.

After seeing all the violations, Solan realized that having the site’s forums and news articles on the same URL exposed the site to more advertising volatility than he’d like. Despite extensive moderation, user-generated content attracts violations. But he can’t separate the site into two URLs now without taking an even worse hit on its SEO.

Instead, he and PubGalaxy focus on resolving the one to two new issues that crop up every week.

PubGalaxy continued down a checklist of issues. It implemented Fraudlogix and analyzed bot traffic coming to the site. Nothing unusual. Did the site have an issue with click spam, or where users could accidentally click on an ad? It did not. Was the setup of its mobile site leading to bad ad experiences on phones? No – in fact, it had a fully responsive mobile site and served different ads on desktop and mobile.

PubGalaxy compared XDA Developers with other sites it worked with, and tried to pinpoint commonalities between those that were being blocked to those that weren’t. Yet, the sites on the “shadow blocklist” looked identical to those that weren’t on it.

Then PubGalaxy first asked contacts at agencies to buy on XDA Developers and see what they saw, including how the site was classified. No issues. Finally, it used its own DV360 account to buy on XDA Developers. There, it discovered that 90% of the site wasn’t available to bid on – yet another mystery.

PubGalaxy continued down the rabbit hole.

It zeroed in on the blind spots, such as the ads on XDA Developers’ site that PubGalaxy couldn’t see. For example, its commenting system provider and its affiliate partner each sold ad units and took a revenue share.

Like XDA Developers’ former ad management firm, these partners were receiving violation notices but weren’t letting the site know, leaving them unresolved. Plus, their very presence potentially amplified all of XDA Developers’ violations.

“If there are three different instances of the same thing, and they are feeding violations into the same company, it might not register as the same violation, but as three violations,” Shterev said.

XDA Developers decided that “free” services through an advertising revenue share were no longer worth it. It now pays both its affiliate partner and commenting tool for its ad-free option. The day after it removed one of its service providers’ ad units and its associated ads.txt files, DV360 started bidding again.

Was it a coincidence, or did PubGalaxy finally home in on the issue?

No one knows for sure. “It’s impossible to pinpoint,” Shterev said. “Most likely, it was a large number of small things.”

Must Read

Beehiiv Brings Dynamically Inserted Podcast Ads To Its Publisher Platform

Podcasters can open their inventory to programmatic demand to complement their direct-sold host-read ads and monetize their back catalogs.

Stagwell Acquires Publisher Monetization Network Freestar

The deal is the latest sign that media buyers are moving closer to publishers to shorten supply paths and get at the audience data they need to train AI agents.

The Healthcare Marketing Tech Company OptimizeRx Is Going Programmatic

OptimizeRx, which has software that plugs into the systems doctors use to prescribe drugs and maintain patient records, has taken its next big step into the world of programmatic through a new partnership with The Trade Desk.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters
Single continuous line drawing robot riding pencil rocket flying in the sky. Tech education and creativity. Future technology development. Artificial intelligence. One line design vector illustration

Q3: Omnicom’s Media Business Is Growing, But Is It Agent-Proof?

If AI agents can plan and buy media, who needs a holding company? Good question. It came up during Omnicom’s Q3 earnings on Thursday.

Netflix Touts New Measurement Capabilities As It Struggles With “Modest” Engagement Growth

Netflix’s revenue grew 12% YOY to $12.9 billion in Q3, which it maintains is in line with its forecast. Its ads business, however, is lagging slightly compared with expectations, causing Netflix to tweak its forecast for the rest of the year.

Apple Publishes Its Plan To Wipe Out Web Tracking

Apple is coming for identity resolution. WebKit’s latest tracking crackdown targets the infrastructure behind post-cookie IDs – and switching to a first-party setup won’t necessarily spare vendors.