Home Publishers How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

How The Tech Site XDA Developers Solved The Mystery Of The Shadow Blocklist – And Got Its Ad Revenue Back

SHARE:

Shadow Blocklist
When Google’s DSP DV360 stopped buying on the tech site XDA Developers, revenue dropped 30% overnight.

The site soon realized it was on a “shadow blocklist,” where buyers don’t reveal why they stop bidding on a site, to prevent nefarious publishers from skirting the rules.

It took almost six months of guesswork and methodical changes before DV360 started bidding again. To this day, XDA Developers still doesn’t know exactly what change flipped the switch back on.

XDA Developers is a 20-year-old site featuring content and popular forums about mobile devices. Because of its tiny staff, it outsources its ad management, said CEO Josh Solan.

“Our core competency is making content,” Solan said. “We have no expertise in banner ads or header bidding and all the other things there.”

The first time XDA Developers ended up on a blocklist in 2017, it didn’t notice for weeks. Mysteriously, the buying eventually returned. Then it happened again. When it happened for the third time, in October of 2019, XDA Developers jumped ship to a different ad management firm, PubGalaxy.

PubGalaxy accepted the challenge of getting Google’s DSP buying on XDA Developers again. “We would never expect a website like that to have that issue – a website that’s not visibly doing something wrong or shady,” PubGalaxy head of marketing Boris Shterev said.

When XDA Developers’ seller account (it uses Google Ad Manager) switched over to PubGalaxy, one of the first things the two companies discovered was that the site had racked up years of “page-level violations” that it never knew about.

Google sends these violations to the company managing the advertising account, explained Mirela Kolarova, manager of yield and account management teams at PubGalaxy. Since the previous ad management firm never told XDA Developers about the violations, it couldn’t fix them.

PubGalaxy suspected that these outstanding violations were being factored into how the site was being judged programmatically.

These “page-level violations” tended to come from its forums, and ranged from dead hyperlinks to a picture posted of a girl in a bikini, Solan said. The site demonetized most of these old pages as a precaution, and fixed violations by deleting certain content and fixed broken links.

After seeing all the violations, Solan realized that having the site’s forums and news articles on the same URL exposed the site to more advertising volatility than he’d like. Despite extensive moderation, user-generated content attracts violations. But he can’t separate the site into two URLs now without taking an even worse hit on its SEO.

Instead, he and PubGalaxy focus on resolving the one to two new issues that crop up every week.

PubGalaxy continued down a checklist of issues. It implemented Fraudlogix and analyzed bot traffic coming to the site. Nothing unusual. Did the site have an issue with click spam, or where users could accidentally click on an ad? It did not. Was the setup of its mobile site leading to bad ad experiences on phones? No – in fact, it had a fully responsive mobile site and served different ads on desktop and mobile.

PubGalaxy compared XDA Developers with other sites it worked with, and tried to pinpoint commonalities between those that were being blocked to those that weren’t. Yet, the sites on the “shadow blocklist” looked identical to those that weren’t on it.

Then PubGalaxy first asked contacts at agencies to buy on XDA Developers and see what they saw, including how the site was classified. No issues. Finally, it used its own DV360 account to buy on XDA Developers. There, it discovered that 90% of the site wasn’t available to bid on – yet another mystery.

PubGalaxy continued down the rabbit hole.

It zeroed in on the blind spots, such as the ads on XDA Developers’ site that PubGalaxy couldn’t see. For example, its commenting system provider and its affiliate partner each sold ad units and took a revenue share.

Like XDA Developers’ former ad management firm, these partners were receiving violation notices but weren’t letting the site know, leaving them unresolved. Plus, their very presence potentially amplified all of XDA Developers’ violations.

“If there are three different instances of the same thing, and they are feeding violations into the same company, it might not register as the same violation, but as three violations,” Shterev said.

XDA Developers decided that “free” services through an advertising revenue share were no longer worth it. It now pays both its affiliate partner and commenting tool for its ad-free option. The day after it removed one of its service providers’ ad units and its associated ads.txt files, DV360 started bidding again.

Was it a coincidence, or did PubGalaxy finally home in on the issue?

No one knows for sure. “It’s impossible to pinpoint,” Shterev said. “Most likely, it was a large number of small things.”

Must Read

SQREEM Touts The Large Behavioral Model – Not The LLM – As The Winning Predictive Engine

Rather than relying on machine learning, SQREEM uses a mathematical AI model to track how systems change over time and predict audience behavior.

Comic: Game Over?

The Google Antitrust Remedies Are Too Little, Too Late – But Publishers Will Take What They Can Get

Given how much the market has changed since the Google trial began, and the wiggle room in the ruling itself, publishers aren’t expecting much relief from the court’s behavioral remedies.

Comic: "Deal ID, please."

Can Sell-Side Curation Solve The Cookieless Audience Problem For Advertisers?

Indie agency KWG says sell-side curation can target more high-performing inventory with better match rates and lower data fees than buy-side curation.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters

Infillion Acquires Foursquare, Adding More Location Data To Its Ever-Growing Ad Tech Stack

Infillion checked in with its latest acquisition on Friday: Foursquare. Apparently, if there’s a strategically interesting or distressed ad tech asset on the market, Infillion will find it.

HBO MAX’s Reddit Account Was Compromised And Used For Ad Fraud

A week ago, HBO MAX had its verified Reddit account overrun by a hacker group, which eluded notice for two days while it ran 108 different ad permutations targeting an unknown number of Redditors.

Gaming Wants To Prove It’s Just Like Other Media Channels – While Also Owning How It’s Different

Adapting other channels’ strategies might be what gaming platforms need to do to get advertisers comfortable spending more. Leaning into gaming’s differentiators will come later, after bigger budgets arrive.