Home Daily News Roundup Can Cloudflare Really Block Google’s AI Crawlers?; Knock It Off, Knockoffs

Can Cloudflare Really Block Google’s AI Crawlers?; Knock It Off, Knockoffs

SHARE:
Comic: Scraping The Headlines

Head In The Cloud

Cloudflare caused a stir in the publishing industry with its announcement last week that it would begin blocking all generative AI bots by default and create an option whereby AI model operators – whose models are primarily based on scraped web data – pay for access.

But Google has an Uno Reverse Card up its sleeve.

Publishers must tolerate the Google AI scraper bot because it comes under the same consent checkbox as Google’s Search crawler. In other words, denying access to Google Gemini and Google’s AI Mode will cause sites to suffer in traditional Google searches. 

Cloudflare CEO Matthew Prince tweeted in response to one publisher, “We will get Google to provide ways to block Answer Box and AI Overview, without blocking classic search indexing, as well.”

That’s a bold claim. “I mean, we’ve all been asking Google to give us this level of control,” writes Barry Schwartz at Search Engine Roundtable. And Google’s answer has been a steady “no.” 

But Cloudflare appears to have its own card to play.

One SEO agency leader asked Prince on X whether it’s even possible to block Google’s AI scrapers while allowing the search bot.

Prince’s response: “It is. #staytuned.” 

Just Dupe It

Some brands are struggling with the new “dupe” culture.

Once the province of people on the street hawking obviously fake handbags, the term “dupe” has been co-opted through the recent trend of quality private-label lines and social media-based manufacturers – not to mention online retailers like Shein – aping pricey products for peanuts, reports Marketing Dive.

Lululemon is suing Costco for producing lookalikes, as well as for backing influencers who refer to the products as “Lulu dupes” and “knockoffs.” In Lululemon’s view, there’s now a private-label shopper mentality, so when people see a knockoff Lululemon product made by Kirkland, Costco’s house brand, they often believe Lululemon is the true manufacturer.

Meanwhile, in the grocery aisle, Mondelēz filed a suit against Aldi last month for blatant knockoffs of Chips Ahoy! and Oreo cookies.

But Mondelēz and other brands must tread carefully. They don’t want to lose their spot on those grocery shelves.

And consumers aren’t helping much. Marketing Dive reports a survey indicating 70% of Americans who make $150,000 or more per year “say they’re more likely to try private label if it’s marketed as a dupe of a high-end product.”

Stuck In Traffic

Publishers are desperate to restore their dwindling traffic rates. But whether their attempts are working is a separate conversation.

As Google AI Overviews continue to grow as a share of search responses and more people use generative AI search engines, publishers are preparing for “the idea of ‘Google Zero,’” GQ’s global editorial director, Will Welch, tells New York Magazine

As Google search results peter out, it’s becoming more important than ever to “build a relationship with your core readers,” Welch says.

Subscription-based publications, for example, haven’t been hit so hard. The ones feeling deep traffic losses are “outlets that really relied on a much more casual news reader who just sort of popped in and out,” per one senior New York Times editor.

Gaining subscribers and improving app quality are two of the strategies that digital publishers are seizing upon to sustain traffic, along with increasing the amount of video they produce.

“Advertisers want to put their money in areas that already have paying customers,” the Times editor notes, “because that means there’s a path to purchase through you.”

But Wait! There’s More

AI thinks it would be a good idea for people to make cookies out of an overly sweetened pasta sauce. People staunchly disagree. [The Guardian]

Meet the humans who make a living filling in when generative AI content services screw up. [BBC]

Threads is close to reaching X’s daily active user numbers. [TechCrunch

Perplexity AI’s plan for search ads looks nothing like Google. [Business Insider]

You’re Hired!

Tubi hires two senior Snap execs: Sharon Silverstein as senior VP and head of US industry verticals and Katelyn Kroneman as VP of finance and QSR verticals. [Variety] 

Tagged in:

Must Read

How TIME’s CMS Transition Laid The Foundation For Its AI-Driven Content Overhaul

The CMS migration helped unify TIME’s fragmented content data after years of platform transitions under multiple owners. This enabled TIME to launch its own AI search product and convert archival content into AI-friendly “markdown” pages.

Adobe Advertising Just Launched Its Own Custom Algorithms Product

Last week, Adobe Advertising announced the general release of its own Custom Algorithms product, which is “a huge departure from the TubeMogul days,” Erwin Castellanos, GM of Adobe Advertising, tells AdExchanger.

MFA Ad Spend Is Increasing. Is AI Slop To Blame?

This year, the percentage of ad spend going toward made-for-advertising (MFA) sites went up instead of down for the first time since 2023.

Privacy! Commerce! Connected TV! Read all about it. Subscribe to AdExchanger Newsletters

Kickbacks Takes An Outsider’s View While Bringing Ads To AI Agents

Andrew McCalip is a founding engineer at Varda Space Industries, where he oversees the manufacturing of things like hypersonic reentry vehicles and satellite buses.

CTV Buyers Are Getting The Show-Level Performance Optimization They’ve Always Wanted

A collaboration between InterMedia Advertising, Peer39 and Pontiac Intelligence provided show-level cost-per-acquisition data for 94% of CTV ad impressions.

Advertisers Await Programmatic Pause Ads

The IAB Tech Lab is working on standardizing programmatic signals for new streaming TV ad formats, including pause ads. Meanwhile, many brands are eager to add pause ads to their repertoire.