The Clash Between Publishers and Google: Accusations and Allegations
In a landscape increasingly dominated by artificial intelligence (AI), the friction between content publishers and tech giants like Google is reaching new heights. Recently, Neil Vogel, the CEO of People, Inc.—one of the United States’ largest digital and print publishers—voiced his concerns about Google’s practices. He accused the tech giant of using its web crawler to benefit its AI products at the expense of content creators.
The Accusation: Google as a "Bad Actor"
Vogel articulated his frustrations during the Fortune Brainstorm Tech conference, highlighting a critical point: Google employs a single crawler for both its search engine and its AI applications. This dual-use practice raises ethical questions. "Google has one crawler, which means they use the same crawler for their search, where they still send us traffic, as they do for their AI products, where they steal our content," Vogel stated.
His remarks strike at the core of a larger dilemma that many publishers are grappling with. While Google serves as a traffic source for their websites, the concern is that its AI usage effectively undermines the value of their original content.
Declining Traffic and Revenue Concerns
The impact of Google’s practices on publishers has been evident in the declining referral traffic they receive from the search giant. Vogel provided alarming statistics: three years ago, Google Search accounted for around 65% of People, Inc.’s traffic. Today, that number has plummeted to the “high 20s.” This decline is not just a trivial point; it’s an existential threat to many media organizations that rely heavily on web traffic for revenue.
Despite this downturn, Vogel remains optimistic, stating, "I’m not complaining. We’ve grown our audience. We’ve grown our revenue." However, his optimism does not detract from his criticism of Google’s practices: "What is not right about this is: you cannot take our content to compete with us."
More Read
The Need for Publisher Leverage in the AI Era
Vogel argues that, in the age of AI, publishers require more leverage to negotiate fair terms. He advocates blocking AI crawlers—automated tools that scrape websites to train AI systems—as a way to compel technology companies into content deals. Notably, People, Inc. has secured a partnership with OpenAI, which Vogel describes as a “good actor” in contrast to Google.
To facilitate this, People, Inc. has adopted a solution from Cloudflare that allows them to block non-paying AI crawlers. This innovative approach not only highlights a shift in strategy for publishers but also poses questions regarding the evolving relationship between content providers and AI services.
The Impossible Dilemma: Blocking Google
Despite these efforts, Vogel acknowledges that blocking Google’s crawler is not feasible. Doing so would prevent their sites from being indexed in Google Search, effectively cutting off that crucial “20%-ish” traffic they still receive. "They know this, and they’re not splitting their crawler. So they are an intentional bad actor here," Vogel asserted.
This dilemma illustrates the power imbalance that exists between tech giants and content publishers, where the latter feels trapped by the very systems that are supposed to promote their work.
A Broader Perspective: Industry Insights
Janice Min, CEO of Ankler Media, echoed Vogel’s sentiments by describing large tech firms like Google and Meta as "content kleptomaniacs." She noted that her company opts to block AI crawlers entirely, reflecting a growing sentiment among publishers.
Matthew Prince, the CEO of Cloudflare, also weighed in on the topic, suggesting that regulatory changes might eventually compel AI companies to act differently. He raised an important point about copyright law, arguing that traditional legal approaches may not apply seamlessly to AI-generated content. Prince emphasized the challenge of navigating a legal framework designed for a pre-AI era and pointed out that current rulings have leaned favorably towards AI companies, complicating the situation for traditional content creators.
Future Predictions: Will Google Change?
Prince made a provocative statement, suggesting that “everything that’s wrong with the world today is, at some level, Google’s fault,” attributing this to the way Google has historically taught publishers to prioritize web traffic over quality content. He even speculated that by next year, Google may be compelled to compensate content creators for their material used in AI models, indicating a potential shift in how content is valued in an AI-driven landscape.
The ongoing dialogue between publishers like People, Inc. and tech giants such as Google encapsulates the complexities of modern media in an AI world. Striking a balance between ethical practices, fair compensation, and sustained traffic remains an evolving challenge. As the industry adapts, the voices of publishers are vital in shaping the future of content creation and distribution.
Inspired by: Source
