Google Content Scraping Debate

Comments debate whether Google unfairly scrapes and displays publishers' content in search results like snippets and AI overviews, profiting from ads while reducing traffic and revenue for original creators, with some defending it as essential indexing.

📉 Falling 0.5x Startups & Business
3,326
Comments
20
Years Active
5
Top Authors
#2015
Topic ID

Activity Over Time

2007
4
2008
38
2009
104
2010
111
2011
208
2012
119
2013
97
2014
114
2015
115
2016
86
2017
207
2018
144
2019
236
2020
277
2021
259
2022
232
2023
371
2024
319
2025
268
2026
17

Keywords

SEO AFAIK AI PageRank robots.txt GPT API E.g google content search revenue ads paywall websites web traffic sites

Sample Comments

booi Jan 17, 2020 View on HN

so that google can make money on their content?

tinus_hn Oct 17, 2016 View on HN

Google is not stealing traffic but it is stealing content by displaying it out of the original servers control. The real cost of a website is not hosting it but filling it with things people want to read. Content creators will want to get benefits such as ad revenue to compensate for their effort.

notyourwork Aug 17, 2017 View on HN

How does google profit from serving these pages opposed to original content creator?

gjs278 May 30, 2019 View on HN

google will get paid. you’ll be ripping off their publishers.

extropy Feb 12, 2021 View on HN

This is a tricky balance.No google are not profiting from borrowed content. You can always deindex yourself by robots.txt or otherwise.It's just google is providing a huge value to the market and content creators have gotten lazy and now waking up to that all other options of publishing are going away or are way more expensive.Google is in damage control mode. And will rather deindex all news sites, not pull search entirely.

buboard Jan 24, 2020 View on HN

why do people keep having their content for free for google to use? it doesn't make sense anymore. the google web social contract is broken, there is no tit for tat anymore. only paywall sites get it right now.

MrVitaliy Mar 10, 2011 View on HN

Would this make google's job on removing content aggregator slightly harder?

daleharvey Jan 28, 2011 View on HN

Google (in the context of search) produce no content of their own, are they ruining the internet?

jsight Aug 30, 2022 View on HN

Two words: Revenue optimizationEverything free on the web is optimized to maximize the delivery of advertisements and referrals at the expense of everything else. And Google no longer rewards credible sources vs ad-laden garbage.

chroma Jun 29, 2023 View on HN

Google isn't circumventing paywalls. Most paywalled sites whitelist search engines so that their content gets crawled and more people visit them.