HACKER Q&A
📣 metadat

Are Paywalls allowed to show Google crawler full content but not users?


Today I noticed the Washington Post I'd quite naughty.

Even when you click through from a Google search, they still gate the article content behind a paywall. Clearly they fed the full article to Google bot and Google news, but then show a different page, sans article content, to web users.

Is this a violation of Google search policy? If yes, does Google even care enough to enforce it?

I think this sort of publisher behavior makes for a hostile and overall very poor user experience.

.. Especially when Wapo is already bankrolled by greedy Uncle Jeff. But I digress.


  👤 lusbuab Accepted Answer ✓
Some news sites use certain Structured Data (schema.org, hasPart in combination with accessibleForFree:false) for that - telling crawlers about the content behind the registration wall / pay wall.

👤 jzl
You can't cloak, which means serving different content.

https://developers.google.com/search/docs/advanced/guideline...


👤 altdataseller
Google does not care. They make the rules - not follow them.

👤 2ICofafireteam
View their cached version.

👤 wmf
Google has allowed this for years unfortunately.

👤 jamjamjamjamjam
Become a robot and enjoy the benefits no captcha and no paywalls

👤 arcastroe
You may be interested in 12ft.io

It tricks sites into thinking you are a search engine so you get the full site without paywall