Sam_uk

u/sam_uk@slrpnk.net
23 posts · 35 comments

Recent posts

Recent comments

on Anti SEO? · c/meta · 2 pts · 272d

I think it would just be

User-agent: *
Disallow: /
User-agent: Googlebot
Allow: /
on Anti SEO? · c/meta · 1 pts · 273d

I wonder if it was a short term fix that got forgotten about..

on Anti SEO? · c/meta · 2 pts · 273d

In the bottom

User-agent: *
Disallow: /

Blocks all scrapers and superseeds the text above AFAIK