Google exposing PSF posts

[bigfutz]

Can we disable the Google indexing of the content of our forum? You can't access the site without a membership, but you can read the content on Google, meaning
Google is basically storing a copy of all our posts. See example below.

https://www.google.com/search?q=WTB+sit ... sforum.com

 

[Avtomat-Acolyte]

This forum is open to the public and does not restrict viewing to registered members.

Log out, clear your cache and check for yourself.

 

[bigfutz]

My bad. Thanks for the clarification. I guess I should have read the fine print. Carry on.

 

[FunkyMonkey]

Actually, the site admin can set a cookie in the server (robots.txt, IIRC) that tells Google and other well-behaved spiders not to crawl the site. Doesn't affect regular web user in any way.

I always set it when I ran sites. Would highly reccomend it here, too.