Aug 8, 2012

How to disallow robots on your webpage


1) make "robots.txt" file in a folder that you want to disallow to collect information.
2) in the txt file,
        user-agent:googlebot
        disallow:All


http://www.robotstxt.org/robotstxt.html

No comments:

Post a Comment