Basic robots.txt format

User-agent: [user-agent name]
Disallow: [URL string not to be crawled]

Here it in in practice:

User-agent: Googlebot
Disallow: /example-subfolder/

Leave a Reply

Your email address will not be published. Required fields are marked *