################################################################################# # INSTRUCTIONS: # This file goes in "hidden" directories of your site. # Add "disallow" lines for each sub-directory that you do not want crawled. # EX: "Disallow: /reports" would exclude the reports folder # # NOTES: # The * used in the "User-agent" line is a special case; # you may not use wildcards for the "disallow" line - just use additional lines. # # META Info: # As an added measure, you'll want to put the following code in the files # that you do not want indexed: # # ################################################################################# User-agent: * Disallow: /