# robots.txt file for Constant Contact image and archive servers # the Robots Exclusion Standard specifies that a bot will respect # the first record containing a User-agent prefix which matches their name, or contains "*" # http://www.robotstxt.org/wc/exclusion.html # # At this point, most search spiders support the following features: # User-agent - which spider does this set of rules apply to # Disallow - where should the spider NOT crawl # Allow - where can the spider crawl (not currently supported by MSN) # * - wildcard character # $ - end of line character (can be used to exclude file types) # # syntax for this document: # User-agent: # Disallow: /privatedir/ # Allow: /publicdir/ # # last updated 20100316 by Alex Bourgeois User-agent: * Disallow: / Allow: /docs/pdf/* Allow: /lp/images/standard/* Allow: /fs*/*/archive/*