# # SoftwareMedia.com robots.txt # # It's pretty simple, folks. # # Most crawlers are welcome to traverse our site, so long as a few simple # guidelines are observed: # # * Adhere to the directives in this file. # # * Don't pretend to be something you're not (e.g. Internet Explorer or # googlebot). Provide an accurate User-Agent string, including a url to a # page about the crawler. # # * Moderation, please. With the exception of the home page, limit your # crawler to 1-2 hits per URL each day. 15000+ hits/day on 500 unique URL's # is pretty hard to miss, even when it comes from 50 unique IP's. # # * No URL hacking. Excessive use of query string parameters is frowned upon # and will quickly catch our attention. # # We take these policies quite seriously. We employ certain automated measures # to detect and neutralize abuse of our goodwill and bandwidth. # # Those who fail to comply are subject to the whims of our zany sysadmins. # Depending on what sort of mood they are in, the penalties range from # receiving inaccurate content or comical messages to being banned outright. # No one has been subjected to goatse just yet, but it hasn't been ruled out as # a possibility. # # So play it safe. Go ahead and use your tools, just don't be one. # # # If you have questions about these policies, or want to learn more about web # services we offer (e.g. automatic product pricing feeds), please email # webmaster@softwaremedia.com. # User-Agent: * Disallow: /account/ Disallow: /cart/ Disallow: /checkout/ Disallow: /search/ Disallow: /category/-1.html Disallow: /page/pop_up/ Disallow: rel.softwaremedia.com