# robots.txt - robot exclusion file - back-end server version - no robots! # ======================================================================== Sitemap: http://www.ncbi.nih.gov/pmc/site_map_index.xml User-agent: * Disallow: /pmc/utilities/ Disallow: /pmc/issues/ Disallow: /pmc/articles/ Disallow: /pmc/ivip/ Disallow: /pmc/articlerender.fcgi Disallow: /pmc/pagerender.fcgi Disallow: /pmc/picrender.fcgi Disallow: /pmc/tocrender.fcgi User-agent: Googlebot Disallow: /pmc/utilities/ Disallow: /pmc/*/bin/ Disallow: /pmc/*/pdf/ Disallow: /pmc/*/equ/ Disallow: /pmc/*.cgi User-agent: Slurp Crawl-delay: 1 Disallow: /pmc/utilities/ Disallow: /pmc/*/bin/ Disallow: /pmc/*/pdf/ Disallow: /pmc/*/equ/ Disallow: /pmc/*.cgi User-agent: MSNBot Disallow: /pmc/utilities/ Disallow: /pmc/*/bin/ Disallow: /pmc/*/pdf/ Disallow: /pmc/*/equ/ Disallow: /pmc/*.cgi