# Robots.txt # Allow all robots to spider the domain User-agent: * Disallow: # Disallow directory /_assets/server/ User-agent: * Disallow: /_assets/server/ Disallow: /_assets/client/js/ Disallow: /possible-duplicate-site/ Disallow: /news/ sitemap: http://www.absoluteworld.net/sitemap.xml