Every Web-site should have a robots.txt sitemap, although it is a small object indeed. It gives directives to the crawler of ...