Robots & Site Map

[lpug]

Are these still required, what is the significance of these in the page properties? even if I select robots index follow and doesn't create a robots file.
I'm assuming you have to create this manually together with a sitemap.xml?

Thanks

[BaconFries]

You do not need to manually create a sitemap all you have to do is go to Menu -> Tools-> Site Map. As for the use of a robots.txt is entirely up to you but you will need to create this yourself manually with what you require not to be read.

Are these still required, again this is entirely down to you. The use of a sitemap is so the likes of Google, Bing and Yahoo can can read and understand how your site's pages are connected and how they are related to each other it also makes sense to use for SEO purposes.

The use of a robots.txt is similar to a sitemap again it allows the likes of web crawlers to read the contents but in this instance they will only be able to crawl / read what pages and areas you wish them to do so by excluding them from these.

What is the significance of these in page properties?
Well it outputs this as a meta tag as such (see example) and not as a robots.txt as thought.
<meta name="robots" content="noindex" />