Robots & Site Map

All WYSIWYG Web Builder support issues that are not covered in the forums below.
Forum rules
PLEASE READ THE FORUM RULES BEFORE YOU POST:
viewtopic.php?f=12&t=1901

MUST READ:
http://www.wysiwygwebbuilder.com/getting_started.html
WYSIWYG Web Builder FAQ
Post Reply
lpug
 
 
Posts: 120
Joined: Thu Apr 05, 2018 10:15 am

Robots & Site Map

Post by lpug » Tue Feb 25, 2020 3:24 am

Are these still required, what is the significance of these in the page properties? even if I select robots index follow and doesn't create a robots file.
I'm assuming you have to create this manually together with a sitemap.xml?

Thanks

User avatar
BaconFries
 
 
Posts: 5230
Joined: Thu Aug 16, 2007 7:32 pm

Re: Robots & Site Map

Post by BaconFries » Tue Feb 25, 2020 4:37 am

You do not need to manually create a sitemap all you have to do is go to Menu -> Tools-> Site Map. As for the use of a robots.txt is entirely up to you but you will need to create this yourself manually with what you require not to be read.

Are these still required, again this is entirely down to you. The use of a sitemap is so the likes of Google, Bing and Yahoo can can read and understand how your site's pages are connected and how they are related to each other it also makes sense to use for SEO purposes.

The use of a robots.txt is similar to a sitemap again it allows the likes of web crawlers to read the contents but in this instance they will only be able to crawl / read what pages and areas you wish them to do so by excluding them from these.

What is the significance of these in page properties?
Well it outputs this as a meta tag as such (see example) and not as a robots.txt as thought.
<meta name="robots" content="noindex" />

Post Reply