Robots.txt or workaround (Without Password!!)

  • 1
  • Question
  • Updated 4 years ago
  • Answered
Hi have Yola got round to adding the ability to add robots.txt files yet?
I don't want to use password protection but need some pages that aren't indexed.
If not does anyone have a good workaround?
Thanks
Philip
http://www.openformula.co.uk/

Sorry - logged into my customers gmail account so has come up as Doris - I am Philip!!!
Photo of doris Yoga

doris Yoga

  • 2 Posts
  • 0 Reply Likes

Posted 4 years ago

  • 1
Photo of Gop

Gop

  • 7473 Posts
  • 2115 Reply Likes
Hello doris Yoga aka philip,

Try adding the robots.txt to the Site Tracking Header section and then check it wih the webmasters tool to see if you get an acknowledgement.

Make sure there are no links within the site or any other link to the page otherwise the robot may index it even with a prohibitive robots.txt. (This can happen subsequently as well so that the robot.txt is acknowledged but a later link can over-ride the robots instruction).
Photo of Jen

Jen

  • 206 Posts
  • 24 Reply Likes
Yola does not offer access to the root directory of your site, which would allow you to edit your robots.txt file to prevent indexing of your site by search engines. As a workaround, if you are a Yola Silver or Yola Gold subscriber, you can add a meta tag to the Site Tracking Code area of your website:

1.Open your site in Sitebuilder
2.Click on Site > Tracking > Site Tracking Code.
3. Paste the following meta tag into the "Header Code" pane on the right-hand side of the screen:

For a site: <meta name="robots" content="noindex">
For a page: <a href="signin.php" rel="nofollow">sign in</a> Replace "signin.php" and "sign in" with the name and title of the specific page.

4. Republish your site.

Currently the only way to stop your sites from being indexed on Yola Bronze and Yola Free is to:

1. Password protect your site, you can find the steps to password protecting your site on this link: Adding Password Protection.

*None of the content that is behind the password protection will be indexed. The name of your site might still appear in the search results, but there will be no description of the contents.

2. Unpublish your site so that the search engines don't index your published site.

However, this would defeat the purpose of having a site, so we recommend the first option!
Photo of doris Yoga

doris Yoga

  • 2 Posts
  • 0 Reply Likes
many Thanks - Will try that