robot txt

  • 1
  • Question
  • Updated 6 years ago
  • Answered
how to change in file robots.txt from disallow googleboot to allow on site instrukcijenaravoslovja.yolasite.com so google colud find me? Why on Yola you did that? So now google cant find my site. At the begining google ranked me on first place on first page, now when people on yola change from allow to disallow parameter in robots.txt. Is this because it is free package? Common you yola workers, my bussiness depends on you.
Photo of naravoslovne.instrukcije

naravoslovne.instrukcije

  • 6 Posts
  • 0 Reply Likes

Posted 6 years ago

  • 1
Photo of naravoslovne.instrukcije

naravoslovne.instrukcije

  • 6 Posts
  • 0 Reply Likes
how to change in file robots.txt from disallow googleboot to allow on site instrukcijenaravoslovja.yolasite.com so google colud find me? Why on Yola you did that? So now google cant find my site. At the begining google ranked me on first place on first page, now when people on yola change from allow to disallow parameter in robots.txt. Is this because it is free package? Common you yola workers, my bussiness depends on you.

This reply was created from a merged topic originally titled
robotstxt.
Photo of Gop

Gop

  • 7473 Posts
  • 2115 Reply Likes
Hello naravoslovne.instrukcije,

Yola free accounts and yola sub-domains don't have access to the robot.txt file. This is because the google bot can only read this in the head of the document.

May I ask why you think that the robot.txt file includes a disallow statement?
Photo of naravoslovne.instrukcije

naravoslovne.instrukcije

  • 6 Posts
  • 0 Reply Likes
I dont think! I know, because in google analytics report that robot.txt on my page include disallow statment and you can see it. Dont play smart.
Photo of Gop

Gop

  • 7473 Posts
  • 2115 Reply Likes
Really I wasn't playing smart and I do apologise if this came across as such.

I have tried many times to modify the robot.txt as a fellow user and I honestly didn't know how to check the txt file for this.

I suppose it's possible that Yola may have done some global modification of the file and I really was wanting to know how you saw the file associated with your site. I haven't seen any thing announced to the fact but I can't say that I read all announcements either. Once again I'm sorry if this sounded off.
Photo of Stefan

Stefan, Official Rep

  • 4448 Posts
  • 190 Reply Likes
Hello naravoslovne.instrukcije

If you get a message saying that your URL is blocked because of a robots.txt file, please ignore this. Google has simply tried to index the preview URL of one of your pages.

A preview URL is what is used when you open your site in the Yola Sitebuilder and then preview it. Yola prevents Google from crawling these URLs as Google should not index unpublished sites. This message simply serves to indicate that everything is working correctly. It will not interfere with your search engine ranking or Google Webmaster's ability to return data about your site.

As long as your site is published and you have submitted the correct, published URL, Google will be able to index your site. If you get a "Page not Found" or 404 error this probably means that there was a problem with your DNS server (the server of your domain name registrar) or that you had made a DNS change around the time that Google tried to index your site. Google makes an attempt approximately every 5 days, so you simply need to wait for the Google spiders to come around again and everything should be fine.
Photo of naravoslovne.instrukcije

naravoslovne.instrukcije

  • 6 Posts
  • 0 Reply Likes
ok you all see this...

http://instrukcijenaravoslovja.yolasi...

is that enough.... and then type in google inštrukcije naravoslovja, and you will see nowhere my page, but on first 3 months it was on first page, first place.... Why!
Photo of Stefan

Stefan, Official Rep

  • 4448 Posts
  • 190 Reply Likes
Hello naravoslovne.instrukcije

If you have recently published your site, please be aware that Google has a "Freshbot" – a daily crawler, which picks up newly-submitted URLs - which most likely picked up your site. This is why your site was listed quickly.

You can get dropped off the Google rankings quite easily and hopefully once the main Googlebot crawls your site it will appear in the rankings more consistently. I hope this helps explain why your site isn't listed.

Yola has developed a short series of SEO Tutorials which will take you through the process of building, maintaining and promoting your website with search engine optimization in mind, here is a link: SEO Tutorials.