i want to change my robots.txt

  • 1
  • Question
  • Updated 7 years ago
  • Answered
i am running a website on synthasite, now i want to change my robots.txt can u please help me how can i upload or change robots.txt file?
Photo of kavi

kavi

  • 11 Posts
  • 0 Reply Likes
  • sad

Posted 10 years ago

  • 1
Photo of Ruth

Ruth

  • 2819 Posts
  • 135 Reply Likes
A robots.txt file is a file that informs search engines which files/directories of the site you do NOT want indexed. If you do not add a robots.txt file then your entire site will be indexed.

See: Google Help page for more information on this topic. Are there any parts of your site that you do not want indexed? If not, you do not need to add a robots.txt file to your site.
Photo of Joe El Khoury

Joe El Khoury

  • 15 Posts
  • 0 Reply Likes
Hello, I have some pages on my site that I do not want to be indexed on search engines... I see that it is not possible to edit the robots.txt file, so do you have a workaround?
Photo of Stefan

Stefan, Official Rep

  • 4448 Posts
  • 190 Reply Likes
Hello Joe

The best workaround would currently be to password protect the pages you don't want to be indexed by search engines.
Photo of Joe El Khoury

Joe El Khoury

  • 15 Posts
  • 0 Reply Likes
Thank you Stefan :)
I read somewhere that I can add a code to the meta data of the pages that I do not want indexed: <meta name="robots" content="noindex" />
Would it work if I just add it to a html box in my page?
Because the point is that these pages I want to hide are mobile optimized, so I do not want them to appear in search results but I want my customers to access them through my mobile app... this is why I prefer not having to password protect them.

Anw, than you once again for your support, and please consider adding an option to edit robots.txt, a bit like the option of editing the description and keywords of our pages, because it would really be helpful! my issue is just one example of why we would need to edit the robots.txt file.

tc :)
Photo of Laura Thomas

Laura Thomas, Social Media Coordinator

  • 4536 Posts
  • 211 Reply Likes
Hi Joe,

You cannot add robots code via the HTML widget on your website. However, if you are a Yola Silver member we provide a mobile publishing feature that handles the optimization for you. I was unable to find an account for you searching by the email address associated with this forum so I do not know your current account level. You can learn more about Yola Silver here and if you're already a member and need help with mobile sites, please let us know.
Photo of Joe El Khoury

Joe El Khoury

  • 15 Posts
  • 0 Reply Likes
hehe I've got a Bronze account. Thanks anw :)