preventing google indexing

  • 1
  • Question
  • Updated 10 years ago
  • Answered
How can you prevent Google indexing your site?
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes

Posted 10 years ago

  • 1
Photo of Ruth

Ruth

  • 2819 Posts
  • 135 Reply Likes
Hi Peter,

You can prevent Google from indexing your site by adding a robot.txt file to your site.

A robots.txt file is a file that informs search engines which files/directories of the site you do not want indexed. If you do not add a robots.txt file then your entire site will be indexed.

See: http://www.google.com/support/webmast... for more information on this topic.

Are there any parts of your site that you do not want indexed? If not, you do not need to add a robots.txt file to your site.
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
Hello Ruth,

Thank you for that guidance

I now understand the creation of the file now with the two rules. I don't know how or where to place the generated file as directed:

{robots.txt}
User-agent: *
Disallow: /

"Once you've created your robots.txt file, save it to the root of your domain with the name robots.txt. This is where robots will check for your file. If it's saved elsewhere, they won't find it."

Where and what is the "root of the domain". I'm lost on that point
Photo of saph

saph

  • 4 Posts
  • 0 Reply Likes
No one can seem to give me an answer either Peter.

I do no t wish to password protect my site, but simply uploading the robots.txt file to the file manager doesn't work.
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
Hello Saph,

At this time there isn't a solution with Synthasite.

Monique and Emmy have suggested that it could be added as a feature if the requests for it were significant. There are 4 references to this requirement in this forum.
Photo of saph

saph

  • 4 Posts
  • 0 Reply Likes
Thanks for your reply Peta :)

Lets hope people see this and add their support lol
Photo of Emmy

Emmy

  • 5892 Posts
  • 299 Reply Likes
Hi Saph,
Peter is right, at this time it is not possible to edit the robots.txt file. This is something we will look into for the future.

Kind Regards,
Emmy
Photo of Cosmic Sensorium

Cosmic Sensorium

  • 102 Posts
  • 5 Reply Likes
hey guys, an option you might consider is using noindex meta attributes. it's not really equivalent to a robots.txt file, but the tag can tell search engines not to index pages in your site.

To prevent all robots from indexing a page on your site, drop an html widget on your page and place the following meta tag in it (without the <!--- and --->, that's just there so that the code displays):

<!---
<meta name="robots" content="noindex">
--->

If you only want to keep Google from indexing your page, place this code instead:
<!---
<meta name="googlebot" content="noindex">
--->

here's some more info:
http://www.google.com/support/webmast...

and here's a comparison between using noindex, nofollow and the robots.txt file:
http://www.seobook.com/robots-txt-vs-...

hope this helps!
Photo of Emmy

Emmy

  • 5892 Posts
  • 299 Reply Likes
Thanks for adding this!

Emmy
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
Diogenes,

That's great research. Thank you for the work you've put in on this. Very helpful.

Peter.

!{Monique,

Consider this for the new awards!}
Photo of Cosmic Sensorium

Cosmic Sensorium

  • 102 Posts
  • 5 Reply Likes
glad to help! I just happened to stumble upon it when changing my site around a bit. I wanted to block some pages on which I put redirects.
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
D,

Would you know if the order of placement is important. i.e. should it be as close as possible to the top of the page or irrelevant?
Photo of Cosmic Sensorium

Cosmic Sensorium

  • 102 Posts
  • 5 Reply Likes
I've used it on the very top of the page and it seems to have worked nicely.
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
Great.
Photo of Peter

Peter

  • 2569 Posts
  • 113 Reply Likes
Thanks Shaq,

If you check just a few lines up you will notice that Cosmic Sensorium has given the answer to blocking Google and other crawlers from indexing sites on SynthaSite.

It's a great answer I think.
Photo of Shaq

Shaq

  • 868 Posts
  • 5 Reply Likes
I already know how to block and that. lol..... thanks tho