Access permissions to development sites

  • 2
  • Question
  • Updated 10 years ago
  • Answered
When I search for my website using Google, the search results included the development url (/ide.synthasite.com/sites/D5be/D778/D468/D5b3/U402881.....) I don't think public should be able to read or execute development sites. Is it possible to limit the access permissions to development box?

Thank you

Niddy
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
  • happy but hungry

Posted 10 years ago

  • 2
Photo of lisaretief

lisaretief

  • 114 Posts
  • 21 Reply Likes
Hi Niddy,

What you are calling the development url should never get into a Google search result unless you specifically submit it to Google via Google Webmaster or some other means (like for example link to it from another website). Only you can see that URL when you preview a page from within the Site Builder.

Sometimes users do get confused and copy that preview URL and distribute it, and that is a problem. But if you do not do that and only distribute a published site URL then your development URL should never be public.

About a year ago we corrected a problem where Google automatic indexing spiders were managing to find some of the development urls, but that was corrected and the necessary security measures were put in place. So we do agree with you that they should not be public and this is what we have implemented.

In your case, we would need to try and figure out how your development url got into the public and thus was indexed by Google. Did you distribute that URL in any way, or are there any web links to it that you know of? If there are no web links to it then it will disappear from Google's results in a few weeks.

Lisa
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
Hi Lisa,

Thank you for your reply. I didn't distribute the development url to anybody including Google webmaster tool or any other tools or to any chat rooms. The way I found out about this was searching my site on Google and it returned the development URL. Once I saw that, I went to look at Google Analytics and I found the development url(s) had been viewed over 350 times for the main page and over 20 times for each of the other pages.

I tested on Yahoo and MSN. I didn't find the development URLs yet.

Please let me know what should I do to solve this problem. I'm updating my site on a weekly basis for the weekly article, ingredient and recipe. So, I work on those 3 areas during the week and try to publish it on Saturday night. So it'd be very bad to have people look at my work in progress

My site is http://thaicookinghouse.com

Thank you very much for your help

Niddy
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
Good morning,

I just checked Google Analytics and found that the page views (of development url(s)) had been increased. I read Lisa email again and I think that people should only preview the development pages while they log in. Is it possible to increase access ability to preview development? For example, using IP address for each user or having password protection if they're not logging in.

Thank you

Niddy
Photo of lisaretief

lisaretief

  • 114 Posts
  • 21 Reply Likes
Hi Niddy,

We have now, based on this discussion, put in place some additional measures which will indicate to search spiders (such as Google) that they should not index development URLs. So this should prevent the situation that occurred for you - in a short while the existing case you identified should also drop off the search results. Then it should drop off Google Analytics as well.

While it would be ideal to limit the development (preview) URL to only the current user it is not the case at the moment and it will be difficult to implement. There is also no foolproof way - a user's IP does often change in the duration of a session.

It is a secret URL that is not linked to from anywhere (unless a user does so accidentally), so that should be enough.

We do take your input seriously and will look at ways to prevent further accidental spreading of the URLs.

In the meantime I do think the changed we have made (by using robots.txt files) will make a but difference.

Thanks as always,
Lisa
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
Thanks Lisa.
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
Hi

I'm sorry to bother you guys on this issue. My friend told me that when she types "Thai cooking classes, Corvallis, Oregon" in Google search box, it didn't return the live URL, instead it returned the development URL. So, I tested and she was right. Google returned the development URL as a second place on the first result page.
I went through 15 pages of the result pages and couldn't see the live URL - which I understand that my site might not yet be indexed or something.

But returning the development URL as their top 3 results? I'm getting worried again. I also checked the Google Analytics, the number view on main index.php of development box is staying the same since last week but other pages (on development box) were going up slowly especially classes.php page.

I appreciate you guys put some preventions in robots.txt file. What can I do on my side to help prevent this from happening?

My site is http://thaicookinghouse.com

thank you

Niddy
Photo of Niddy

Niddy

  • 67 Posts
  • 5 Reply Likes
Hi,

What if I rename the site on development box, will it help? I don't think it will help much because they both have the same content and keywords. Anyway, please let me know your thoughts on this.

Thank you

Niddy
Photo of lisaretief

lisaretief

  • 114 Posts
  • 21 Reply Likes
Hi Niddy,

What is happening is that Google has a reference to your development site. We have told Google to no longer index the site so it will eventually discard the reference. Neither you or we have any control over when that will be.

What I can say with certainty is that it will disappear off of Google's search results given time.

Lisa