Robots.txt File Blocked URL Google Ad Sense

  • 5
  • Question
  • Updated 9 years ago
  • Answered
Photo of Latrelle

Latrelle

  • 2 Posts
  • 0 Reply Likes
  • Frustrated

Posted 9 years ago

  • 5
Photo of UK Duke

UK Duke, Champion

  • 3321 Posts
  • 213 Reply Likes
It was probably a site builder URL which is blocked on purpose - not a problem for you.

Did it look something like this
http:/ / sitebuilder. yola. com/ sites/ D2ab/ D354/ D036/ Dcb2/ U8a49866a1dfd1ffb011e2bc630453ba2/ 8a49866a1dfd1ffb011e2bc893843c19/

Its normal - dont worry.
Photo of Sanja

Sanja, Official Rep

  • 10698 Posts
  • 495 Reply Likes
Hello Latrelle

I just sent you an email about this. I'll post here in case you don't get the email.

Here's a bit more information about this issue you see:

The URL in that message from Google is your preview URL (the URL of your unpublished site when you preview it) A robots.txt file blocks Google from indexing parts of your site and this would prevent them from placing ads on your site. Our unpublished sites have robots.txt files attached to them. This is in order to prevent Google from indexing your site before you publish it. As soon as your site is published Google can crawl your site and place ads.

This is what happens:

1. You paste Adsense code on your site.
2. You preview your site. Your previewed page acts like a web page with Adsense code, so Google attempts to index it, but we block Google from indexing your preview URL with a robots.txt file.

That is why you get this message. Please ignore it. It does not mean that you need to do anything. It has no impact on Google's ability to index your published website and it will not interfere with Google's ability to place advertising code on your site or with your advertising revenue. Once your site is published and the ads are displaying on your site, you can safely ignore that message. Over time, as you update your content and develop your site, the Google Ads will become increasingly relevant.
Photo of Latrelle

Latrelle

  • 2 Posts
  • 0 Reply Likes
Thanks, this help from what I am looking at on my Ad sense account they have blocked about 10 of my URL's I am getting less clicks and page impressions...
Photo of Tina

Tina

  • 2 Posts
  • 1 Reply Like
Where do I change the top of the robots.txt.file with yola so adsence can craw my site?

This reply was created from a merged topic originally titled
How Do I find the top of the robots.txt.file on yola so adsense can crawl?.
Photo of miss.mais

miss.mais

  • 2 Posts
  • 0 Reply Likes
i have two urls blocked due to robots.txt too.
Photo of Monique

Monique, VP of Customer Support

  • 6294 Posts
  • 446 Reply Likes
Can you post these URLs so we can investigate? I am willing to bet that they will be preview URLs (the long URL you see in the address bar of your browser when you preview your site) and not URLs from your published website. If this is the case you can simply ignore the message (see the explanation from Sanja, above). If I am wrong I would be happy to look into it for you.
Photo of miss.mais

miss.mais

  • 2 Posts
  • 0 Reply Likes
Thanks Monique. Now I have 3 blocked URLs.

1. http:/ / images. google. be/ imgres? imgurl= http:/ / 1. bp. blogspot. com/ _cJXPk-zFcHc/ SsS7FmWkqYI/ AAAAAAAAAJY/ RSbMeP99HeQ/ s320/ farmville_cropmastery. jpg&imgrefurl= http:/ / lookwhosstalking. blogspot. com/ 2009_10_01_archive. html&usg= __P55C9q0LMJ51-_c7wB7q1NeRkGk= &h= 290&w= 320&sz= 24&hl= nl&start= 44&um= 1&tbnid= qYvf0VogARUsbM:&tbnh= 107&tbnw= 118&prev= / images%3Fq%3Dfarmville%2Bflag%26ndsp%3D20%26hl%3Dnl%26rlz%3D1T4ADBF_nlBE259BE259%26sa%3DN%26start%3D40%26um%3D1

2. http:/ / images. google. com. ph/ imgres? imgurl= http:/ / 3. bp. blogspot. com/ _cJXPk-zFcHc/ StHf0Eqb6oI/ AAAAAAAAAPQ/ O0wKNlaQphM/ s320/ elevated. JPG&imgrefurl= http:/ / lookwhosstalking. blogspot. com/ 2009_10_01_archive. html&usg= __csP4EMa6g2xrHRc5qtO-Oq7IyS8= &h= 202&w= 320&sz= 19&hl= tl&start= 8&tbnid= pKJijf_oeWdBoM:&tbnh= 74&tbnw= 118&prev= / images%3Fq%3Dfarmville%2Bhill%26gbv%3D2%26hl%3Dtl

3. http:/ / translate. googleusercontent. com/ translate_c? hl= iw&sl= en&u= http:/ / lookwhosstalking. blogspot. com/ &prev= / search%3Fq%3DNEW%2BCROPS!%2BFarmers%2Bhave%2Blots%2Bto%2Bbe%2Bthankful%2Bfor%2Btoday!%2BCranberry,%2BPattypan%2BSquash%2Band%2BAcorn%2BSquash%2Bseeds%2Bare%2Bnow%2Bavailable%2Bin%2Bthe%2BMarket!%2BWe%2527ve%2Balso%2Bmade%2Bit%2Beasier%2Bto%2Bget%2Bfriends%2Bto%2BFertilize%2Byour%2Bcrops%26hl%3Diw%26sa%3DG&rurl= translate. google. co. il&usg= ALkJrhhleLVXP8UO3Qj1nsrbZ0h1b1CKpw

All are due to robots.txt.
Photo of Monique

Monique, VP of Customer Support

  • 6294 Posts
  • 446 Reply Likes
Those don't look like Yola URLs. They probably come from a widget you have added. Please post the link to your site so I can have a look where they come from. In any event they don't look like URLs that would have any impact on Google's ability to place ads on your site.
Photo of UK Duke

UK Duke, Champion

  • 3321 Posts
  • 213 Reply Likes
There all google URL's - Google obviously dont want them followed - nothing to worry about.
Photo of Donald

Donald

  • 2991 Posts
  • 37 Reply Likes
you can allow these through google.com/webmasters
Photo of Donald

Donald

  • 2991 Posts
  • 37 Reply Likes
it's probably marked with

Disallow: /link/