mediapartners robot from google????????

  • 1
  • Question
  • Updated 10 years ago
  • Answered
how can i allow mediapartners robot from google to crawl my site if am not allowed to create my own robots.txt file and how can i then be expected to generate anything from google ads? Now what on earth is going on here? This doesnt make sense to me at all! I keep receiving 404(not found) as regards my robots.txt file. WHAT IS GOING ON?????
Photo of swv410


  • 1 Post
  • 0 Reply Likes
  • confused

Posted 10 years ago

  • 1
Photo of Kershnee


  • 2087 Posts
  • 152 Reply Likes
Hi SWV410,

If you get a message saying that your URL is blocked because of a robots.txt file, please ignore this! Google has simply tried to index the preview URL of one of your pages. A preview URL is what you see in your browser window when you open your site in the SynthaSite sitebuilder and then preview it. SynthaSite prevents Google from crawling these URL's as Google should not index unpublished sites. This message simply serves to indicate that everything is working correctly. This will not interfere with your search engine ranking or Google Webmaster's ability to return data about your site.

If you get a "Page not Found" or 404 error this probably means that there was a problem with your DNS server (the server of your domain name registrar) or that you had made a DNS change around the time that Google tried to index your site. Google makes an attempt approximately every 5 days, so you simply need to wait for the Google spiders to come around again and everything should be fine.