Edit "robots.txt"...

  • 4
  • Idea
  • Updated 11 years ago
There should be a way to edit the "robots.txt" file, an editor built into SynthaSite would be great.
Photo of Techjar


  • 122 Posts
  • 3 Reply Likes
  • confident

Posted 11 years ago

  • 4
Photo of Emmy


  • 5892 Posts
  • 299 Reply Likes
Hi Techjar,
At this time it is not possible to edit the robots.txt file. I will give this feature request to our engineers for future consideration.

Photo of zycorpforever


  • 7 Posts
  • 0 Reply Likes
I got this from Google: We noticed that the AdSense ad crawler is having some issues accessing your site on rent-it-in-america.com. The issue appears to lie within your robots.txt file, which is blocking our ad crawler from viewing certain sections of your site. Over a four day period earlier this month, we detected 69 failed crawl requests. Because of this, your AdSense ads are less targeted and are generating less revenue on average.

To fix this, you’ll need to edit your robots.txt file to allow our AdSense crawler by adding these two lines to the very top:

When will we be able to edit the robots.txt file?