search engines....seperate crawls and how frequent?

  • 1
  • Question
  • Updated 8 years ago
  • Answered
do the search engines google yahoo bing etc have seperate crawlers.and do they crawl less frequently. I notice some sites that are coming up in google search are nowhere to be seen in yahoo or bing even after the url has been submitted to them. Is it just a waiting game or am I missing something?
Photo of shay

shay

  • 34 Posts
  • 1 Reply Like

Posted 8 years ago

  • 1
Photo of Sanja

Sanja, Official Rep

  • 10698 Posts
  • 495 Reply Likes
Hello Shay

It can definitely be a bit of a waiting game! It can take a few weeks to a few months before your site is indexed.

There are many Yola sites that perform well in the search engines, but this has to do with time and effort that is put into search engine optimization (SEO); and not the site builder itself. The Yola Site Builder provides areas for adding Google Webmaster verification code, title description and keywords meta tags; as well as ways to optimize your text and images.

Yola has also put together a great deal of documentation to help you with SEO, here is what we have for you: http://www.yola.com/tutorials/categor...

I hope this information is helpful to you. If you have any further questions, please let me know.
Photo of shay

shay

  • 34 Posts
  • 1 Reply Like
hello sanjay... you still didnt answer my question! do the search engines crawl seperately and less ffrequently ie yahoo bing, your advise on google webmasters works for google but what about yahoo bing etc. I see alot of sites on google that are nowhere to be seen on yahoo or bing ...
Photo of Brianna

Brianna

  • 2045 Posts
  • 92 Reply Likes
Hi Shay,

Search Engines do crawl separately - for example, Google, Bing and Yahoo each have their own indexing process. I am unsure how frequent they crawl but will ask colleagues who are specialized in SEO to share any further information in this regard with you that they may know of.

Right now we only have an option for you to add a Google meta tag as this is by far the most popular search engine. If the popularity of other search engines grows we may consider adding support for verifying your site with them in future. In the meantime you can submit your URL to bing here: bing.com and to Yahoo here: siteexplorer.search.yahoo.com.

I hope you find the information I have provided for Yahoo and Bing helpful and appreciate your patience as I ask my colleagues trained in SEO to add anything further for you.
Photo of Emmy

Emmy

  • 5892 Posts
  • 299 Reply Likes
Hi Shay,
The search engines will all crawl at a different pace and with their own algorithm, so it won't be the same from engine to engine. That said, the frequency at which a search engine crawls a site has a lot to do with how often the site is updated, page rank etc. A huge site with high page rank that is frequently updated and changing, such as amazon or ebay, gets crawled extremely often, while a site that doesn't change much might only get crawled once a month.

The process of crawling is not only so that search engines can find newly launched websites, but so that they can try to always have the most updated version of a site in their index, this is why frequent updating of a site will keep the engine's coming back. Crawling and indexing is completely algorithmic and will be different for each site. Here is a link with a bit more general information on the process: How often does Google crawl the web.

I know you were curious about how this process differs between all of the search engines, and it's hard to say as they all have their own unique algorithm. However, SEO techniques and frequent updating of your site will be beneficial to your site's indexing and ranking in each of the search engines.

I hope that helps.

Emmy