Search engines team up for site crawling

By
Follow google news

Google, MSN and Yahoo adopt standard to speed up search engine indexing.

Search engines team up for site crawling
Yahoo and Microsoft have partnered with Google to support the Sitemaps 0.90 protocol. 

Sitemaps allow webmasters to craft an XML file containing information about recently updated pages. When a search engine's indexing program spiders the site, the Sitemap file informs it which pages require indexing.

The protocol was introduced in June 2005 by Google, which has published the technology under a Creative Commons licence.  

The indexing system will now be used by Windows Live Search and Yahoo Search in addition to Google Search.

"The launch of Sitemaps is significant because it allows a single, easy way for websites to provide content and metadata to search engines," said Tim Mayer, senior director of product management at Yahoo Search.

Google said that the Sitemap system saves bandwidth for site owners by letting spiders request fewer pages. It also streamlines the indexing process, making updated content available on the search engines sooner.

The three companies have launched a website that explains the Sitemaps protocol and how to generate the Sitemap XML files.

Webmasters can either hand-code the file themselves or use a Sitemap-generator from either Google or a third-party developer. 
Got a news tip for our journalists? Share it with us anonymously here.
Copyright ©v3.co.uk
Tags:

Most Read Articles

Australia Post deploys ThousandEyes across its retail network

Australia Post deploys ThousandEyes across its retail network

OpenAI fights order to turn over millions of ChatGPT conversations

OpenAI fights order to turn over millions of ChatGPT conversations

Microsoft launches tracker to manage autonomous AI in the workplace

Microsoft launches tracker to manage autonomous AI in the workplace

Teachers Mutual Bank automates KYC across brands

Teachers Mutual Bank automates KYC across brands

Log In

  |  Forgot your password?