Wednesday, April 16, 2008

Slurp 3.0 - New Crawler from Yahoo

After that Yahoo! exclamation yodeling, one more news from Yahoo! Search engine has been released by Sharad Verma & Yoram Arnon at Yahoo Search Blog.

Yahoo! has launched the upgraded web crawler - Slurp 3.0. This new Yahoo! Slurp 3.0 recognizes the same user-agent and all robots.txt directives for 'Yahoo! Slurp,' though it'll identify itself as Slurp 3.0 in your web logs and statistics but would not recognize directives specific to "Slurp/2.0.".

For more information -

I hope, this new crawler will be more efficient in crawling web pages and we could get more good search engine results.

No comments:

Post a Comment