Yahoo! Slurp Spiders

[Silent Pirate]

curious as to what those where...there is msn ones too..

[Tiki]

Spiders!!! Yikes!!

[kvnband]

Those are just the search engines crawling Birdboard. The slurp spider is yahoo search. Googlebot is google...
Kevin

[ILv2Go]

Can someone explain a bit more about these? TIA

[jenseits]

Search engines use programs -- called spiders, robots or 'bots -- that search the web for content and then catalog information about these pages. They "crawl" a page to read code and discover new pages by following hyperlinks - this is an iterative process that takes them all over the web over and over again.

The info about these pages is stored in giant databases called search engine indexes. Each search engine then uses a calculation (i.e. algorithm) to determine in what order the pages should be displayed when someone conducts a search for a particular term.

As Kevin said, each search engine spider has its own name so you can identify it when you're looking at your logs. Google = Googlebot; Yahoo = Slurp; MS Live = MSNbot. By looking at your logs you can see how often each search engine is visiting your site, how many pages they are crawling, how much bandwidth they're using up, whether there are any technical problems with your site etc.

Does that answer the question?

[PowerBBS]

Very well said jenseits!