2dwebdesign.com
FREE HTML TEMPLATES
InktomiInktomi's popularity grew several years ago as they powered the secondary search database that had driven Yahoo!. Since then, Yahoo as switched to using Google as their secondary search and backend database, however Inktomi is just as popular now, as they were several years ago, if not more so. Their spiders are named "Slurp", and different versions of Slurp crawls the web many different times throughout the month, as Inktomi powers many sites search results. There isn't much more to Inktomi then that. Slurp puts heavy weight on Title and description tags, and will rarely deep crawl a site. Slurp usually only spiders pages that are submitted to its index. Here is a list of some of the sites that Inktomi provides results for:
As you can see, thats quite a list. Inktomi has may different versions of it's SLURP spiders. |