« Radio Publish and subscribe walkthrough | Home | Quote on baseball from The West Wing »

April 10, 2002

Yahoo and Google page harvesters

It's interesting to see how pages and sites get sucked up into Google.  If you search 'Paul Holbrook radio userland' on google right now, you only come up with one relevant entry:

Radio UserLand : Discussion Group
... Post vs publish? Paul Holbrook, 3, 18, 4/9/2002 ... Mozilla/Netscape on Mac, Paul Eliasberg,
1, 15, 4/5 ... 2002 UserLand Software, Inc. Radio UserLand and Radio are ...
radio.userland.com/discuss/ - 71k - 09 Apr 2002 - Cached - Similar pages

On the other hand, if you do the same query on Yahoo right now, which uses Google for web page matches, you get these results:

  1. Radio UserLand : Discussion Group
    ... Post vs publish? Paul Holbrook, 3, 18, 4/9/2002 ... Mozilla/Netscape on Mac, Paul Eliasberg,
    1, 15, 4/5 ... 2002 UserLand Software, Inc. Radio UserLand and Radio are ...
    http://radio.userland.com/discuss/

  2. Paul Holbrook's Radio Weblog
    ... 55 PM. Copyright 2002 Paul Holbrook. Click here to
    visit the Radio UserLand website. April 2002. Sun, ...
    http://radio.weblogs.com/0106188/

  3. Weblogs.Com: Recently Changed Weblogs
    ... 2:30 AM. 32. Paul Holbrook's Radio Weblog, 2:30 AM. ... 03 AM. 220. Phil Ackley's Radio
    Thingumabob, 12:03 AM. ... AM. Copyright 1999-2002 UserLand Software, Inc. ...
    http://www.weblogs.com/

  4. Referer rankings for Wired News
    ... Radio Weblog, 1. 18. Paul Holbrook's Radio Weblog, 1. 19 ... 26. Brian Tol's Radio Weblog,
    1. 27. xio, 1. ... Copyright 2001-2002 UserLand Software, Inc. Last update ...
    http://subhonker6.userland.com/rcsPublic/referers?site=Wired%20News&group=rss
    More Results From: subhonker6.userland.com

  5. Vacuum Weblog by Edward Vielmetti
    ... Paul Holbrook has a new weblog running using Radio Userland. I've known Paul since
    our days at CICnet together, where we wrangled Gopher servers. We share ...
    http://www-personal.umich.edu/~emv/project/vacuum/

  6. InfoWorld's Next-Generation Web Services Conference
    ... http://radio.weblogs.com/0101359 ... Cape Clear Software. *Steve Holbrook, Web Services
    Tech ... David Winer (Userland) – Keynote Address, 09 ... Paul Holland, Venture Partner ...
    http://nextgen.infoworld.com/presentations.asp

Clearly, Yahoo is using a different crawl cycle and a different data set for its search results. Yahoo has found my web site, but Google hasn't.