Master RSS List, Merging, and Updating...

[Morbus Iff <morbus@disobey.com>]

I'd like to get a communal opinion from the list members.

For my own little RSS project (to be released soon), I'm compiling a large
list of RSS channels. I'm pulling from XMLTree, GrokSoup, Weblogs,
Userland, Moreover, and a bunch of lesser places.

For each of the major lists, I'm compiling a subset of three lists:

  - "still there" channels.
  - channels updated in the last month.
  - "not there" (ie. 404) channels.

Finally, from those three subset files, I'm compiling three large master
lists, devoid of duplicates (or, at least as much as possible) of "still
there" channels, channels updated in the last month, and channels that were
once there, but are now MIA.

My sticky question is: once this supreme list is created, how often (or if
it all) should I recreate the list from scratch from all the other
providers (and merge the unique added entries in the supreme). Should I? Or
should I just keep adding to the supreme list from other sites,
submissions, and so forth?

Your comments are appreciated.

-- 
Morbus Iff
    _____
   |  (@ \
 __| <\/> |____.         Here we have Head-Wound Morbus who discovers
|  |------|    |          that flesh objects in motion tend to stay
|_ |______|_ __|          in motion until they hit metal and bleed.
  (_)      (_)

-05--- <\/> ---- <http://www.disobey.com/> --- Bad Ascii, Short Notice ----