[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Standard RSS location?



--- In syndication@egroups.com, "Stephen Tyler" <tuesday@g...> wrote:
> Most RSS aggregators are built with the assumption that a site
> publishes only 1 or at most a few RSS feeds.  So a single RSS
> aggregator will make only a very small impact on any given site.  
Why
> bother implementing code to automatically infer optimal update
> intervals, when the impact is so small?

I've just joined the list but have been reading back messages.  I 
developed a solution to this problem because I didn't want my 
aggregator spending more time than it needed to churning around the 
net.

My aggregator's first step is to read 
http://static.userland.com/myUserLandMisc/currentStories.xml
every hour after the Userland aggregator has finished its trawl.  I 
then extract the unique channel IDs from that list, cross-reference 
with my copy of the service list to get the URLs, and as a result, 
I'm only downloading from channels that I know have changed.

David

http://www.wc.cc.va.us/services/news/