[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [syndication] Re: RSS feed filtered by keywords?



Rick Bradley wrote:

* Bill Kearney (ml_yahoo@ideaspace.net) [030204 10:16]:
But that assumes that it is practical to store all items flowing in
many-many feeds in a database.  What happens when instead of  200,000
feeds we are dealing with 200,000,000 feeds or even 200,000,000,000
feeds.  If the AOLs and the MSNs get the knack of RSS , then we got to
think of how this is going to scale way way beyond where we are today.
That's, frankly, bullshit.  That;s just another rendition of the old "it'll
never scale" argument.  Please.  So nothing should be tried in the interim?
Right now the run rate of feeds isn't approaching anywhere near the numbers
you're suggesting.  Yes, it's certainly possible that more people will start
sites.  Most won't stick to it so it's not like it'd matter.  As for resources
available, in the days of 200gb drives and 3gHz processors that hardly has any
bearing whatsoever.

FWIW (in agreement), unless something fundamentally changes in the
interim, when we have to deal with scaling to 200M or 200G feeds the
bottleneck will not be storage or processor power, it will be bandwidth.

Or really ... what\where is the bandwidth bottelnect that you are refering to ?

As long as our storage and processing capacity in this realm continues
to far exceed that needed to deal with the data coming down our pipes
arguments against scalability are mostly noise.

Don't get me wrong .. I know of no reason that RSS is not scaling just fine ... I just know that it is already beyond the point where I can personally read all the items flowing in the RSS river ... in fact I can't even keep up with all the items in the feeds to which I have personally subscribed. Now we can rely on Google , and personal browsing for discovery ... but that is slow and will miss a lot of the current flow. How do we go faster and beyond what Google and personal browsing can offer? Can you reliable and swiftly give me all the items that have talked about identity as it relates to formal logic on the semenatic web in the last week ?
Seth Russell
http://radio.weblogs.com/0113759/