[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [syndication] Google and newsblaster
Hi,
Julian Bond wrote:
Mentioned on Scripting News.
http://radio.weblogs.com/0104308/RssDistillerChannels/
RSS versions of Google News and Columbia Newsblaster. Some questions:-
- Shouldn't this be produced by the source? Surely both Google and
Newsblaster could do it themselves.
most sites could, few actually do ;-)
Also, Google added rules in robots.txt to exclude robots, I would
think that applies to scrapers.
- What tech was used to produce them?
RssDistiller for Radio I'd say. It's a scraping tool, like Stappler.
Mike
--
Mike Krus mkrus@newsisfree.com
http://www.newsisfree.com/blog/ ICQ: 30900412