[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [syndication] Google and newsblaster



Hi,

Julian Bond wrote:
Mentioned on Scripting News.
http://radio.weblogs.com/0104308/RssDistillerChannels/

RSS versions of Google News and Columbia Newsblaster. Some questions:-

- Shouldn't this be produced by the source? Surely both Google and
Newsblaster could do it themselves.
most sites could, few actually do ;-)

Also, Google added rules in robots.txt to exclude robots, I would
think that applies to scrapers.

- What tech was used to produce them?
RssDistiller for Radio I'd say. It's a scraping tool, like Stappler.


Mike

--
Mike Krus                                       mkrus@newsisfree.com
http://www.newsisfree.com/blog/                        ICQ: 30900412