Re: [syndication] Digest Number 794

["Pino Calzo" <pino@calzo.com>]

I find it even more ironic to find NewsIsFree-generated Sources within 
fastbuzz and i don't remember being asked or having given a permission to 
do so. Syndic8 and Daypop have done this. Dror - would ask you to read 
policies, too.

Regards
Pino Calzo


------------- Original message follows -------------

There are 2 messages in this issue.

Topics in this digest:

      1. Yahoo groups rss blocking since 01/13/2004
           From: "dror" <dror@zapatec.com>
      2. Re: Yahoo groups rss blocking since 01/13/2004
           From: Jeremy Zawodny <jeremy@zawodny.com>


________________________________________________________________________
________________________________________________________________________

Message: 1
   Date: Wed, 14 Jan 2004 19:32:47 -0000
   From: "dror" <dror@zapatec.com>
Subject: Yahoo groups rss blocking since 01/13/2004

Hi Folks,

There's plenty of irony in here. 

We at fastbuzz.com provide an online aggregator and search engine. We
have hundreds of users and so poll many thousands of channels.

Yahoo started blocking us yesterday from polling Yahoo group rss
feeds. It looks like they have some threshold, (around 400?) of the
number of groups that they will let you poll in a day. 

I couldn't find anywhere either on
http://news.yahoo.com/rss/
or on
http://groups.yahoo.com/
about what the policy is with regard to their rss feeds and polling.

This is a similar problem that we've seen with slashdot about a month
ago. Slashdot at least had a stated policy on what their requirement
was. They didn't want you to poll more than every hour. The cluless
part of their policy was that they this requirement was for *all*
channels. So if you subscribed to all 12 channels you had to do it
over a period of 12 hours.

I can understand that the publishers want to make sure that their
resources don't get abused. But we're actually making their lives
easier. Instead of having a lot of desktop applications go and fetch
the same feeds again and again, we do it in one centralized place, and
then the readers come to our site. 

So if anyone has any clarifcations on Yahoo's policies on this, or can
point me to a URL about this, or even better get us unblocked, I'd be
greatful.

As for the irony:
This *is* a yahoo group, which means that I won't be able to see the
responses in my aggregator.

Regards,

Dror

--
Dror Matalon
Zapatec Inc
1700 MLK Way
Berkeley, CA 94709
http://www.fastbuzz.com
http://www.zapatec.com



________________________________________________________________________
________________________________________________________________________

Message: 2
   Date: Wed, 14 Jan 2004 12:54:59 -0800
   From: Jeremy Zawodny <jeremy@zawodny.com>
Subject: Re: Yahoo groups rss blocking since 01/13/2004

On Wed, Jan 14, 2004 at 07:32:47PM -0000, dror wrote:
> 
> So if anyone has any clarifcations on Yahoo's policies on this, or can
> point me to a URL about this, or even better get us unblocked, I'd be
> greatful.

I can probably help track this down.  Ping me off-list at
jzawodn@yahoo-inc.com with some extra info, including:

  1. dates/times of when blocking started

  2. ip address(es) you're coming from

  3. frequency of polling

  4. a sample of the URLs you're attempting to fetch

Jeremy
-- 
Jeremy D. Zawodny     |  Perl, Web, MySQL, Linux Magazine, Yahoo!
<Jeremy@Zawodny.com>  |  http://jeremy.zawodny.com/


________________________________________________________________________
________________________________________________________________________




------------------------------------------------------------------------
Yahoo! Groups Links

To visit your group on the web, go to:
 http://groups.yahoo.com/group/syndication/

To unsubscribe from this group, send an email to:
 syndication-unsubscribe@yahoogroups.com

Your use of Yahoo! Groups is subject to:
 http://docs.yahoo.com/info/terms/ 
------------------------------------------------------------------------