[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [syndication] Can anyone guess the aggregator?

To: syndication@yahoogroups.com
Subject: Re: [syndication] Can anyone guess the aggregator?
From: Klaus Johannes Rusch <KlausRusch@atmedia.net>
Date: Thu, 03 Apr 2003 10:38:47 -0100
Organization: atmedia.net
References: <dz74snElG+i+EAB6@jblaptop.voidstar.com> <023101c2f9b8$19372be0$af382d0c@NOYDB> <063f01c2f9ba$3cf22290$2000a8c0@wkearney.com> <7NXRjsDRSBj+EA$B@jblaptop.voidstar.com>
Reply-to: KlausRusch@atmedia.net

Julian Bond wrote:

> Bill Kearney <ml_yahoo@ideaspace.net> wrote:
> >
> >> Once an hour from
> >> the same IP? That sounds like it might be a scraper, looking a little too
> >> hard to see if you've suddenly added an RSS feed that it can switch to.
>
> 170.224.8.76
> http://www.samspade.org/t/lookat?a=%09170.224.8.76
> isn't very helpful

The record does include a contact address. You could try adding these requests
to /robots.txt, which would help if the crawler complies with the Robots
Exclusion standard, otherwise if you want to stop the requests I would suggest
to email the tech contact for the network.

--
Klaus Johannes Rusch
KlausRusch@atmedia.net
http://www.atmedia.net/KlausRusch/

References:
- Can anyone guess the aggregator?
  - From: Julian Bond <julian_bond@voidstar.com>
- Re: [syndication] Can anyone guess the aggregator?
  - From: "Phil Ringnalda" <phil@philringnalda.com>
- Re: [syndication] Can anyone guess the aggregator?
  - From: "Bill Kearney" <ml_yahoo@ideaspace.net>
- Re: [syndication] Can anyone guess the aggregator?
  - From: Julian Bond <julian_bond@voidstar.com>

Prev by Date: Re: [syndication] Can anyone guess the aggregator?
Next by Date: Re: [syndication] Re: Autodiscovery (was: Fawcette's feed)
Previous by thread: Re: [syndication] Can anyone guess the aggregator?
Next by thread: Re: [syndication] Autodiscovery standards and formal specification
Index(es):
- Date
- Thread