[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [syndication] site-wide metadata discovery
On Thu, Oct 16, 2003 at 01:40:41PM -0400, Chad Everett wrote:
>
> Another thought would be to use comments in the robots.txt file. Something
> akin to embedding javascript in HTML comments. Comments are widely accepted
> in robots.txt and shouldn't cause any harm. Something like:
>
> #Public-Feeds: myPublicFeeds.opml
> #Format: http://www.opml.org/spec
> #Title: Public Feed List
>
> #Public-Feeds: feedindex.xml
> #Format: http://purl.org/ocs/directory/0.5/
> #Title: Public Feed List
>
> #Subscriptions: mySubscriptions.opml
> #Format: http://www.opml.org/spec
> #Title: My Subscriptions
Indeed.
http://www.robotstxt.org/wc/norobots.html says:
Comments can be included in file using UNIX bourne shell
conventions: the '#' character is used to indicate that preceding
space (if any) and the remainder of the line up to the line
termination is discarded. Lines containing only a comment are
discarded completely, and therefore do not indicate a record
boundary.
This sounds like the best suggestion so far.
Jeremy
--
Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo!
<Jeremy@Zawodny.com> | http://jeremy.zawodny.com/