Re: robots erro msg -- WEB400

× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.

Subject: Re: robots erro msg
From: David Gibbs <david@xxxxxxxxxxxx>
Date: Sun, 04 Nov 2007 10:42:34 -0600
List-archive: <http://archive.midrange.com/web400>
List-help: <mailto:web400-request@midrange.com?subject=help>
List-id: Web Enabling the AS400 / iSeries <web400.midrange.com>
List-post: <mailto:web400@midrange.com>
List-subscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=subscribe>
List-unsubscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=unsubscribe>
Openpgp: id=D1980033; url=http://pgp.mit.edu:11371/

Jim Franz wrote:

Looking for a good doc on how to populate a robots.txt file - customer
wants to make sure this is not interfering with search engine placement.
As usual, same cust does not want to spend$$ for this to be done by
professional search engine co.

AFAIK, this is the canonical reference ...
http://www.robotstxt.org/wc/robots.html

david

As an Amazon Associate we earn from qualifying purchases.

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.