robots erro msg -- WEB400

× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.

Subject: robots erro msg
From: "Jim Franz" <franz400@xxxxxxxxxxxx>
Date: Sun, 4 Nov 2007 09:47:06 -0500
List-archive: <http://archive.midrange.com/web400>
List-help: <mailto:web400-request@midrange.com?subject=help>
List-id: Web Enabling the AS400 / iSeries <web400.midrange.com>
List-post: <mailto:web400@midrange.com>
List-subscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=subscribe>
List-unsubscribe: <http://lists.midrange.com/mailman/listinfo/web400>, <mailto:web400-request@midrange.com?subject=unsubscribe>

[error] File /xxx/robots.txt does not exist
[error] URI in request GET /robots.txt HTTP/1.0 is not valid

Looking for a good doc on how to populate a robots.txt file - customer
wants to make sure this is not interfering with search engine placement.
As usual, same cust does not want to spend$$ for this to be done by
professional search engine co.
jim

As an Amazon Associate we earn from qualifying purchases.

Follow-Ups:

Re: robots erro msg , Bryan Dietz
Re: robots erro msg , David Gibbs

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.