Welcome! Log In Create A New Profile

Advanced

Leaving notice of spider vist on server?

Posted by Minuteman 
Leaving notice of spider vist on server?
May 29, 2007 06:35PM
Hello all,

This is my first visit to the forum so thanks to the admin for providing this.

I have a script on my server, provided by the hosting company, that reports when a spider hits the site.

Sphider, however, doesn't leave any sign that it has been there. I would like to let the sites on my SE know that the spider has visited their site.

Would that be hard to do? Or is it already part of Sphider and I have something misconfigured?

Thanks

Maker of BungeeBones.com
An Income generating Link Exchange for webmasters



Edited 1 time(s). Last edit at 05/29/2007 06:37PM by Minuteman.
Re: Leaving notice of spider vist on server? SOLVED
May 30, 2007 12:33AM
I'll reply to my own post, in case someone else gets curious about this.

The script on my host that gets the stats is AWStats, and open source software. They say on their site how many robots their script will pick up (over 300) and how many search engines (over 100). Apparently you have to be on their list to get picked up.

Maker of BungeeBones.com
An Income generating Link Exchange for webmasters
Re: Leaving notice of spider vist on server? SOLVED
June 01, 2007 09:39AM
More about this topic at: http://www.antezeta.com/awstats/robots.html
Sorry, only registered users may post in this forum.

Click here to login