Welcome! Log In Create A New Profile

Advanced

The crawler does not follow Href links

Posted by roman 
The crawler does not follow Href links
March 22, 2007 06:42PM
I have setup a search engine www.mydoodo.com,While inexing,I had observed that the crawler does not follow the weblinks in the page indexed,Example,If I index www.yahoo.com,the crawler does not follow the href links found in Yahoo or any other domain which I index.

Please help
Re: The crawler does not follow Href links
March 22, 2007 07:04PM
If you want it to follow outside links you need to select it in the admin settings tab.

-----
Eric
Make Money with your Unused domains
http://www.parked.com/tour/?promo=455BD4CABB



Edited 2 time(s). Last edit at 03/22/2007 07:06PM by ehask71.
Re: The crawler does not follow Href links
April 01, 2007 12:29AM
Thanks for your message,You had mentioned that I need to do changed in the Admin panel settings so as to make the crawler follow the Href links(external links).

I checked the Settings tab in the Admin panel but was not able to figure out as what exactly need to be set in order to make the crawler follow the Href links,With regards to the same,I earnestly request you to kindly guide me in a detailed manner as what settings is to be checked in order to make the crawler do the above work,your assistance would be highly appreatiated.

Regards
Roman
Sorry, only registered users may post in this forum.

Click here to login