Welcome! Log In Create A New Profile

Advanced

Also Having "Top Only Spidering" Problem

Posted by MarketRaid 
Also Having "Top Only Spidering" Problem
March 16, 2007 08:29PM
I'm having some problems. For some reason Sphider is only grabbing 4 links from the URL http://www.HowToMakeMoneyWithA.com, and none of the articles. Trying to see what I can do.

I'm a PHP/MySQL developer so if it needs some modification I can look into it, just wondering if anyone else knows a fix for this problem.

Thanks, and I LOVE THE SCRIPTS! Can't wait to write modifications. smiling smiley
Re: Also Having "Top Only Spidering" Problem
March 17, 2007 10:41AM
Try indexing http://howtomakemoneywitha.com/ (i.e. without the www part, because thats how your links aregiven. For sphider www.somedomain.com is different from somedomain.com (and it should).
Anonymous User
Re: Also Having "Top Only Spidering" Problem
March 18, 2007 12:04PM
Congratulations for Sphider.


I Index to further personal search a public journal of portuguese law in

http://dre.pt/gratis/dd1s/dd1su30d.asp


It works fine in

http://dre.pt/gratis/dd1s/20070316.asp


In the second level it works ok

http://dre.pt/gratis/dd1s/diario1s.asp?data=2007-03-16&num=05400

But it is not recognizing url's like this
http://dre.pt/pdf1sdip/2007/03/05400/16271627.PDF

Can you help?
Re: Also Having "Top Only Spidering" Problem
March 19, 2007 02:46AM
No luck, Ando.

Spider Output:

[Back to admin]

Spidering http://howtomakemoneywitha.com/
1. Retrieving: http://howtomakemoneywitha.com/ at 22:44:29.
Size of page: 21.24kb. Starting indexing at 22:44:29.
Indexed
Links found: 0. New links: 0

Completed at 22:44:30.

---

And I have it on full depth, and re-index. No such luck. Any more ideas..? Can you spider it OK from your installation?
Re: Also Having "Top Only Spidering" Problem
March 19, 2007 03:35AM
Fixed it! Used the "comments bug" fix in the other forum with the non-www website address. Now I'll code it into automatically spider both www and non www, and my problem for indexing should be solved. smiling smiley

Thanks a lot Ando, if you need more developers or more features let me know, I have some spare time.

PS - If you have a few minutes, could you drop me an e-mail? I have a question for you. EMail is radler a-to-the-t speedexec d(o(t) com. Thanks bud!
Re: Also Having "Top Only Spidering" Problem
April 02, 2007 02:52PM
How can I get access to the "other" formum to see the

"comments bug" fix in the other forum with the non-www website address

Thanks
David
Sorry, only registered users may post in this forum.

Click here to login