I have a header(Location: ) statement in my php file. The spider picks up the redirection fine, fetches and indexes the page BUT all the relative links in the page which the spider has been are not found. Example the page [blah.com] redirects to [blah.com] - the spider gets the page [blah.com] but it still tries to find relative the links inside this page relative to [blah.com] instead of [blah.com] P.S. Phorum is converting the http urls to links :( http://www.sphider.eu/forum/read.php?2,33,33#msg-33 Sat, 25 May 2013 18:34:38 +0300 Phorum 5.2.10 http://www.sphider.eu/forum/read.php?2,33,34#msg-34 http://www.sphider.eu/forum/read.php?2,33,34#msg-34
Line 129 in file spiderfuncs.php currently reads
if (ereg("Location: *([^\n\r ]+)", $answer, $regs) && $httpcode == 3 && $full_httpcode != 302)

it should be

if (ereg("Location: *([^\n\r ]+)", $answer, $regs) && $httpcode == 3 && $full_httpcode == 302)

Notice the last == instead of !=

HTH

Tarique]]> tariquesani Sphider Support Tue, 20 Mar 2007 13:26:38 +0200 http://www.sphider.eu/forum/read.php?2,33,33#msg-33 http://www.sphider.eu/forum/read.php?2,33,33#msg-33
Example the page [blah.com] redirects to [blah.com] - the spider gets the page [blah.com] but it still tries to find relative the links inside this page relative to [blah.com] instead of [blah.com]

P.S. Phorum is converting the http urls to links :(]]> tariquesani Sphider Support Mon, 19 Mar 2007 15:31:18 +0200