Welcome! Log In Create A New Profile


How to ignore a url?

Posted by devkbsc 
How to ignore a url?
April 06, 2016 02:21PM

is there any regular expression method or wildcard method to ignore URL when indexing?
Re: How to ignore a url?
April 06, 2016 03:44PM
Not supported by the original Sphider.

Don't know whether your mod supports reg-ex in 'URL must include/must not include'.

Might be unwanted here, but Sphider-plus does it.
As of the docu:
Using Perl style regular expressions instead of literal strings is also supported. But only a string starting with a '*' in front
is considered to be a regular expression, so that '*/[a]+/' denotes a string with one or more a in it.

Re: How to ignore a url?
April 06, 2016 07:13PM
In the mod, I did not alter the logic of the must/must not include directives.

The documentation on this site (concerning 1.3.6) says Perl style regular expressions are supported. While I do not personally use regular expressions in the must/must not include URLs (haven't had the need), I have tested the feature, although not extensively.

Limited testing indicates Perl style regular expressions ARE supported. Since I am not willing to vouch for the complete reliability of their use (due to the lack of extensive testing), they are not mentioned in the included user guide I package with the mod.

Bottom line: If you are willing to take the time to experiment, the original and mod versions of Sphider MAY reliably support Perl style expressions just fine. If you want an iron-clad guarantee, use Sphider-plus.
Re: How to ignore a url?
April 06, 2016 08:09PM
Sorry, my mistake. So all of them should be able to use regular expressions.

Sorry, only registered users may post in this forum.

Click here to login