Hi all,
at first MANY THANKS for a great and easy to install / modify script. Works with minimum efforts like a charm !
All "must NOT include" words are correctly ignored.
However, the spider shows also some results from a parent directory as "Index of /".
When entering e.g. "htm" into "must include", I get the error "file checking forbidden by required/disallowed string rule".
How can I make sure to index only pages with endings like .htm, .html, or .php ?
Thanks for any advise.