Show all posts by user
If you are having a problem with Sphider, this is the place to look for an answer.
Re: Database structure - link_keyword* - 1 year ago
The reason for this is purely legacy. In Mysql, each table is one file, and with older versions of mysql, the table access times went up significantly when the file reached a certain size. For this, the table was split into 16 separate ones, so that the sweet spot wouldn't be hit so quickly. I don't think it's an issue any more, but the old structure is still there.by Ando - Sphider Support
Re: Sphider database structure - 2 years ago
The reason for multiple index tables was that with mysql 3.x, table reads/writes became very slow after the table file was over a certain size. So the table was split into 16 different tables (hexademical indeed), and word indices were put into the correct table according to their hash. This made indexing/searching big sites much faster. Not sure if this applies anymore with mysql 5+, probably noby Ando - Sphider Support
Re: Indexing doesn't seem to follow sub-directories - 2 years ago
Well, file structure/subdirectories has nothing to do with how sphider indexes files. Sphider follows links, just as a normal web user would. If the files you are talking about are reachable via following links from start page, then Sphider can index them. If not, it can't.by Ando - Sphider Support
Re: i try to index but spider.php on line 190 fatal error - 3 years ago
See the faq on Sphider pageby Ando - Sphider Support
Re: Indexing duplicate pages issue - 3 years ago
Well, Sphider does ignore pages which have exactly the same content ( meaning literally, byte-by-byte). You should find out why your "duplicate" pages are not literally duplicates. You could also filter out some parts of the page not to be indexed (archive for example)by Ando - Sphider Support
Re: Spidering: What determines "Page is a duplicate"? - 3 years ago
Page is a duplicate if it has exactly the same content as a page that is already in the databaseby Ando - Sphider Support
Re: Newbie - 3 years ago
> I'm sure this is a pretty silly question, but Is > it the line: > > $success = mysql_select_db ($database); No, it's this $database="sphider"; $mysql_user = "root"; $mysql_password = "";by Ando - Sphider Support
Re: Newbie - 3 years ago
You have to successfully install the tables etc before ever going to the admin interface. You probably have not specified the correct db settings in database.php.by Ando - Sphider Support
Re: Newbie - 3 years ago
> when I open install.php in a seperate window, I get the page where I'm asked for my username and password. If you run install.php, it should not ask for any password. Instead, it reads the password and user for database from the db conf file (you should set these). Sphider asks for a password only when you log into admin.php.by Ando - Sphider Support
Sphider 1.3.5 - 3 years ago
Sphider 1.3.5 should now fix the ereg warnings experienced in newer PHP versions.by Ando - Sphider Support
Re: Is there is any way to get the total number of websites to crawl.... - 3 years ago
Sphider will never scale to 6 billion pages.by Ando - Sphider Support
Re: how to sort the result by domain !!! - 3 years ago
What do you mean by sort? Right now, Sphider does group results from domain together.by Ando - Sphider Support
Re: tweaking search results? - 3 years ago
You need to edit the template and the css files.by Ando - Sphider Support
Re: How to set up Sphider and link it to my website tables - 3 years ago
Sphider does not serach from db tables. Sphider seraches the actual web pages, which can be reached by following a link. Indexing means you tell sphider the starting page of your site, and Sphider will automatically follow the links, extract the text and make a keyword database (index).by Ando - Sphider Support
Re: How do you force a duplicate page to be reindexed anyway? - 3 years ago
Simply modify the duplication check to always return false in the code.by Ando - Sphider Support
Re: Need domain-independent indexing - 3 years ago
I don't understand, how can you not include the domain in the url?by Ando - Sphider Support
Re: How to index external links - 3 years ago
You have the "Sphider can leave domain" option for this.by Ando - Sphider Support
Re: Internal Server error when trying to index - 3 years ago
Probably something wrong with your php set up. Check Apache error logs.by Ando - Sphider Support
Re: How is the Sphider crawler identified? - 3 years ago
You can change it in the admin settingsby Ando - Sphider Support
Re: AJAX Live Search Results - 3 years ago
Sphider already has that featureby Ando - Sphider Support
Re: NOHOST 
- 3 years ago
This probably means that Sphider cannot access the server.by Ando - Sphider Support
Re: What does columns="2" do? - 3 years ago
columns ="2" means that suggested word and potential result count appear in different columns.by Ando - Sphider Support
Re: International Characters messing up search results. - 3 years ago
You should probably set the encoding of your page in the templates files to the codeset you display in your search results.by Ando - Sphider Support
Re: Cron job set-up - 3 years ago
You shouldnt wget anything, but run the sphider.php script directly., ie php sphider.php Read the online doc on what the options can/should be.by Ando - Sphider Support
Re: admin.php fatal error - 3 years ago
This is not a Sphider bug, but problem with your server php setupby Ando - Sphider Support
Re: how to ignore my counter? - 3 years ago
Use User agent instead of sessionsby Ando - Sphider Support
Re: how to ignore my counter? - 3 years ago
I dont think this is really Sphider question, you have to do it in your counter software. For example, add an extra check, so that if the User-Agent string matches Sphider's, you ignore the "hit".by Ando - Sphider Support
Re: Is there a simple script that I can use to put a search box on my site to work with Sphider? - 3 years ago
you dont need a script to add a search box to your page. Just copy and paste the html for form to your page. For example <form action="search.php" method="get"> <input type="text" name="query" id="query" size="40" value="" action="include/js_suggest/suggest.php" columns="2" autocomplete="oby Ando - Sphider Support