Sphider forum - Sphider Support

Which file or files got changed in 1.3.6? (1 reply)

t-p — Tue, 11 Jun 2013 00:41:18 +0300

Does anybody knows which file or files got changed in 1.3.6?

Upgrading SQL (7 replies)

wubbledoos — Thu, 13 Jun 2013 10:55:55 +0300

Hi,

Apologies if this is a 'newbie' question, I have just downloaded Sphider 1.3.6 and I see a lot of sql scripts regarding upgrading and also there is a folder called upgrade, can somebody please advise what these are all for as in the install.txt file I see no mention of them.

Thanks

Thanks for this great tool! (translations in german) (1 reply)

Johann B — Fri, 07 Jun 2013 19:38:54 +0300

Dear maker, provider, supporter of Sphider,

thanks a lot for having made this tool and for making it avaliabe. I and the future use of this tool owe you much gratitude and respect!

I am not sure if I am able to give something valued back, but I have seen that some texts in german language are still english and I would like to offer to translate it if this is wished and helpful.

The installation had worked perfectly and I as a real internet and IT dummie was albe to install run and index our pages it in lesser than 15 minutes.

Thanks a lot and now there is a lot of work in reagard of modification of layout and implementing it into the websites.

_()_
metta & mudita
Johann

Sphider don't index all the files in my folder (no replies)

zen_28 — Thu, 30 May 2013 15:17:30 +0300

Hi everybody,

I use Sphider 1.3.4 to index pdf and doc files. I have 3200 files in my folder, and indexation stop after indexing ~ 220 files.
I use an Iframe to index the folder, the URL use is spider.php?all=1&add_doc=ok . With the option all=1, normally sphider index all the folder, I don't understand ...

In my DB, depth = -1

I precise that my max execution time in php.ini is 3600

Thanks for your help

Jeremy

Sphyder-plus not indexing (5 replies)

snipesearch — Mon, 20 May 2013 14:33:46 +0300

Hi when i started my SE i was using sphyer then i moved to sphyer plus. I started on shared hosting and am now on a VPS as i needed more resources. After moving the to the VPS, nothing is indexing.

I click index, start the index and then get

Indexing sites . . .

Start indexing at 12:33:22.

and nothing happens, does anyone know why this might be or have a way of tracing the problem? I know sphder plus is a splinter project but its roots live here so im king of hoping someone might be able to help

the website is snipesearch.co.uk

Making Indexing Faster (5 replies)

solarsurfer — Fri, 10 May 2013 10:41:13 +0300

Hi
Anyone know how to use multiple installations of Sphider (Original Version) to increase the speed of Indexing ?

I would assume that it would be easier to make several installations, that then update already indexed data, rather than to go out and crawl new data?
Also can this be done from same machines, as I gather most of the power is used by processing speed, rather than internet speed !

I would assume that you would have to update a master database, verify the data, then replace the old index ? Or is there a safe way to use various crawlers on one database ?

I ask this question, because I need around 20 sites (out of around 4000) to be updated every 3 hours, and 1 crawler doing an update won't do !

Currently I'm running xampp on a windows laptop, while indexing before uploading of the db, to a shared server. I am currently also playing with a Linux server in my front room, in an effort to understand what I want from a dedicated server. My host, like many, only gives me around 30 secs of processor time, at a go, so that won't work !

Any ideas, and anyone that has successfully run multiple spiders / crawlers I would welcome how you have done it, and how successful it is, together with problems you came across !

Thanks guys in anticipation of your reply !!!

Apostrophes in Sphider Suggest = not found (6 replies)

BrentEades — Sat, 08 Jun 2013 18:30:06 +0300

Here's an odd one.

Whenever Sphider Suggest shows a keyword that contains an apostrophe, clicking on that link always produces a 'not found' error. For example, if the suggestions are:

Toronto 4 results
Toronto's 1 result

I'll get:

'The search "toronto's" did not match any documents'

Suggestions?

Still have "mysql has gone away" Error! (4 replies)

libertux — Fri, 31 May 2013 17:26:18 +0300

Hi, and thanks for this awsome script,
I successfully integrate Sphider with CodeIgniter you can see it in action here (http://www.farkess.com), and it's work as a charm, but thease days i have "mysql has gone away" when trying to Reindex Sites.
I folow all the steps in :

[www.sphider.eu]

But still have the same error!

Can some one help me fix it?

Thanks

Why was my post deleted (1 reply)

n-jin.tk — Mon, 06 May 2013 06:04:10 +0300

Sphider is indexing the entire site even though I set it to only index a sub directory (no replies)

PHP_User — Fri, 03 May 2013 21:06:16 +0300

I am testing sphider on our testing server. My root is 192.168.2.2/site but I dont want to test it on the entire site (because its faster to test it out on a sub-directory, so I set it to 192.168.2.2/site/events. And I have that path for the index as well. But when I do an index, it starts at the root of the site? I even truncated all the database tables, and started over (to ensure that I was starting the index from scratch) and it still starts indexing at the root. Or it will begin and index and stop after a second and tell me:
" MD5 sum checked. Page content not changed
Links found: 0. New links: 0"

Any ideas?

How To Remove: Table 'sph_search.query_log' doesn't exist (2 replies)

Rubel — Fri, 03 May 2013 18:18:21 +0300

When I search any word the search result shows but at the top shows "Table 'sph_search.query_log' doesn't exist". How to solve this Problem. Please Help.

I am looking for a webhosting compuny to install Sphider on, any free webhoasting compunies? (1 reply)

AFN — Sat, 08 Jun 2013 15:28:25 +0300

I am looking for a webhosting compuny to install Sphider on, any free webhoasting compunies?

Deprecated: Function eregi_replace() (1 reply)

Timberwolf53 — Mon, 29 Apr 2013 18:59:51 +0300

After globally updating the PHP version to 5.4, search results in the following 20 or so identical lines:
Deprecated: Function eregi_replace() is deprecated in /include/searchfuncs.php on line 54
Subsequent lines with the same message refer to different lines: 62,71,142,578,582,586
After about 50 lines of depreciated code error messages, the search results are found.
Is there a work-around to avoid receiving the error messages?

How can I change the language of "did you mean"? (10 replies)

Darvather — Thu, 09 May 2013 05:56:55 +0300

I have just installed the version 1.3.5 and selected spanish to be the language in my site but I have enable the option "did you mean" in the settings panel and noticed that it appears in english and need that to be in spanish as well, does anyone know to change this?

I welcome any advise. Thanx.

Confused how to exclude all URLS with a specific GET variable (1 reply)

PHP_User — Tue, 14 May 2013 20:16:52 +0300

Hello, I am new to Sphider, and I apologize, but I am not good with perl style expressions. I have URLs on my site that Sphider is indexing and I want to exclude them. For example, I use OsCommerce and many pages have pagename.php?osCsid=xxxxxxxx. I want to have it exclude any URL with "?osCsid=" in it. These are SESSION ids and it indexes a ton of them.

In the Read Me it shows this example"
'*/[a]+/' denotes a string with one or more
a's in it.

So in my case, would it be,
*/[?osCsid=]+/

I tried to use some perl tutorials and they are not easy to follow.

Thanks,
Don

Overlayed Search Results (no replies)

darkknight — Sat, 13 Apr 2013 21:24:32 +0300

A little background info: I'm using Sphider to create a search box for one of my buddies sites and I'm hosting the actual Sphider files on my own server. Is there any way to have the search results overlayed on the page after clicking submit kinda like the Google custom site search does so that users can't see where the files are actually hosted and keeps everything connected to my buddy's site only?

after set up the environment and then test,but it cannot work (no replies)

lingemma — Fri, 12 Apr 2013 12:00:59 +0300

after set up the environment in Dreameaver, and then test,but it cannot work. It pop up the message"While executing applyServerBehavior in InsertRecord.html,a JavaScript error occurred". what is problem and how to solve it,THX

Two qustions: donations and wordpress (1 reply)

TRG — Thu, 02 May 2013 04:49:34 +0300

Hi!

I am struggling getting the Sphider Wordpress Plugin up to date with the latest version of PHP. I was wondering: has anyone on this forum already done that job, and could he/she tell me how to do this? Or is there an updated version somewhere for grabs?

Also, how is the donation thing working: you get a licence code after donating or something? I have been asked to get the rid of the "Powered by"-notification, that's why I am asking.

Thanks in advance!
Erik

Search-form automatically refreshes website if clicked on (1 reply)

jaco — Wed, 10 Apr 2013 12:39:10 +0300

Hi Guys

I inherited a wordpress website that i'm doing some maintenance on. Sphider 1.3.4.2 is currently installed on it: [www.hysasystems.org]

The issue i have at present it that if a user clicks on the search-form (top right-hand corner of the site) it automatically refreshes the site to [www.hysasystems.org]

I cannot seem to figure out how to correct this issue.

searchform.php has the following code. I've tried to de-activate the 'action' command as this appears to create the refreshing, but to no avail:





SEARCH

Please help.

Regards,
Jaco

How to make sphider case insensitive (no replies)

theo@bimediatv.com — Mon, 08 Apr 2013 11:28:45 +0300

Hi guys,

I was wondering how to make Sphider case insensitive. For instance, "NETWORK" does not return results for "Network", nor does it return results for "network". Which is somewhat of a problem ...

Any ideas ???

MySQLi (:P) (no replies)

liviululu — Fri, 05 Apr 2013 16:08:46 +0300

Hi to everyone!!!

First I wanna praise the developers...Keep up!!
My question is: is there a newer version of sphider that uses MySQLi?

Sorry if this is a duplicate question...

Thanks! Good day to all!

How do I remove timeout (1 reply)

bonur — Thu, 11 Apr 2013 07:38:43 +0300

How do I remove timeout

How To Index Site Behind VPN (1 reply)

alexanderc — Sun, 28 Apr 2013 09:43:18 +0300

I am trying to index a wiki that is behind a private network. Obviously, I have access to this wiki, but would appreciate any help in configuring Sphider to be able to authenticate on this VPN.

Searching techniques being used (no replies)

faisalsarfraz — Tue, 26 Mar 2013 16:56:54 +0200

Hi!!
I am working on a similar project as my final year project.
I want to know what searching technique is being used in this sphider search engine
Please someone from development team must reply

Thanks

Email crawling (no replies)

Mhche — Tue, 26 Mar 2013 15:48:44 +0200

Hello,
I tried to found a solution,i searched a lot but i couldn't find anything so that's why i made a topic.
That i would like to do is to take the urls from the links table on the db and them to crawl one by one to search for emails and other content that i want,but especially for emails.
I cannot find out where to put the function i have for the emails,and i don't how to take the urls from the table and put one by one in the function and then store them in a new table(emails) in the db.
And also where to put that function.

Of course if is it possible all that to be done by other way, when sphider runs and indexes i would be much better.

I tried with json and mysqli parser for php but i couldn't make it.

So i hope to help me out.
Thanks!

How to Play SWF on iOS Devices (1 reply)

sphioliver — Mon, 25 Mar 2013 12:08:34 +0200

As Apple’s unique mobile operating system and the world’s leading OS as well, iOS has been with us for over four years since its initial release in Jun, 2007. (Convert SWF to WMV Mac) No matter how pretty the iPhone, iPad, iPod is, and no matter how delicate their design is, iOS is the key to make those devices alive and useable. It has been a long way that iOS finally came to its current version 5. The brand-new iOS 5 was added up to 200 new features and is a perfect match to the newly-published iPhone 4S as well.

However, regardless the fact that iOS develops very fast, the door to Adobe Flash Player is still closed. That is the reason whyFlash SWF files (convert SWF to AVI mac) can never be officially played on any Apple iOS devices. Although there are a lot of tricks teaching how to make Flash SWF playable on iOS devices, it leads the customers more likely to jailbreak them, which sounds not so good for me. (SWF to ogg)

Here is a much easier way to do it, with the essential assistance from a handy SWF converter (convert SWF to Webm). There is no harm to your iOS devices and your original Flash SWF file either. Everthing works in the way it shoud and it only takes 3 steps and 3minutes to play Flash SWF content on any of your iOS device. (SWF to Sony Vegas)

Step1: Input your source Flash SWF file by clicking "Source" button.

Step2: Choose the right output video format for your specific iOS device and access the advanced output profile settings for more parameters.

Step3: Start the Flash SWF to iOS device conversion by clicking "Capture".

Update your iOS today for the ultimate Flash SWF playback experience on your iOS devices. Shockwave Flash to MP4 Converter

how do i add a new folder and still be required to have admin access to view it? (1 reply)

cladiron — Mon, 25 Mar 2013 22:58:03 +0200

My question is:
How can i add a new folder to the admin folder, and still be required to be logged in inorder to view the other files in the new folder ?

For Example:
I have a folder called "groups", in this folder are other files that i only want to be view by the admin.

As my setup is now it is allowing public access even tho it's a subfolder in admin.

Auto İndexing (4 replies)

bonur — Thu, 04 Apr 2013 23:54:32 +0300

How I do automatic indexing and a lot of web site indexing at the same time

Indexed, added one page, re-indexed, many "New Links" found (no replies)

1611mac — Wed, 20 Mar 2013 13:57:58 +0200

I deleted my index and ran a brand new index. I then added a new blog page. The next day I re-reindexed and sphider "reindexed" many pages that were not changed since previous days index. A links on those pages were reported as "new links." Here's an example list from the run showing "ebooks.php" with a new link. However, I know for sure that the page was not changed from previous run to this one. What's happening?

136. Retrieving: [-snip-] at 06:44:47.
Size of page: 28.74kb. Starting indexing at 06:44:47. Re-indexed
Links found: 19. New links: 1

What is "Minimal delay between page downloads" in settings? (no replies)

1611mac — Tue, 19 Mar 2013 22:20:43 +0200

Settings has a field where you can enter a "Minimal delay between page downloads." Can someone explain what this is and what it does?