Sphider forum - Sphider Mods

No description in results

djsmc — Tue, 23 Apr 2013 02:50:12 +0300

Hi, I've just downloaded Sphider and been testing it on my site. Installation went fine and site was indexed without any issues. However when I do search the results return but there is no description or hilighted search term. Did I install it incorrectly?

Thanks,
Craig

Re: need help to move my database

wptemaer — Tue, 23 Apr 2013 02:05:40 +0300

In cpanel there is a backup wizard just choose only database and choose the database you named and you can download it as .sql file and import it later ...

Jan R.

[wordpress-hosting.dk]
[find-en.dk]
[wptemaer.dk]

spider video and images

coolcurrent — Fri, 19 Apr 2013 23:20:14 +0300

hello,

i have an intranet website that has pages with images and video files
is there any mod for spidering images and video files?

thanks

Re: ad mod

cladiron — Thu, 11 Apr 2013 07:51:03 +0300

This may be your best way for now. i don't know of any ad mod my self.
https://www.google.com/search?q=how+do+i+put+an+ad+in+my+webpage&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-USofficial&client=firefox-a

ad mod

coolcurrent — Sat, 30 Mar 2013 07:03:43 +0200

is there any ad mod? i wat to diaplay test and or image add in the right hand side of the search page

Re: [Help] Index RSS

markspend1 — Tue, 26 Mar 2013 17:13:21 +0200

Hello Guys according to that topic i think that RSS feeds is a way to examine for up-dates to your preferred sites, without having to examine out each website independently.If you want to use the RSS feeds then visit that url:

ehow.com/how_2312182_use-rss-feeds.html

Re: CATDOC for Windows

markspend1 — Mon, 25 Mar 2013 20:38:37 +0200

Hey Guys i think that catdoc is system which flows one or more Microsoft word information and results text, included inside them to standard outcome.The system which converts succeed worksheet into comma-separated value file.Thanks a lot!!

Re: RELEASED Howto: Index using a script (Theme MOD and Mass-Indexing)

cladiron — Sun, 24 Mar 2013 04:47:56 +0200

Just to update this thread, i am working on another version.

The new version will allow you to add/edit multiple links in the admin section without needing to SSH into your server.
Added a CPU page to monitor TOP status among a few other things.
Reindex 1 group or multiple groups at once, or reindex ALL using the factory reindex feature.

I'm still working on a way to monitor each link that is being indexed.

http://i45.tinypic.com/24p9vkh.jpg
http://i50.tinypic.com/if3or4.jpg
http://i49.tinypic.com/e5fbph.jpg
http://i46.tinypic.com/2gt0uti.jpg
http://i46.tinypic.com/j5dz46.jpg

Re: How to create a custom 404 error page?

markspend1 — Thu, 21 Mar 2013 20:12:01 +0200

Hello Guys according to my thinking if you want to create custom 404 error page then you must visit that URL:

webweaver.nu/html-tips/custom-404.shtml

nyc web design

how i do going my site to search engen

mayupress — Fri, 08 Mar 2013 18:36:13 +0200

can you please let me know what i do now i just created a id.

Re: How to create a custom 404 error page?

ronaldhafer579 — Mon, 18 Feb 2013 06:33:19 +0200

Thanks so much for posting these helpful tips, I'll definitely be perusing some information from here.

Medisoft download

Making search case-insensitive

halfacre — Thu, 07 Feb 2013 18:05:58 +0200

My searches are currently case sensitive, and I do not want them to be. Is there a simple way to "turn on" case sensitivity in the admin panel? I have not been able to find a way to do this. My knowledge of PHP and mySQL is minimal, just enough to get Sphider running on my site. But this case sensitivity thing is a deal breaker with the number of all-caps acronyms our visitors search for, usually entered in lowercase. Any advice or direction would be greatly appreciated.

More Mods for Sphider

memyidesu — Wed, 06 Feb 2013 00:18:47 +0200

Yo Peeps,

I have some more mods that are in the works for the Sphider.

These are some of them:

IP Banning
Domain Banning
New Captcha for the ADD URL page
Pending Index List
IP and Domain Ban check for URL Suggestions

All of these and a few more. And guess what! It will be FREE and on the newest version 1.3.5. I also plan on putting the entire thing in a package for download.

Just because this is FUN!!!

P.S. I am also going to take a bunch of mods from this forum and put those in too. For FREE!!

Re: URL Banning feature

memyidesu — Fri, 25 Jan 2013 23:34:22 +0200

Because it was FUN!

With that said here is the link to the mod, peeps.

LINK: Sphider URL Banning MOD

P.S. I have further mods in the works

Re: How to create a custom 404 error page?

leeandyliuliu — Fri, 25 Jan 2013 05:25:10 +0200

My site has 404 error page,it is www.rs2cheap.com which is selling runescape gold at the moment!

sphiderpro - free download and review

Tec — Fri, 11 Jan 2013 18:34:49 +0200

As Sphider Pro is available as free download for a while now at
[code.google.com]
and also at
[sourceforge.net]
I felt free to do so.

Here is my review on the product.

Summarization: Very disappointing.

Statement of reasons:
Announced to take over from Sphider-plus with big Tam-Tam and a lot of polemic, the Sphider Pro scripts are still very close to the original Sphider, which was released in 2009. As I already stated in another posting:
: . . . it seems they just added some old mods like 'Follow sitemap.xml' and 'Erase & Re-index' to the original Sphider. I've published all these mods in the original Sphider forum several years ago. Adding them to the original Sphider, now they call it Sphider Pro. Okay, in order to remain fair: they also implemented some ideas from Sphider-plus. . . .

But in front of the original Sphider the most important improvements are missing:
- No UTF 8 support. Thus, unable to search for queries in Cyrillic, Japanese, German and other languages.
- Indexing of iframes is not supported.
- Not indexing any kind of feeds.
- No support for IDN URLs.
- Uable to search with wildcards.
- Suggesting to index PDFs, DOCs, etc, the regarding converter are not included.
- Suggesting to contain several search modes, nothing of it is implemented.
- Suggesting to index images, not working.
- Multiple database support is not jet implemented, just separated permission for admin and user in one db.
- Secondary sitemaps are not supported. As result, no links are found.
Application hint: Useless to uncheck the regarding option in Admin settings. The scripts always follow the links in sitemap.xml. It is not that I want to debug the scripts, but please boys, it is not enough to set and unset the variable $follow_sitemap in your config file. You additionally need to use this variable in your script …/admin/spider.php

By the way, also the well-known bugs of original Sphider, for example in category search, are still present.

Regarding the documentation: Thank you for leaving 'Sphider-plus' as part of your poor documentation. Thus, all users are well informed from whom you copied it. Because of my limited English knowledge, even my grammar errors remained!

To all early adaptors: The release dateof Sphider Pro version 3.1 is defined in the docs to Nov. 26, 2012. But having a look at the 'last modified' date of the scripts: Often their date and time is newer than November 26. Are they still debugging their first official release? In order to get always the latest debug version, it might become necessary to write a small batch job for a daily download. Perhaps in the next future the bugs in 'follow sitemap.xml' will become fixed?

It is a great pity that I wasted my time with these scripts. I really was keen to learn from the scripts, which pretend to take over from Sphider-plus. But as in the past, I will be obliged to do it all by my selves.

Tec

Re: Sphider-plus version 2.9 released

Tec — Wed, 02 Jan 2013 00:42:15 +0200

<<< Sphider Pro has been running on websites since 2009 >>>
Your website, offering Sphider Pro, has been established November 29, 2012.
Quite a nice performance that all your beta testers were busy for more than 4 years. But even so much activities would not justify to name your first public available release v.3.1
In order to verify, all details regarding registration, ownership, etc. they are available at
[www.eurid.eu]
Just whois for sphiderpro

<<< As Tec says he published all these mods in here seral years ago yet he states on his website that that he addapted Sphider-plus form the original sphider created in 2008. >>>
Okay, English is not my native language. But as far as I understand the above: Congratulations, finally also you understood, who really developed the search engine. Ando Saaabas devoloped the original Sphider, and as he did not support it any longer I continued with his personal compliance. Would be no problem for me to present the ragarding e-mails written by Ando dated 2008 and 2009.

By the way: How you might know, whether I've never seen your scripts?

Tec

Re: Sphider-plus version 2.9 released

Sphider Pro Team — Tue, 01 Jan 2013 17:29:37 +0200

It seems Tec doesnt have much of a clue. Sphider Pro has been running on websites since 2009 and as Tec has not even seen Sphider Pro how could he possible know what is in the code and what mods and functions are installed.

As Tec says he published all these mods in here seral years ago yet he states on his website that that he addapted Sphider-plus form the original sphider created in 2008.

Seems Tec just wants to insult

Re: Sphider-plus version 2.9 released

Tec — Sun, 30 Dec 2012 13:28:09 +0200

Sphider Pro is not an official update or upgrade of Sphider-plus. As no details are presented, it seems they just added some old mods like 'Follow sitemap.xml' and 'Erase & Re-index' to the original Sphider.
I've published all these mods here in this forum several years ago. Adding them to the original Sphider, now he is calling it Sphider Pro. Okay, in order to remain fair: he also implemented some options from Sphider-plus.

After purchasing Sphider-plus about 2 month ago, unable to install the scripts on their server by missing knowledge on server settings and configuration. Also the help and advices granted in the Sphider-plus forum was not accepted. Instead, a dispute at PayPal was opened. About 7 hours after downloading the scripts. The PayPal claim was decided in my favour. But it seems to be difficult to accept. Now they try to bother the real developer of Sphider. Publishing publicity and polemic instead of offering solutions here in the forum. Also placing the scripts for free download. Poor boy. Looks like a typical reaction of script kiddies. How do they intend to copy and paste in the future, without intellectual input?
As a cite from one of the e-mails, sent to me:
". . . Should have give me my money back . . . "

Tec

Re: Sphider-plus version 2.9 released

wannabe — Sun, 30 Dec 2012 12:21:39 +0200

What is the difference between sphider-plus and pro?

I read that sphider-plus is lacking good security.

Can someone explain the difference between both packages to me?

thanks in advance,

W//

Re: Sphider-plus version 2.9 released

Sphider Pro Team — Sat, 29 Dec 2012 12:41:25 +0200

Sphider Plus is free, download version 2.9 here https://code.google.com/p/sphider-plus/,

Sphider Pro is the best release which can be found at Sphider Pro

Re: Sphider-plus version 2.9 released

andon — Sat, 29 Dec 2012 10:30:56 +0200

Thanks for the reply, and you're right about just working on your Sphider-Plus, it is much better but its not free :)

---
Forex Strategies Blog
Financijski Portal

Re: Can't save in settings

Tec — Sun, 23 Dec 2012 12:18:03 +0200

The Sphider scripts do need 'write' privileges to store the settings. It might be necessary to chmod 777 the folders and scripts on your server.
The setings are stored by the script
.../admin/configset.php
into the file
.../include/settings/conf.php

Tec

Can't save in settings

sugar_ray — Sun, 23 Dec 2012 09:20:45 +0200

Hi, I'm a newbie, so please be gentle!

I have setup SPHider for the 1st time. Everything has gone well but I have a small problem. In the Admin Panel/Settings it wont allow me to save new settings i.e. Administrator e-mail address ???

Re: Json Theme. You can get sphider results with json.

Licejan — Wed, 05 Dec 2012 10:46:27 +0200

Really got the point.

______________________________________________________
[www.mmoggg.de]

Re: Module request can pay for it

Licejan — Wed, 05 Dec 2012 10:45:36 +0200

OK,you could say that again.Thanks for sharing this.

___________________________________________________________
[www.mmoggg.de]

Re: Sphider-plus version 2.9 released

Tec — Wed, 05 Dec 2012 00:48:47 +0200

Sorry to tell you, but the original Sphider is unsupported since about 4 years now. Before starting to develop Sphider-plus, I tried to cooperate with Ando. My intension was to continue with him together. But as it seems, Ando intended to concentrate on other projects. Thus I started to create Sphider-plus by myself. Meanwhile I have added 284 new features (additional mods, functions, template designs and debugging) to the original Sphider. And now, 4 years later, I do not intend to do reengineering for the original Sphider. I do have to concentrate on Sphider-plus, which is under continuous development.

Tec

Re: Sphider-plus version 2.9 released

andon — Mon, 03 Dec 2012 14:19:52 +0200

Hi Tec, do you think you can help to update Sphider basic. It would be a nice thing.

-----
Foreign Exchange Forex Trading Strategies

Re: URL Banning feature

memyidesu — Wed, 21 Nov 2012 23:42:40 +0200

Yo Peeps,

I have been tinkering with this for a while and found a better way to do this. Instead of completely benning the url I just de-index it and leave it in, so it can't be submitted again. I am putting the finishing touches on it and then I will post all of the code in my forum.

Sphider-plus version 2.9 released

Tec — Fri, 02 Nov 2012 15:34:08 +0200

As it might be of interest also for the users of original Sphider:
Meanwhile the latest development of Sphider-plus is available at [www.sphider-plus.eu]

In front of version 2.8 of Sphider-plus the following items have been added / modified:

New feature:
Support for non-ASCII URLs using 'Internationalized Domain Names' (IDN).
It is a standard described in RFC 3490, RFC 3491 and RFC 3492.
If activated, internationalized domain names like 'http://президент.рф/' and 'http://müller.de/'
will be accepted as new sites in Admin backend, as well as in User's addurl form.

New feature:
Support Punycode URLs like [xn--90aoqlh7c4a.xn--d1abbgf6aiiy.xn--p1ai]
Converted into the readable form http://события.президент.рф/
To be activated in Admin settings.

New feature:
Besides the usual HTML elements , also delete from full text all those HTML elements,
which are defined like < element >
To be activated in Admin settings.

New feature:
Index only parts of a page, defined by . . .
This feature is foreseen to cooperate with the new HTML5 elements like
section, nav, aside, hgroup, article, header, footer, etc
If enabled in Admin settings, the values as defined in the list-file
…/include/common/elements_use.txt will be used to index only the page content between
. . .

New feature:
Ignore parts of a page, defined by . . .
This feature is foreseen to cooperate with the new HTML5 elements like
section, nav, aside, hgroup, article, header, footer, etc
If enabled in Admin settings, the values as defined in the list-file
…/include/common/elements_not.txt will be used to remove the content between
. . . from the page content.
This is the contrary function to 'Index only parts of a page, defined by . . . '

New feature:
Index only files and documents with defined suffix :
If activated, all pages of the site will be searched for links,
but only files with suffixes as defined in the docs list will be indexed.

New feature:
1. Perform a WHOIS check for sites waiting for approval in Admin backend.
2. Perform a WHOIS check for suggested URLs direct in the addurl form,
so that invalid URLs will automatically be rejected.
For both tests a basic list of WHOIS servers for the generic top level domains
and some important country codes (supporting 30 suffixes),
or an extended list (supporting 155 suffixes) are selectable.

New option to be activated in Admin backend:
Crawler can leave domain during index procedure, but only for canonical links.
Only the canonical link will be indexed, but links found there will be ignored.

New feature:
Obey the 'refresh' meta tags as part of HTML headers.
Now following the redirection and delayed indexing.

New option:
Support UTF-16 coded sites. Will convert UTF-16 coded sites into UTF-8.
To be activated in Admin settings

New option:
For index procedure always use the standard Firefox HTTP_USER_AGENT string
and ignore the individual defined Sphider-plus string. To be activated in Admin backend.

New feature
Follow redirections, which are invoked by JavaScript, when sent as HTTP content.
Will obey directives like:

New feature:
Follow URL redirections caused by HTTP 301, 302, 303 and 307 status codes.

New feature:
Separated PDF converter supplied for 32 and 64 bit Operating Systems.

New feature:
Follow links placed in JavaScript files. Will detect and follow links like
document.write(' All news 2012 ');
Also the complete content of
document.write( this text in all rows');
will be indexed and stored as keywords in db.

New feature:
Now indexing also sites, which do send a obligatory request for a cookie, to be set by the crawler.

New feature:
In order to reduce transmission time, the crawler now requests gzip-formatted data transfer
from the remote server for the URL to be indexed.

New option:
In order to convert the text into UTF-8, use the charset definition as supplied via HTTP by the client
server.
If this option is not activated in Admin Settings, the charset will be extracted from the header of the files to be indexed. If not found, like in PDF documents, the preferred charset will be used.

New option:
Delete duplicate parts of the URL path found in the indexed page URL and the new links.
Unfortunately some CMS seem to be unable to build up a correct path for relative links.
If activated in Admin backend, these duplicate parts of the path will be deleted from the link URL. Should be activated only, if sites are indexed created by dedicated CMS.

New feature:
Show summary of actually active User database at the bottom of result listing.
To be activated in Admin backend, the count of sites, categories, page links and keywords
are displayed.

New feature:
Automatically deleting invalid URLs from Admin 'Sites' view.

Improved 'Add site' function in Admin backend.
Now treating URLs with and without 'www' as equal, and excluding them as duplicate sites.

Improved image indexing procedure
Now also indexing phpBB images, linked by php command files.

New option
Suppress the file suffix from image file names for indexing.

Improved media indexing procedure
In case of missing title tag, now the alt tag is used to define the name of the media.
In case that also the alt tag is missing, the file name will be used as keyword.

Improved "banned domain" management
Now holding name and suffix of the banned domains, and no longer the URLs.

Improved index procedure
Now ignoring links that try to link to the calling URI (self back linking).

Improved link detection for relative links, which are to be found in full text.

Improved input protection against SQL injections

Improved Admin statistics
Now providing also the IP, country code and country name for
- Search log
- Most popular searches
- Most popular page links
- Most popular media links

Updated GeoIP database, used to provide the IP, CC and country name for the Admin statistics.
Now also supporting IPv6 URLs.

Support on Windows systems temporary removed for ppt files, as the converter causes failures on large PowerPoint documents.

Bug fixed, which prevented category selection without activating the "Advanced search form" option.

Bug fixed that caused invalid URL encoding in result listing.

Bug fixed causing the error output "Unknown column 'naame' in field list" during media indexing.

Bug fixed that caused MySQL warning messages during index procedure at some older MySQL versions, if the URL to be indexed contained blank characters.

Bug fixed, which caused invalid URL creation for relative links containing a file name and/or query.

Bug fixed in option 'Crawler can leave domain'.

Bug fixed in option 'Use list of div ids to ignore the div content during index/re-index'.

Bug fixed in option 'Enable to decode entity coded sites into standard HTML characters'.

Bug fixed in 'addurl' form, which prevented input of words containing accents in 'title' and 'description' fields.

Some additional small bugs killed.

Sphider forum - Sphider Mods

No description in results

Re: need help to move my database

spider video and images

Re: ad mod

ad mod

Re: [Help] Index RSS

Re: CATDOC for Windows

Re: *RELEASED* Howto: Index using a script (Theme MOD and Mass-Indexing)

Re: How to create a custom 404 error page?

how i do going my site to search engen

Re: How to create a custom 404 error page?

Making search case-insensitive

More Mods for Sphider

Re: URL Banning feature

Re: How to create a custom 404 error page?

sphiderpro - free download and review

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: Can't save in settings

Can't save in settings

Re: Json Theme. You can get sphider results with json.

Re: Module request can pay for it

Re: Sphider-plus version 2.9 released

Re: Sphider-plus version 2.9 released

Re: URL Banning feature

Sphider-plus version 2.9 released

Re: RELEASED Howto: Index using a script (Theme MOD and Mass-Indexing)