Sphider-plus version 2.0 released

In front of prior Sphider-plus the following items have been added / modified:

Multiple database support for up to 5 independent databases (expandable).
Individual database activation for:
- Admin
- Search user
- Suggest URL

Independent configuration and activation for each database is integrated into the Admin interface.

Additional password protected access permission for database configuration, independent from Admin login.

Integrated availability check for all databases and their release relevant table structure.

Individual for each database:
- Backup and restore
- Copy / Move from each database to each other database

32 MByte query cache for MySQL database.
- To be activated in Admin settings.
- Status of cache is observable in Admin / Statistics / Server-Info / MySQL.
(Cache might not work for 'Shared Hosting' applications)

Obey the<link> tag specification:
rel="canonical"
If defined in page header of a website, the crawler will be redirected to the canonical link and Sphider-plus will understand that the duplicates all refer to the canonical URL.

Index websites that are created with ASP.NET

Definition for path to PDF converter integrated into Admin Settings interface.
Additionally the default setting - as required for the Operating System environment - is suggested.

If path to PDF converter is invalid and converter is not accessible, an error message (in Admin Settings dialog) is created.

Additional Admin setting to enable optionally indexing of external hosted media content.

Improved index procedure of media files, by avoiding indexing of duplicate media content from different pages.

Improved image indexing by reducing the required download time.

Improved index / re-index procedure to avoid 'MySQL server has gone away' messages.

prototype.js framework adapted to cooperate with XHTML valid parameter handling.

XHTML1.0 output for
- Admin interface
- Search form and Result listing
- Suggest URL form

Improved vulnerability check of User input and Admin log-in:
- Prevent buffer overflow errors.
- Suppress JavaScript execution and tag inclusions masked as XSS attacks.
- Prevent C-function 'format-string' vulnerability.

The 'URL Suggestion Form' now includes a character counter for remaining input in 'title' and 'description' field.

For 'Search with wildcards' now the complete word is highlighted in result listing. Not only the query part of the found keyword.

Phrase search is enabled now also for title tag, not only for full text.

Improved suggest framework:
For search in categories, the suggestions now will be presented with respect to the pre-selected category.

Additional Admin setting in section 'Suggest Options':
For 'Media search' get suggestions also from EXIF info and ID3 tags

Files for database setting and script configuration are protected now against direct client access by pre-defining a named constant.

Updated Swedish language file. Thanks to Holger Gremminger.

Bug fixed in 'Search for suggestions in query log', which prevented to disable this option

Bug fixed that caused multiple listing of the same result, when
"Define maximum count of result hits per page, displayed in
search results (if multiple occurrence is available on a page)"
was activated.

The project page of Sphider-plus is to be found at
[www.sphider-plus.eu]
Sphider-plus release 2.0 vs. original Sphider: 141 items worked out


Tec

1.) The Databasename (during installation) is sized to max 20 Letters -> Why? My Databasename is 22 Letters long...
2.) The "Page Indexing Weights" dosn't really work...
I set "Relative weight of a word in the Domain Name" to 99 and set "Relative weight of a word in the Path Name" to 99 and a URL with the search term is the last in the search result list. I set the two values to 0 and try it again -> same result
(I "Erase & Re-index all" before I test the next values...)
I have SEO-URL's - why I can't use it with sphider-plus?!?
3.) The transliteration is not correct and use a few wrong letters from latain to cyrillic - but I can't find this array / table...

And a few more bugs...

Sorry but I think it's not really an 2.0 - more an 1.81

dor_neue Wrote:
-------------------------------------------------------
> 1.) The Databasename (during installation) is sized to max 20 Letters -> Why?
Because I limited the allowed input length.

>My Databasename is 22 Letters long...
Open the file …/admin/db_conf.php and search for:
<input name='_database1' type='text' id='database1' size='20' maxlength='20' value='$database1'
Define size='20' maxlength='20' to your personal needing.
Before you ask: yes, you need to change it in the same script also for id='database 2-5'

> 2.) The "Page Indexing Weights" dosn't really
> work...
> I set "Relative weight of a word in the Domain
> Name" to 99 and set "Relative weight of a word in
> the Path Name" to 99 and a URL with the search
> term is the last in the search result list. I set
> the two values to 0 and try it again -> same
> result
> (I "Erase & Re-index all" before I test the next values...)
The algorithm to calculate weight is to be found in …/admin/spiderfuncs.php in function calc_weight()
You may use the first rules of arithmetic to find out which weighting will result in the corresponding result.

> I have SEO-URL's - why I can't use it with sphider-plus?!?
Did you notice (and follow) the FAQ
[sphider-plus_eu]

> 3.) The transliteration is not correct and use a few wrong letters from latain to cyrillic - but I can't find this array / table...
Which characters are invalid transferred?

> And a few more bugs...
With interest awaiting your review report. But don't repeat your Cron issue. Also you don't need to inform me about your template refusal. I already know all that.

> Sorry but I think it's not really an 2.0 - more an 1.81
Close an eventually open Admin window. Open the file /setting/conf.php and search for:
$plus_nr = '2.0';
For your personal sense of well-being you may replace it to:
$plus_nr = '0.01 BETA';
But it remains my decision to define the numbering also of future releases.

Tec

Please increase the Chinese word segmentation technology!
Thanks!

this suppose to be free and ur forcing people to pay ur violating the gnu instead ad the donation if some 1 wants to donate the they will im gona report u for this sory m8 but this is not the way u should be doing it

If, in a far future, your English becomes readable, we eventually might enter into a useful discussion. I'm unwilled even to read such nonsense. While improving your fundamentals in English, you may also get a lesson that enables you to understand the difference between a free beer and free software.

Tec Wrote:
-------------------------------------------------------
> If, in a far future, your English becomes
> readable, we eventually might enter into a useful
> discussion. I'm unwilled even to read such
> nonsense. While improving your fundamentals in
> English, you may also get a lesson that enables
> you to understand the difference between a free
> beer and free software.


An Answer which affirmed the post before - congratulation...
I counted over 20 Bugs in the "abolute perfect new" version 2.0 -> I don't want to use this version any more...
It's a shame that it's too late reorder my money -> wasted money...

Fortunately you never ordered v.2.0. But be ensured that every download (folder access) is logged by ip, cc, time, etc. So I know quite well who you are. You don't need to create another new username here.

<<< the "abolute perfect new" version 2.0 >>> Never promised something gushy.

Meanwhile
[www.sphider.eu]



Edited 1 time(s). Last edit at 06/05/2009 02:43AM by Tec.

Tec Wrote:
-------------------------------------------------------
> If, in a far future, your English becomes
> readable, we eventually might enter into a useful
> discussion. I'm unwilled even to read such
> nonsense. While improving your fundamentals in
> English, you may also get a lesson that enables
> you to understand the difference between a free
> beer and free software.


look who is telling me to get a english lesson imao

look tec dont get me wrong but the deference between free beer and free software is deferent any how free is free so why forcing every 1 to pay just put a donation button if some 1 likes ur work or want to donate they will.

and you need to get a lesson not me dude ask any 1 here they will say the same thing ohh i saw a post some 1 told u that already lol

Ha, ha, ha! Not having laughed since a long time like when reading your posting. How stupid one must be to stumble into my trap. Not recognizing that I just caught you with a cit. But okay, for script kiddies, Richard Stallman is already a grandfather (like me). So you can't remember his statements.

Well knowing that it is waste of time, but here is a 'reading lesson' for your knowledge about free software:
[www.gnu.org]
Attention: reading and understanding this article will take some more effort than to write two phrases in pitmen English. That's all you offered until now.

Or do you need your lesson in short?
Cit (Richard Stallman):
"High or low fees, and the GNU GPL.
… the GNU General Public License (GNU GPL) has no requirements about how much you can charge for distributing a copy of free software. You can charge nothing, a penny, a dollar, or a billion dollars. It's up to you, and the marketplace, so don't complain to us if nobody wants to pay a billion dollars for a copy. . . . "

That is quite okay for my intention and me. No one is obliged to buy this software.

This will remain my last participation here. You may continue being envious that I'm going my way; not influenced by your chatter.

Tec

ps: should I be proud that since publishing v.2.0 of Sphider-plus (about 2 weeks ago from now) there had been 884 attempts to get this stuff without password? All recognized and IP blocked against future attacks.

what ever



Edited 1 time(s). Last edit at 06/13/2009 11:14PM by lex.

Tec Wrote:
-------------------------------------------------------
> Fortunately you never ordered v.2.0. But be
> ensured that every download (folder access) is
> logged by ip, cc, time, etc. So I know quite well
> who you are. You don't need to create another new
> username here.
>
> <<< the "abolute perfect new" version 2.0 >>>
> Never promised something gushy.
>
> Meanwhile
> [www.sphider.eu]
> sg-6140

lol, I also know who you are - and now?
Do you want a date with me? Ok, I will wear a blue rose and you a red, so we can find each other...
It unbeliveable for me, how your reaction is, but ok - when you want it in this way...

Everybody who want this version:
Mirror 1: [rapidshare.com] [updated]
Mirror 2: [ul.to] [updated]

GNU GPL allow also that I can public this version...


PS: Please, everybody who download this software, donate to tec - but only if you really want to do this!



Edited 2 time(s). Last edit at 06/10/2009 03:20AM by dor_neue.

dor_neue Wrote:
-------------------------------------------------------
> Tec Wrote:
> --------------------------------------------------
> -----
> > Fortunately you never ordered v.2.0. But be
> > ensured that every download (folder access) is
> > logged by ip, cc, time, etc. So I know quite
> well
> > who you are. You don't need to create another
> new
> > username here.
> >
> > <<< the "abolute perfect new" version 2.0 >>>
> > Never promised something gushy.
> >
> > Meanwhile
> >
> [www.sphider.eu]
>
> > sg-6140
>
> lol, I also know who you are - and now?
> Do you want a date with me? Ok, I will wear a blue
> rose and you a red, so we can find each other...
>
> It unbeliveable for me, how your reaction is, but
> ok - when you want it in this way...
>
> Everybody who want this version:
> Mirror 1:
> [rapidshare.com]
> _v.2.0.zip
> Mirror 2: [ul.to]
>
> GNU GPL allow also that I can public this
> version...
>
>
> PS: Please, everybody who download this software,
> donate to tec - but only if you really want to do
> this!


thats what im talking about thanks brother so nice of you sharing it and i hate tec lol

lex Wrote:
>
> thats what im talking about thanks brother so nice
> of you sharing it and i hate tec lol

I don't hate him. I can't understand his way of support. When a user ask for support, a programmer can't tell him the files to change if he want it. Ok, I can change this - and the next user? He also has to change it by himself? That can't be the right way...

By the way, he (tec) changed his homepage and replaced the part with donation. I think it's a first step in the right direction...

So long, if one of the links doesn't work anymore, send a PN to me and I reupp it...

@tec: I still waiting for our date... I live only a few kilometers away from you



Edited 1 time(s). Last edit at 06/14/2009 04:47PM by dor_neue.

i dont hate hate him u know i just said that bcoz i was angry lol he is a good guy but u know if he makes it available publicaly then every 1 will make a doantion and he will get more visitors he can earn lots of money from ads iswell

Tec bad person. lex thanks, this is true.

I appreciate Tec taking the time to work on the Sphide Plus, so the Sphider Plus meets the standards as a world class search script. Plus, I expect others to support him and understand the effort he is putting toward this.

Thanks

Thankyou so much dor_neue for posting up the links. I tried Sphider-Plus for about 15 minutes and then quickly hit the delete button. I respect Tec's right to charge for his mods but it seems to me as though he's created a monster. The beauty of the original Sphider is its simplicity and lack of bullshit. Using Sphider-Plus was like taking a time machine back to a 90's website! I don't care how fantastic the features are in Sphider-Plus; the execution and horrendous graphical interface is enough to make you want to throw up. This is inevitably what happens when a coder dabbles in design! It's a pity because there is tremendous scope for some development company to properly revamp this awesome little program.

If it was done properly then I surely would pay good money for it.



Edited 1 time(s). Last edit at 07/13/2009 05:08PM by johnnybegood.

Hello Tec,

First, let me state that I do not contest the fact that you deserve some form of compensation for your continued development on this project. Having worked on some open source projects of my own, I understand the frustration of not being "monetarily" appreciated.

However my experience with open source projects has given me a decent understand of how the GPL works, including how it affects commercial projects.

Since what you are doing is providing a modified version of the original, you are obligated to release the sources to the public. You are in violation of the GPL by requiring payment to receive the sources of your modified version.

If you were providing scripts that were separate and original from Sphider and were merely including the original Sphider files as a set of resources for your own program, there would be no issue. If this were the case, you would only be obligated to provide a complete, unmodified copy of the original source code, including the unmodified GPL license along with your commercial application. An example would be if the original Sphider were object-oriented, you could create a set of child classes that were commercially available.

Here is a link for your reference: [www.gnu.org]

Hello,

Of course I do not know your experience with GPL licensed software, and which lawyer you consulted. But be ensured that I carefully checked the legal situation before commercializing Sphider-plus.

Already stated several times, but again I am citing Richard Stallman:
<<<When we speak of “free software”, we're talking about freedom, not price. (Think of “free speech”, not “free beer”.) Specifically, it means that a user is free to run the program, change the program, and redistribute the program with or without changes.>>>

You were pointing to the FAQs about the GNU Licenses. This is realy a good source to understand the GNU philosophy. By reading the FAQs, and additionally the article [www.gnu.org], please take into consideration that there is a big difference between the www community and the "user" of a software.


Some GNU FAQs :

If I use a piece of software that has been obtained under the GNU GPL, am I allowed to modify the original code into a new program, then distribute and sell that new program commercially?
You are allowed to sell copies of the modified program commercially, but only under the terms of the GNU GPL. Thus, for instance, you must make the source code available to the users of the program as described in the GPL, and they must be allowed to redistribute and modify it as described in the GPL.
These requirements are the condition for including the GPL-covered code you received in a program of your own.

Comment: <<< you must make the source code available to the users of the program >>>
The "users of the program" are my customers (those who bought Sphider-plus), not the www community. And all my customers do receive the source code; of original Sphider plus my modifications.


Does the GPL allow me to charge a fee for downloading the program from my site?
Yes. You can charge any fee you wish for distributing a copy of the program. If you distribute binaries by download, you must provide “equivalent access” to download the source—therefore, the fee to download source may not be greater than the fee to download the binary.

Comment: That is exactly what I do. In order to become a user of Sphider-plus, you are kindly requested to fee.


Does the GPL allow me to require that anyone who receives the software must pay me a fee and/or notify me?
No. In fact, a requirement like that would make the program non-free. If people have to pay when they get a copy of a program, or if they have to notify anyone in particular, then the program is not free. See the definition of free software.
The GPL is a free software license, and therefore it permits people to use and even redistribute the software without being required to pay anyone a fee for doing so.

Comment: This touches the rights of my users / customers. They are free to sell or distribute Sphider-plus as often as they like. I will not participate in any of their benefits.


Also stated several times in some other postings: no one is obliged to buy Sphider-plus. Original Sphider is satisfying several basic applications. The 25 Euro fee was established because I wanted to separate between serious interested (those who need debugging and are interested in more search engine options) and script kiddies who just want to play around with Sphider-plus. Not because I intend to buy a Ferrari next year.

I know it is an effort to study all the above articles, but I really don't like to repeat this dialog each time a new release of Sphider-plus is published. In order not to disturb the community of this forum any longer, I will resign of publishing further announcements. Also answering to more than 650 questions here in the forum is quite enough.

Tec



Edited 1 time(s). Last edit at 07/23/2009 07:31PM by Tec.

GPL FAQ
Does the GPL require that source code of modified versions be posted to the public?
But if you release the modified version to the public in some way, the GPL requires you to make the modified source code available to the program's users, under the GPL.

After reviewing the source code for sphider-plus 2.0, the application is a modification of the original. There is no separation in the files you provide between the original Sphider and the changes you have made to it. Therefore the program's users would be inclusive of all Sphider and Sphider-Plus users.

To me really it's not a huge deal, however I felt that I should stick up for the other users who have voiced the same issue, only to be belittled because English is not their native language.

see the problem is, people who take free open source code then build there own idea onto it, they seem to think they can sell it!

for example if i made an open source for just image search... then a developer came and took my code placed it into a video search and then started charing ppl to use it... i would be mad... because most of my hard work as gone into that image search and if i was going to sell it i would in the first place

so this is why we have a dilemma here

sphider-plus is just some extra code added from sphider! since most of the hard work is done i find it clealy unfair that you should charge for what a normal home developer can do for free with free information of the web...

if you released sphider-plus free then not only would you make more money you could add tiers to the script like phpld ect free verion get soo much to paid version who would get the full works.

This is excellent answer to "modifier's" (Tec) attitude towards community/GNU/original Sphider & (ab)use of this forum to advertise himself.

dor_neue Wrote:
-------------------------------------------------------
> Everybody who want this version:
> Mirror 1:
> [rapidshare.com]
> _v.2.0.zip
> Mirror 2: [ul.to]

So, does anyone have v2.1?
(I dont need it, but Id be happy to just see it uploaded/available to public, for free)



Edited 1 time(s). Last edit at 09/11/2009 06:21AM by rhino.

I need 2.1 version of Sphider Plus too.
Please upload.
Thank you!

rhino Wrote:
> (I dont need it, but Id be happy to just see it
> uploaded/available to public, for free)

Why?



Edited 2 time(s). Last edit at 09/21/2009 02:48PM by dor_neue.

Tec
I been working in GPL project and write code,
What you are doing is not allow acoriding GPL

Many company have try samething but they have backed and release the source code after FSF 100% free to public.
Here is two project I known have this issue company take the code and sell it as it own
Wine directx warper with some presue the company that sold it did release the code to public after few month.
mplayer www.mplayerhq.hu there player are in allot diffent dvd player (hardware) the manufactor are force to release
the code to public after FSF and other lawers did talk with them.

That mean anyone that request the source code for a GPL/LGPL program have right to get it for free.

But GPL/LGPL say if you put it on a CD/DVD and sell it, you have right to cover you cost.

Beside I just find sphider it seam really good search enginge as it is. it need few changes before it sute my own project that
I will release to public for free. I do not known when it will be release. I waiting on a answers from the devoper team about a question I mail them.

GreatLord Wrote:
-------------------------------------------------------
> Tec
> I been working in GPL project and write code,
> What you are doing is not allow acoriding GPL

In fact, download fees are allowed.

See [www.gnu.org].

<quote>

Does the GPL allow me to charge a fee for downloading the program from my site?

Yes. You can charge any fee you wish for distributing a copy of the program. If you distribute binaries by download, you must provide “equivalent access” to download the source—therefore, the fee to download source may not be greater than the fee to download the binary.

</quote>


>
> That mean anyone that request the source code for
> a GPL/LGPL program have right to get it for free.

Not true,

[www.gnu.org]

<quote>

Does the GPL require that source code of modified versions be posted to the public?

The GPL does not require you to release your modified version, or any part of it. You are free to make modifications and use them privately, without ever releasing them. This applies to organizations (including companies), too; an organization can make a modified version and use it internally without ever releasing it outside the organization.

But if you release the modified version to the public in some way, the GPL requires you to make the modified source code available to the program's users, under the GPL.

Thus, the GPL gives permission to release the modified program in certain ways, and not in other ways; but the decision of whether to release it is up to you.

</quote>

In fact, the misconceptions about GPL that you have raised are a major problem for companies using GPL software. What ever the legal basis or lack of legal basis for what someone is saying about GPL, companies aren't going to risk the hassle of someone coming at them and making *public* accusations against them for using GPL licensed software. The potential "stink factor" just not worth the risk.

So, for the most part, GPL software has not been adopted by companies ( except non-profits ) and will probably never be adopted for developing commercial applications so long at the threat of being attacked for using GPL exists. Sad, but that seems to be the fact of the matter.

I'm a developer with 30 years behind me who is looking for the next thing, so I've been watching Tec's efforts with great interest. I've been very discouraged by this thread and other threads demonstrating the same degree of rancor and ignorance about GPL. I wish people would check out the GPL FAQS page before attacking developers for imagined infractions of the licensing rules, but they don't. They just let the nasty talk fly, I guess just they like to do it, gives them a thrill of some sort.

So how do open source developers make a living with open license software ? My conclusion is that they don't, only one in a hundred is able to do it, if that many.

I admire Tec for what he has done and is trying to do. He's a much more patient and nicer person than I am, that's for sure.

- Bill B

Sorry I did miss about the pay fee the FAQ say. But it is fun what FSF lawers say and thery FAQ say. The lawers say diffent that the FAQ say, See WIne and there DirectX wine3d was rip from wine and sold by 3 party, FSF was involve in that process and force the company to release ít for free with source code.

That is my experies about GPL and FSF

In my experience, lawyers are more often part of the problem than the solution. Actually, programmers do the same thing when they try to make a big project out of a little project, I do it too. I guess it must be human nature.

I'm pretty sure that I have seen code that was ripped from other sources without attribution. In fact, in the course of my career, I've done it, especially back in the 1980s before open licensing. For example, I would buy a book about C++ data structures and use the examples to build an applications.

Even within a company, it was considered a bad thing to re-use someone else's code. Back in the old days, everyone was supposed to write date validation routines as if it was the first time it had ever been done. It was very boring to write the same code over and over again.

Later, programmers started using shared libraries and software engineering technology to be more productive and reduce coding errors.

In a way, the spirit of GPL is more important than the details of licensing. I think Tec has been true to the spirit of GPL, that is take it, improve it, pass it along. On the other hand, it's good to have the legal requirements in cases where someone is trying to steal GLP code.

I hadn't heard about wine3d, but FSF settled a court case with Cisco about GPL requirerments.

[www.fsf.org]

It's a good decision because FSF and Cisco are working together to find some way for Cisco to use GPL applications without violating the license, it's good for everyone. Also, if a company is making money from GPL code, a donation to the developer can help to "grease the wheels" a bit.

Come to think of it ... Tec has been sending emails to Ando Saabas ( the developer of Sphider ), but getting no rely. Maybe if he sent Ando a small check, he'd get a reply to his emails. ;-)

If you are interested, I've written an short article about "Making a Living from Open Source Software".
[billbreitmayer.com]

- Bill B

I just d/l sphider-plus (not paying for it) and try it out.

I found some issue with it.
he issue I have with sphider-plus 2.0 is that it can not index www.reactos.org but orginal sphider 1.3.4 code can.

Like the thing that Tec have done, it is thuse featuer I started implement in sphider my self.

Tec I did not mean attact u any way.
When you working on opensource project big one FSF say onething and FAQ say another.
that can be bit mess for a devloper. The search engine mod you have done is almost everything I want.

Tec do you using svn for keep track on changes local or GIT ?

I just pay for sphider-plus 2.1 see if it better or not.
I am working on a new website, it will have a public search engine that everyone can search on. it will index allot of web site.



Edited 1 time(s). Last edit at 10/10/2009 10:53AM by GreatLord.