SOLVED Case insensitive search using non English charsets

Hello guys,

I'm testing sphider.
As you know when you have a keyword "Book" in your web site and when you search "book" or "BOOK" or "Book" they all match the same page and highlight "Book". My problem is:

I use windows-1254 charset and I made my mysql table charset as latin5_turkish_ci and my html pages have windows-1254 charset. For example I have "AĞRI" in one of my page title. When I search "ağrı", It does not it only search for "ağrı" not "AĞRI" and as a result highlights "ağrı" only. Another example:
I have "ÇANAKKALE" in one of my pages. When I search "çanakkale" it says "did you mean Çanakkal" not "did you mean Çanakkale" and as a results returns no hit.

1- How can we define the script that both "ğ" and "Ğ" or , "ç" and "Ç", "ş" and "ş", "ı" and "I" are the same characters with just different cases and it should search without case sensitive as in case of other non special characters?

(Maybe by editing "commonfuncs.php" in line sttarting form 78 :

$entities = array
(
"&amp" => "&",
"&apos" => "'",
"Þ" => "Ş",
"ß" => "ß",
"à" => "à",
"á" => "á",............
)


Thanks in advance...



Edited 2 time(s). Last edit at 12/22/2011 08:09PM by test-sphider.

Hi guys,

Finally I solved my issue, and I am sure most of people had the same issue. Long story short, here is my I did for Turkish characters:

In commonfuncs.php, I removed Turkish accented words in remove accent words part. Then here comes the trick. In line 78 starts with "$entities", I added the followings chars:



$entities = array
(
"Ç" => "c",
"ç" => "c",
"Ğ" => "g",
"ğ" => "g",
"İ" => "i",
"ı" => "i",
"Ö" => "o",
"ö" => "o",
"Ş" => "s",
"ş" => "s",
"Ü" => "u",
"ü" => "u",



Then delete your database and do a clean index (Hint: you don't need to delete query log).

Worked for me..

One issue that remains is, it does not highlight the accented words even it finds them.
Hope one of you can solve this..



Edited 1 time(s). Last edit at 12/22/2011 08:07PM by test-sphider.